Jul 10 06:29:10 devstack cinder-volume[76184]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 10 06:29:10 devstack cinder-volume[76184]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 06:29:10 devstack cinder-volume[76184]: we strongly recommend against using it for new projects. Jul 10 06:29:10 devstack cinder-volume[76184]: If you are already using Eventlet, we recommend migrating to a different Jul 10 06:29:10 devstack cinder-volume[76184]: framework. For more detail see Jul 10 06:29:10 devstack cinder-volume[76184]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 06:29:10 devstack cinder-volume[76184]: import eventlet # noqa Jul 10 06:29:13 devstack cinder-volume[76184]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76184) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 06:29:13 devstack cinder-volume[76184]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76184) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 06:29:13 devstack cinder-volume[76184]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76184) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 06:29:14 devstack cinder-volume[76184]: INFO dbcounter [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] Registered counter for database cinder Jul 10 06:29:14 devstack cinder-volume[76184]: DEBUG oslo_db.sqlalchemy.engines [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76184) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 06:29:14 devstack cinder-volume[76184]: DEBUG dbcounter [-] [76184] Writer thread running {{(pid=76184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 06:29:14 devstack cinder-volume[76184]: INFO cinder.rpc [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 10 06:29:14 devstack cinder-volume[76184]: INFO cinder.rpc [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 10 06:29:14 devstack cinder-volume[76184]: DEBUG oslo_db.sqlalchemy.engines [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76184) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 06:29:14 devstack cinder-volume[76184]: INFO cinder.volume.manager [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] Determined volume DB was empty at startup. Jul 10 06:29:14 devstack cinder-volume[76184]: DEBUG cinder.volume.manager [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76184) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 10 06:29:14 devstack cinder-volume[76184]: INFO cinder.volume.manager [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 10 06:29:14 devstack cinder-volume[76184]: WARNING stevedore.named [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 06:29:14 devstack cinder-volume[76184]: WARNING castellan.key_manager [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 06:29:14 devstack cinder-volume[76184]: WARNING cinder.keymgr.conf_key_mgr [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 06:29:14 devstack cinder-volume[76184]: DEBUG cinder.volume.drivers.lvm [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76184) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 10 06:29:14 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_concurrency.processutils [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] CMD "cinder-rtstool verify" returned: 0 in 0.473s {{(pid=76184) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_db.sqlalchemy.engines [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76184) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 06:29:15 devstack cinder-volume[76184]: INFO cinder.rpc [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 10 06:29:15 devstack cinder-volume[76184]: INFO cinder.rpc [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 10 06:29:15 devstack cinder-volume[76184]: WARNING stevedore.named [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 06:29:15 devstack cinder-volume[76184]: WARNING castellan.key_manager [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 06:29:15 devstack cinder-volume[76184]: INFO cinder.volume.manager [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_db.sqlalchemy.engines [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76184) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 06:29:15 devstack cinder-volume[76184]: INFO oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] Starting 1 workers Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] Started child 76366 {{(pid=76184) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] Full set of CONF: {{(pid=76184) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] ******************************************************************************** {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] Configuration options gathered from: {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] ================================================================================ {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] allow_availability_zone_fallback = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] allow_compression_on_image_upload = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] allowed_direct_url_schemes = [] {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] api_rate_limit = True {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] auth_strategy = keystone {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] az_cache_duration = 3600 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_availability_zone = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_host = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_name = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_stats_polling_interval = 60 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backup_api_class = cinder.backup.api.API {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backup_name_template = backup-%s {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backup_use_same_host = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backup_use_temp_snapshot = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] chap_password = **** {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] chap_username = {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cinder_internal_tenant_project_id = 5b9fa264368a45ebbd501dd189e8a471 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cinder_internal_tenant_user_id = 76e5c2fdc6864f4e8dcbd897816b3f25 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cloned_volume_same_az = True {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cluster = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] compression_format = gzip {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] compute_api_class = cinder.compute.nova.API {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] config_dir = [] {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] config_source = [] {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] control_exchange = openstack {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] debug = True {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] default_availability_zone = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] default_group_type = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] default_volume_type = lvmdriver-1 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] disk_geometry = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] driver_client_cert = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] driver_client_cert_key = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76366]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] driver_data_namespace = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] driver_ssl_cert_path = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] driver_ssl_cert_verify = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] driver_use_ssl = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] enable_force_upload = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] enable_new_services = True {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] enable_unsupported_driver = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] enabled_backends = ['lvmdriver-1'] {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] enforce_multipath_for_image_xfer = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] filter_function = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] glance_api_insecure = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] glance_api_servers = ['http://192.168.122.62/image'] {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] glance_api_ssl_compression = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] glance_ca_certificates_file = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] glance_catalog_info = image:glance:publicURL {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] glance_certfile = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] glance_keyfile = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] glance_num_retries = 3 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] glance_request_timeout = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] goodness_function = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] graceful_shutdown_timeout = 5 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] group_api_class = cinder.group.api.API {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] host = devstack {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] image_compress_on_upload = True {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] image_conversion_address_space_limit = 1 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] image_conversion_cpu_limit = 60 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] image_conversion_disable = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] image_upload_use_cinder_backend = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] image_upload_use_internal_tenant = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] image_volume_cache_enabled = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] image_volume_cache_max_count = 0 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] image_volume_cache_max_size_gb = 0 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] init_host_max_objects_retrieval = 0 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] instance_format = [instance: %(uuid)s] {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] iscsi_target_flags = {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] iscsi_write_cache = on {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] iser_helper = tgtadm {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] iser_ip_address = 192.168.122.62 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] iser_port = 3260 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] log_color = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] log_config_append = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] log_dir = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] log_file = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] log_options = True {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] log_rotate_interval = 1 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] log_rotate_interval_type = days {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] log_rotation_type = none {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] max_age = 0 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] max_logfile_count = 30 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] max_logfile_size_mb = 200 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] max_over_subscription_ratio = 20.0 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] message_reap_interval = 86400 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] message_ttl = 2592000 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] migration_create_volume_timeout_secs = 300 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] monkey_patch = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] monkey_patch_modules = [] {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] my_ip = 192.168.122.62 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] no_snapshot_gb_quota = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] num_iser_scan_tries = 3 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] num_shell_tries = 3 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] num_volume_device_scan_tries = 3 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] nvmeof_conn_info_version = 1 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] nvmet_ns_id = 10 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] nvmet_port_id = 1 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] osapi_max_limit = 1000 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] osapi_volume_ext_list = [] {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] osapi_volume_listen = 0.0.0.0 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] osapi_volume_listen_port = 8776 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] osapi_volume_use_ssl = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] osapi_volume_workers = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] per_volume_size_limit = -1 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] periodic_fuzzy_delay = 60 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] periodic_interval = 60 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] project_id_regex = [0-9a-f\-]+ {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] public_endpoint = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] publish_errors = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] quota_backup_gigabytes = 1000 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] quota_backups = 10 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] quota_gigabytes = 1000 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] quota_groups = 10 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] quota_snapshots = 10 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] quota_volumes = 10 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] rate_limit_burst = 0 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] rate_limit_except_level = CRITICAL {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] rate_limit_interval = 0 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] reinit_driver_count = 3 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] replication_device = **** {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] report_discard_supported = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] report_interval = 120 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] reservation_clean_interval = 86400 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] reservation_expire = 86400 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] reserved_image_namespaces = [] {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] reserved_percentage = 0 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack sudo[76370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] rpc_response_timeout = 120 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] run_external_periodic_tasks = True {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] scst_target_driver = iscsi {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] scst_target_iqn_name = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack sudo[76370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] service_down_time = 720 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] shell_completion = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] snapshot_name_template = snapshot-%s {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] snapshot_same_host = True {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] split_loggers = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] state_path = /opt/stack/data/cinder {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] storage_availability_zone = nova {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] storage_protocol = iSCSI {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] syslog_log_facility = LOG_USER {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] target_helper = lioadm {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] target_ip_address = 192.168.122.62 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] target_port = 3260 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] target_protocol = iscsi {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] target_secondary_ip_addresses = [] {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] trace_flags = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] transfer_api_class = cinder.transfer.api.API {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] transport_url = **** {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] until_refresh = 0 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] use_chap_auth = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] use_default_quota_class = True {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] use_journal = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] use_json = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] use_multipath_for_image_xfer = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] use_stderr = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] use_syslog = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] verify_glance_signatures = enabled {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] volume_api_class = cinder.volume.api.API {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] volume_backend_name = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] volume_clear = zero {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] volume_clear_ionice = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] volume_clear_size = 0 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] volume_copy_bps_limit = 0 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] volume_dd_blocksize = 1M {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] volume_name_template = volume-%s {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] volume_service_inithost_offload = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] volume_usage_audit_period = month {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] zoning_mode = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_concurrency.disable_process_locking = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] keystone_authtoken.auth_section = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] keystone_authtoken.auth_type = password {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] keystone_authtoken.auth_version = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] keystone_authtoken.cache = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] keystone_authtoken.certfile = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] keystone_authtoken.delay_auth_decision = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] keystone_authtoken.http_connect_timeout = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] keystone_authtoken.include_service_catalog = True {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] keystone_authtoken.insecure = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] keystone_authtoken.interface = public {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] keystone_authtoken.keyfile = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] keystone_authtoken.memcache_password = {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] keystone_authtoken.memcache_username = {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] keystone_authtoken.region_name = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] keystone_authtoken.service_token_roles_required = True {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] keystone_authtoken.service_type = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] keystone_authtoken.token_cache_time = 300 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.62/identity {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cache.backend = dogpile.cache.null {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cache.backend_argument = **** {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cache.backend_expiration_time = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cache.config_prefix = cache.oslo {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cache.debug_cache_backend = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cache.enable_retry_client = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cache.enable_socket_keepalive = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cache.enabled = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cache.expiration_time = 600 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cache.hashclient_retry_attempts = 2 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cache.memcache_dead_retry = 300 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cache.memcache_pool_maxsize = 10 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cache.memcache_sasl_enabled = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cache.password = **** {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cache.proxies = [] {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cache.redis_db = 0 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cache.redis_sentinel_service_name = mymaster {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cache.redis_server = localhost:6379 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cache.retry_attempts = 2 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cache.retry_delay = 0.0 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cache.socket_keepalive_count = 1 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cache.socket_keepalive_idle = 1 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cache.socket_keepalive_interval = 1 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cache.socket_timeout = 1.0 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cache.tls_allowed_ciphers = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cache.tls_cafile = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cache.tls_certfile = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cache.tls_enabled = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cache.tls_keyfile = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cache.username = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] coordination.backend_url = **** {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] database.asyncio_connection = **** {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] database.asyncio_slave_connection = **** {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] database.backend = sqlalchemy {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] database.connection = **** {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] database.connection_debug = 0 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] database.connection_parameters = {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] database.connection_recycle_time = 3600 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] database.connection_trace = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] database.db_inc_retry_interval = True {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] database.db_max_retries = 20 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] database.db_max_retry_interval = 10 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] database.db_retry_interval = 1 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] database.max_overflow = 50 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] database.max_pool_size = 5 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] database.max_retries = 10 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] database.mysql_wsrep_sync_wait = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] database.pool_timeout = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] database.retry_interval = 10 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] database.slave_connection = **** {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] database.sqlite_synchronous = True {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] database.synchronous_reader = True {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] database.use_db_reconnect = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] profiler.connection_string = messaging:// {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] profiler.enabled = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] profiler.es_doc_type = notification {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] profiler.es_scroll_size = 10000 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] profiler.es_scroll_time = 2m {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] profiler.filter_error_trace = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] profiler.hmac_keys = **** {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] profiler.sentinel_service_name = mymaster {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] profiler.socket_timeout = 0.1 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] profiler.trace_requests = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] profiler.trace_sqlalchemy = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] profiler_jaeger.process_tags = {} {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] profiler_jaeger.service_name_prefix = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] profiler_otlp.service_name_prefix = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_policy.enforce_new_defaults = True {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_policy.enforce_scope = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_policy.policy_default_rule = default {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_policy.policy_file = policy.yaml {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_policy.remote_timeout = 60.0 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] privsep_osbrick.group = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] privsep_osbrick.helper_command = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] privsep_osbrick.user = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cinder_sys_admin.group = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cinder_sys_admin.helper_command = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] cinder_sys_admin.user = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] service_user.auth_section = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] service_user.auth_type = password {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] service_user.cafile = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] service_user.certfile = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] service_user.collect_timing = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] service_user.insecure = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] service_user.keyfile = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] service_user.send_service_user_token = True {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] service_user.split_loggers = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] service_user.timeout = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] glance.auth_section = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] glance.auth_type = password {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] glance.certfile = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] glance.collect_timing = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] glance.insecure = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] glance.keyfile = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] glance.region_name = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] glance.split_loggers = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] glance.timeout = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76366]: INFO cinder.volume.manager [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.backend_availability_zone = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.chap_password = **** {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.chap_username = {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.disk_geometry = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.driver_client_cert = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.driver_client_cert_key = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.driver_data_namespace = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.driver_use_ssl = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.enable_unsupported_driver = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.extra_capabilities = {} {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.filter_function = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.goodness_function = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.iscsi_target_flags = {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.iscsi_write_cache = on {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.iser_helper = tgtadm {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.iser_ip_address = 192.168.122.62 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.iser_port = 3260 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.lvm_mirrors = 0 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.lvm_share_target = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.lvm_type = auto {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.num_shell_tries = 3 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.nvmet_port_id = 1 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.replication_device = **** {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.report_discard_supported = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.reserved_percentage = 0 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.scst_target_driver = iscsi {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.scst_target_iqn_name = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.storage_protocol = iSCSI {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.target_helper = tgtadm {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.target_ip_address = 192.168.122.62 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.target_port = 3260 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.target_protocol = iscsi {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.trace_flags = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.unique_fqdn_network = True {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.use_chap_auth = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.volume_backend_name = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.volume_clear = zero {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.volume_clear_ionice = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.volume_clear_size = 0 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.volume_group = cinder-volumes {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_reports.file_event_handler = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_reports.log_dir = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.backend_availability_zone = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.backend_host = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.chap_password = **** {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.chap_username = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.chiscsi_conf = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.disk_geometry = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.driver_client_cert = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.driver_data_namespace = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.driver_use_ssl = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.extra_capabilities = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.filter_function = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.goodness_function = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.iser_helper = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.iser_ip_address = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.iser_port = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.iser_target_prefix = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.lvm_conf_file = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.lvm_mirrors = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.lvm_share_target = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.lvm_type = auto {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.num_shell_tries = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.048s {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.nvmet_port_id = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.replication_device = **** {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.report_discard_supported = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.reserved_percentage = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.scst_target_driver = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.storage_protocol = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.target_helper = lioadm {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.target_ip_address = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.target_port = 3260 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.target_protocol = iscsi {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.trace_flags = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.use_chap_auth = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.volume_clear = zero {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.volume_clear_size = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] lvmdriver-1.volumes_dir = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_messaging_rabbit.ssl = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_messaging_rabbit.ssl_version = {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_messaging_notifications.driver = [] {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_messaging_notifications.retry = -1 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] oslo_messaging_notifications.transport_url = **** {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] key_manager.fixed_key = **** {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] barbican.barbican_api_version = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] barbican.barbican_endpoint = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] barbican.barbican_endpoint_type = public {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] barbican.barbican_region_name = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] barbican.cafile = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] barbican.certfile = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] barbican.collect_timing = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] barbican.insecure = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] barbican.keyfile = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] barbican.number_of_retries = 60 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] barbican.retry_delay = 1 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] barbican.send_service_user_token = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] barbican.split_loggers = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] barbican.timeout = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] barbican.verify_ssl = True {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] barbican.verify_ssl_path = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] barbican_service_user.auth_section = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] barbican_service_user.auth_type = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] barbican_service_user.cafile = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] barbican_service_user.certfile = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] barbican_service_user.collect_timing = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] barbican_service_user.insecure = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] barbican_service_user.keyfile = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] barbican_service_user.split_loggers = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] barbican_service_user.timeout = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] vault.approle_role_id = **** {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] vault.approle_secret_id = **** {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] vault.kv_mountpoint = secret {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] vault.kv_path = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] vault.kv_version = 2 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] vault.namespace = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] vault.root_token_id = **** {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] vault.ssl_ca_crt_file = None {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:15 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] vault.timeout = 60.0 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:16 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] vault.use_ssl = False {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:16 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:29:16 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] ******************************************************************************** {{(pid=76184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 10 06:29:16 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:29:16 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:29:16 devstack sudo[76370]: pam_unix(sudo:session): session closed for user root Jul 10 06:29:16 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.734s {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:29:16 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:29:16 devstack sudo[76376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 06:29:16 devstack sudo[76376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:29:17 devstack sudo[76376]: pam_unix(sudo:session): session closed for user root Jul 10 06:29:17 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.667s {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:29:17 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:29:17 devstack cinder-volume[76366]: INFO cinder.brick.local_dev.lvm [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 10 06:29:17 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:29:17 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:29:17 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:29:17 devstack sudo[76630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 06:29:17 devstack sudo[76630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:29:17 devstack sudo[76630]: pam_unix(sudo:session): session closed for user root Jul 10 06:29:17 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.689s {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:29:17 devstack cinder-volume[76366]: DEBUG cinder.brick.local_dev.lvm [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76366) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 10 06:29:17 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:29:17 devstack sudo[76856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 06:29:17 devstack sudo[76856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:29:19 devstack sudo[76856]: pam_unix(sudo:session): session closed for user root Jul 10 06:29:19 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.495s {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:29:19 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:29:19 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:29:19 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:29:19 devstack sudo[77146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 06:29:19 devstack sudo[77146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:29:20 devstack sudo[77146]: pam_unix(sudo:session): session closed for user root Jul 10 06:29:20 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.720s {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:29:20 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:29:20 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:29:20 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:29:20 devstack sudo[77152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 10 06:29:20 devstack sudo[77152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:29:20 devstack sudo[77152]: pam_unix(sudo:session): session closed for user root Jul 10 06:29:20 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.716s {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:29:20 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:29:20 devstack sudo[77156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 06:29:20 devstack sudo[77156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:29:21 devstack sudo[77156]: pam_unix(sudo:session): session closed for user root Jul 10 06:29:21 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.898s {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:29:21 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:29:21 devstack sudo[77167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 06:29:21 devstack sudo[77167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:29:22 devstack sudo[77167]: pam_unix(sudo:session): session closed for user root Jul 10 06:29:22 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.660s {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:29:22 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:29:22 devstack sudo[77171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 06:29:22 devstack sudo[77171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:29:23 devstack sudo[77171]: pam_unix(sudo:session): session closed for user root Jul 10 06:29:23 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.901s {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:29:23 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:29:23 devstack sudo[77178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 06:29:23 devstack sudo[77178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:29:24 devstack sudo[77178]: pam_unix(sudo:session): session closed for user root Jul 10 06:29:24 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.725s {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:29:24 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:29:24 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:29:24 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:29:24 devstack sudo[77186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 06:29:24 devstack sudo[77186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:29:24 devstack sudo[77186]: pam_unix(sudo:session): session closed for user root Jul 10 06:29:24 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.719s {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:29:24 devstack cinder-volume[76366]: INFO cinder.volume.drivers.lvm [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 10 06:29:24 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:29:24 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:29:24 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:29:24 devstack sudo[77195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 06:29:24 devstack sudo[77195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:29:25 devstack cinder-volume[76184]: DEBUG dbcounter [-] [76184] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:29:25 devstack sudo[77195]: pam_unix(sudo:session): session closed for user root Jul 10 06:29:25 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.909s {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:29:25 devstack cinder-volume[76366]: DEBUG cinder.volume.drivers.lvm [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Updating volume stats {{(pid=76366) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 06:29:25 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:29:25 devstack sudo[77343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 06:29:25 devstack sudo[77343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:29:26 devstack sudo[77343]: pam_unix(sudo:session): session closed for user root Jul 10 06:29:26 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.671s {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:29:26 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:29:26 devstack sudo[77453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 06:29:26 devstack sudo[77453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:29:27 devstack sudo[77453]: pam_unix(sudo:session): session closed for user root Jul 10 06:29:27 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.663s {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:29:27 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:29:27 devstack sudo[77456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 06:29:27 devstack sudo[77456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:29:27 devstack sudo[77456]: pam_unix(sudo:session): session closed for user root Jul 10 06:29:27 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.629s {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:29:27 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:29:27 devstack sudo[77459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 06:29:27 devstack sudo[77459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:29:28 devstack sudo[77459]: pam_unix(sudo:session): session closed for user root Jul 10 06:29:28 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:29:28 devstack cinder-volume[76366]: INFO cinder.volume.driver [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Driver hasn't implemented _init_vendor_properties() Jul 10 06:29:28 devstack cinder-volume[76366]: DEBUG cinder.volume.driver [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76366) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 10 06:29:28 devstack cinder-volume[76366]: DEBUG oslo_db.sqlalchemy.engines [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76366) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 06:29:28 devstack cinder-volume[76366]: DEBUG dbcounter [-] [76366] Writer thread running {{(pid=76366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 06:29:28 devstack cinder-volume[76366]: DEBUG cinder.db.api [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Building query based on filter {{(pid=76366) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 10 06:29:28 devstack cinder-volume[76366]: DEBUG cinder.image.image_utils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76366) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 10 06:29:28 devstack cinder-volume[76366]: INFO cinder.keymgr.migration [None req-9a958289-81e5-46d6-87c5-ae36a3f8be26 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 10 06:29:28 devstack cinder-volume[76366]: DEBUG cinder.volume.drivers.lvm [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Updating volume stats {{(pid=76366) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 06:29:28 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:29:28 devstack sudo[77464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 06:29:28 devstack sudo[77464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:29:29 devstack sudo[77464]: pam_unix(sudo:session): session closed for user root Jul 10 06:29:29 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.658s {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:29:29 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:29:29 devstack sudo[77472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 06:29:29 devstack sudo[77472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:29:29 devstack sudo[77472]: pam_unix(sudo:session): session closed for user root Jul 10 06:29:29 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.665s {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:29:29 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:29:29 devstack sudo[77481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 06:29:29 devstack sudo[77481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:29:30 devstack sudo[77481]: pam_unix(sudo:session): session closed for user root Jul 10 06:29:30 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.692s {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:29:30 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:29:30 devstack sudo[77485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 06:29:30 devstack sudo[77485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:29:31 devstack sudo[77485]: pam_unix(sudo:session): session closed for user root Jul 10 06:29:31 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.652s {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:29:31 devstack cinder-volume[76366]: DEBUG cinder.manager [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Notifying Schedulers of capabilities ... {{(pid=76366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:29:31 devstack cinder-volume[76366]: INFO cinder.volume.manager [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Driver initialization completed successfully. Jul 10 06:29:31 devstack cinder-volume[76366]: INFO cinder.manager [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Initiating service 2 cleanup Jul 10 06:29:31 devstack cinder-volume[76366]: INFO cinder.manager [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Service 2 cleanup completed. Jul 10 06:29:31 devstack cinder-volume[76366]: DEBUG cinder.service [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Creating RPC server for service cinder-volume {{(pid=76366) start /opt/stack/cinder/cinder/service.py:231}} Jul 10 06:29:31 devstack cinder-volume[76366]: DEBUG cinder.service [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76366) start /opt/stack/cinder/cinder/service.py:237}} Jul 10 06:29:31 devstack cinder-volume[76366]: INFO cinder.volume.manager [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 10 06:29:31 devstack cinder-volume[76366]: DEBUG cinder.volume.drivers.lvm [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Updating volume stats {{(pid=76366) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 06:29:31 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:29:31 devstack sudo[77489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 06:29:31 devstack sudo[77489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:29:32 devstack sudo[77489]: pam_unix(sudo:session): session closed for user root Jul 10 06:29:32 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.702s {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:29:32 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:29:32 devstack sudo[77492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 06:29:32 devstack sudo[77492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:29:32 devstack sudo[77492]: pam_unix(sudo:session): session closed for user root Jul 10 06:29:32 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:29:32 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:29:32 devstack sudo[77552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 06:29:32 devstack sudo[77552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:29:33 devstack sudo[77552]: pam_unix(sudo:session): session closed for user root Jul 10 06:29:33 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.624s {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:29:33 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:29:33 devstack sudo[77555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 06:29:33 devstack sudo[77555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:29:33 devstack sudo[77555]: pam_unix(sudo:session): session closed for user root Jul 10 06:29:33 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.614s {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:29:33 devstack cinder-volume[76366]: INFO cinder.volume.manager [None req-4b9f5f77-c5b3-48fd-9f63-9bfe82a1a64d None None] Driver post RPC initialization completed successfully. Jul 10 06:29:43 devstack cinder-volume[76366]: DEBUG dbcounter [-] [76366] Writing DB stats cinder:SELECT=3 {{(pid=76366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:29:44 devstack cinder-volume[76366]: DEBUG dbcounter [-] [76366] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:30:00 devstack cinder-volume[76366]: DEBUG oslo_service.periodic_task [None req-d53ef427-80bb-4a35-8e0b-2508b96a4ee4 None None] Running periodic task VolumeManager._thread_info {{(pid=76366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:30:00 devstack cinder-volume[76366]: DEBUG cinder.volume.manager [None req-d53ef427-80bb-4a35-8e0b-2508b96a4ee4 None None] thread count: 6 {{(pid=76366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:30:00 devstack cinder-volume[76366]: DEBUG cinder.volume.manager [None req-d53ef427-80bb-4a35-8e0b-2508b96a4ee4 None None] thread info: [<_MainThread(MainThread, started 139682780582016)>, , , , , ] {{(pid=76366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:31:00 devstack cinder-volume[76366]: DEBUG oslo_service.periodic_task [None req-d53ef427-80bb-4a35-8e0b-2508b96a4ee4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:31:00 devstack cinder-volume[76366]: DEBUG cinder.volume.drivers.lvm [None req-d53ef427-80bb-4a35-8e0b-2508b96a4ee4 None None] Updating volume stats {{(pid=76366) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 06:31:00 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-d53ef427-80bb-4a35-8e0b-2508b96a4ee4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:31:01 devstack sudo[80407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 06:31:01 devstack sudo[80407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:31:01 devstack sudo[80407]: pam_unix(sudo:session): session closed for user root Jul 10 06:31:01 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-d53ef427-80bb-4a35-8e0b-2508b96a4ee4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.616s {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:31:01 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-d53ef427-80bb-4a35-8e0b-2508b96a4ee4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:31:01 devstack sudo[80772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 06:31:01 devstack sudo[80772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:31:02 devstack sudo[80772]: pam_unix(sudo:session): session closed for user root Jul 10 06:31:02 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-d53ef427-80bb-4a35-8e0b-2508b96a4ee4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.625s {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:31:02 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-d53ef427-80bb-4a35-8e0b-2508b96a4ee4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:31:02 devstack sudo[81103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 06:31:02 devstack sudo[81103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:31:02 devstack sudo[81103]: pam_unix(sudo:session): session closed for user root Jul 10 06:31:02 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-d53ef427-80bb-4a35-8e0b-2508b96a4ee4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.637s {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:31:02 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-d53ef427-80bb-4a35-8e0b-2508b96a4ee4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:31:02 devstack sudo[81448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 06:31:02 devstack sudo[81448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:31:03 devstack sudo[81448]: pam_unix(sudo:session): session closed for user root Jul 10 06:31:03 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-d53ef427-80bb-4a35-8e0b-2508b96a4ee4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.626s {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:31:03 devstack cinder-volume[76366]: DEBUG cinder.manager [None req-d53ef427-80bb-4a35-8e0b-2508b96a4ee4 None None] Notifying Schedulers of capabilities ... {{(pid=76366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:31:03 devstack cinder-volume[76366]: DEBUG oslo_service.periodic_task [None req-d53ef427-80bb-4a35-8e0b-2508b96a4ee4 None None] Running periodic task VolumeManager._thread_info {{(pid=76366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:31:03 devstack cinder-volume[76366]: DEBUG cinder.volume.manager [None req-d53ef427-80bb-4a35-8e0b-2508b96a4ee4 None None] thread count: 6 {{(pid=76366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:31:03 devstack cinder-volume[76366]: DEBUG cinder.volume.manager [None req-d53ef427-80bb-4a35-8e0b-2508b96a4ee4 None None] thread info: [<_MainThread(MainThread, started 139682780582016)>, , , , , ] {{(pid=76366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:31:43 devstack cinder-volume[76366]: DEBUG dbcounter [-] [76366] Writing DB stats cinder:SELECT=1 {{(pid=76366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:31:44 devstack cinder-volume[76366]: DEBUG dbcounter [-] [76366] Writing DB stats cinder:UPDATE=1 {{(pid=76366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:32:00 devstack cinder-volume[76366]: DEBUG oslo_service.periodic_task [None req-d53ef427-80bb-4a35-8e0b-2508b96a4ee4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:32:00 devstack cinder-volume[76366]: DEBUG cinder.volume.drivers.lvm [None req-d53ef427-80bb-4a35-8e0b-2508b96a4ee4 None None] Updating volume stats {{(pid=76366) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 06:32:00 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-d53ef427-80bb-4a35-8e0b-2508b96a4ee4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:32:01 devstack sudo[83762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 06:32:01 devstack sudo[83762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:32:01 devstack sudo[83762]: pam_unix(sudo:session): session closed for user root Jul 10 06:32:01 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-d53ef427-80bb-4a35-8e0b-2508b96a4ee4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.648s {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:32:01 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-d53ef427-80bb-4a35-8e0b-2508b96a4ee4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:32:01 devstack sudo[83783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 06:32:01 devstack sudo[83783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:32:02 devstack sudo[83783]: pam_unix(sudo:session): session closed for user root Jul 10 06:32:02 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-d53ef427-80bb-4a35-8e0b-2508b96a4ee4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.621s {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:32:02 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-d53ef427-80bb-4a35-8e0b-2508b96a4ee4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:32:02 devstack sudo[83808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 06:32:02 devstack sudo[83808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:32:02 devstack sudo[83808]: pam_unix(sudo:session): session closed for user root Jul 10 06:32:02 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-d53ef427-80bb-4a35-8e0b-2508b96a4ee4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.634s {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:32:02 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-d53ef427-80bb-4a35-8e0b-2508b96a4ee4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:32:02 devstack sudo[83836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 06:32:02 devstack sudo[83836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:32:03 devstack sudo[83836]: pam_unix(sudo:session): session closed for user root Jul 10 06:32:03 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-d53ef427-80bb-4a35-8e0b-2508b96a4ee4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.646s {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:32:03 devstack cinder-volume[76366]: DEBUG cinder.manager [None req-d53ef427-80bb-4a35-8e0b-2508b96a4ee4 None None] Notifying Schedulers of capabilities ... {{(pid=76366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:32:03 devstack cinder-volume[76366]: DEBUG oslo_service.periodic_task [None req-d53ef427-80bb-4a35-8e0b-2508b96a4ee4 None None] Running periodic task VolumeManager._thread_info {{(pid=76366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:32:03 devstack cinder-volume[76366]: DEBUG cinder.volume.manager [None req-d53ef427-80bb-4a35-8e0b-2508b96a4ee4 None None] thread count: 6 {{(pid=76366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:32:03 devstack cinder-volume[76366]: DEBUG cinder.volume.manager [None req-d53ef427-80bb-4a35-8e0b-2508b96a4ee4 None None] thread info: [<_MainThread(MainThread, started 139682780582016)>, , , , , ] {{(pid=76366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:33:00 devstack cinder-volume[76366]: DEBUG oslo_service.periodic_task [None req-d53ef427-80bb-4a35-8e0b-2508b96a4ee4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:33:00 devstack cinder-volume[76366]: DEBUG cinder.volume.drivers.lvm [None req-d53ef427-80bb-4a35-8e0b-2508b96a4ee4 None None] Updating volume stats {{(pid=76366) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 06:33:00 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-d53ef427-80bb-4a35-8e0b-2508b96a4ee4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:33:01 devstack sudo[85299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 06:33:01 devstack sudo[85299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:33:01 devstack sudo[85299]: pam_unix(sudo:session): session closed for user root Jul 10 06:33:01 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-d53ef427-80bb-4a35-8e0b-2508b96a4ee4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:33:01 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-d53ef427-80bb-4a35-8e0b-2508b96a4ee4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:33:01 devstack sudo[85325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 06:33:01 devstack sudo[85325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:33:02 devstack sudo[85325]: pam_unix(sudo:session): session closed for user root Jul 10 06:33:02 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-d53ef427-80bb-4a35-8e0b-2508b96a4ee4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.622s {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:33:02 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-d53ef427-80bb-4a35-8e0b-2508b96a4ee4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:33:02 devstack sudo[85331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 06:33:02 devstack sudo[85331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:33:02 devstack sudo[85331]: pam_unix(sudo:session): session closed for user root Jul 10 06:33:02 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-d53ef427-80bb-4a35-8e0b-2508b96a4ee4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.607s {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:33:02 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-d53ef427-80bb-4a35-8e0b-2508b96a4ee4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:33:02 devstack sudo[85336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 06:33:02 devstack sudo[85336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:33:03 devstack sudo[85336]: pam_unix(sudo:session): session closed for user root Jul 10 06:33:03 devstack cinder-volume[76366]: DEBUG oslo_concurrency.processutils [None req-d53ef427-80bb-4a35-8e0b-2508b96a4ee4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.649s {{(pid=76366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:33:03 devstack cinder-volume[76366]: DEBUG cinder.manager [None req-d53ef427-80bb-4a35-8e0b-2508b96a4ee4 None None] Notifying Schedulers of capabilities ... {{(pid=76366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:33:03 devstack cinder-volume[76366]: DEBUG oslo_service.periodic_task [None req-d53ef427-80bb-4a35-8e0b-2508b96a4ee4 None None] Running periodic task VolumeManager._thread_info {{(pid=76366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:33:03 devstack cinder-volume[76366]: DEBUG cinder.volume.manager [None req-d53ef427-80bb-4a35-8e0b-2508b96a4ee4 None None] thread count: 6 {{(pid=76366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:33:03 devstack cinder-volume[76366]: DEBUG cinder.volume.manager [None req-d53ef427-80bb-4a35-8e0b-2508b96a4ee4 None None] thread info: [<_MainThread(MainThread, started 139682780582016)>, , , , , ] {{(pid=76366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:33:43 devstack cinder-volume[76366]: DEBUG dbcounter [-] [76366] Writing DB stats cinder:SELECT=1 {{(pid=76366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:33:43 devstack cinder-volume[76366]: DEBUG dbcounter [-] [76366] Writing DB stats cinder:UPDATE=1 {{(pid=76366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:33:49 devstack cinder-volume[76184]: INFO oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] Caught SIGTERM, stopping children Jul 10 06:33:49 devstack cinder-volume[76184]: DEBUG oslo_concurrency.lockutils [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] Acquiring lock "singleton_lock" {{(pid=76184) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 06:33:49 devstack cinder-volume[76184]: DEBUG oslo_concurrency.lockutils [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] Acquired lock "singleton_lock" {{(pid=76184) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 06:33:49 devstack cinder-volume[76184]: DEBUG oslo_concurrency.lockutils [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] Releasing lock "singleton_lock" {{(pid=76184) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 06:33:49 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] Stop services. {{(pid=76184) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 10 06:33:49 devstack cinder-volume[76184]: DEBUG oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] Killing children. {{(pid=76184) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 10 06:33:49 devstack cinder-volume[76184]: INFO oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] Waiting on 1 children to exit Jul 10 06:33:51 devstack cinder-volume[76366]: DEBUG oslo_concurrency.lockutils [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] Acquiring lock "singleton_lock" {{(pid=76366) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 06:33:51 devstack cinder-volume[76366]: DEBUG oslo_concurrency.lockutils [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] Acquired lock "singleton_lock" {{(pid=76366) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 06:33:51 devstack cinder-volume[76366]: DEBUG oslo_concurrency.lockutils [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] Releasing lock "singleton_lock" {{(pid=76366) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 06:33:51 devstack cinder-volume[76366]: WARNING amqp [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 06:33:51 devstack cinder-volume[76366]: WARNING amqp [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 06:33:51 devstack cinder-volume[76184]: INFO oslo_service.backend._eventlet.service [None req-1a7606d2-7b48-4dfa-84a3-6fff13b05a5e None None] Child 76366 exited with status 0 Jul 10 06:33:51 devstack cinder-volume[86446]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 10 06:33:51 devstack cinder-volume[86446]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 06:33:51 devstack cinder-volume[86446]: we strongly recommend against using it for new projects. Jul 10 06:33:51 devstack cinder-volume[86446]: If you are already using Eventlet, we recommend migrating to a different Jul 10 06:33:51 devstack cinder-volume[86446]: framework. For more detail see Jul 10 06:33:51 devstack cinder-volume[86446]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 06:33:51 devstack cinder-volume[86446]: import eventlet # noqa Jul 10 06:33:53 devstack cinder-volume[86446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86446) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 06:33:53 devstack cinder-volume[86446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86446) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 06:33:53 devstack cinder-volume[86446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86446) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 06:33:54 devstack cinder-volume[86446]: INFO dbcounter [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] Registered counter for database cinder Jul 10 06:33:54 devstack cinder-volume[86446]: DEBUG oslo_db.sqlalchemy.engines [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86446) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 06:33:54 devstack cinder-volume[86446]: DEBUG dbcounter [-] [86446] Writer thread running {{(pid=86446) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 06:33:54 devstack cinder-volume[86446]: INFO cinder.rpc [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 10 06:33:54 devstack cinder-volume[86446]: INFO cinder.rpc [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 10 06:33:54 devstack cinder-volume[86446]: DEBUG oslo_db.sqlalchemy.engines [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86446) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 06:33:54 devstack cinder-volume[86446]: INFO cinder.volume.manager [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] Determined volume DB was empty at startup. Jul 10 06:33:54 devstack cinder-volume[86446]: DEBUG cinder.volume.manager [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86446) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 10 06:33:54 devstack cinder-volume[86446]: INFO cinder.volume.manager [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 10 06:33:54 devstack cinder-volume[86446]: WARNING stevedore.named [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 06:33:54 devstack cinder-volume[86446]: WARNING castellan.key_manager [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 06:33:54 devstack cinder-volume[86446]: WARNING cinder.keymgr.conf_key_mgr [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 06:33:55 devstack cinder-volume[86446]: INFO cinder.volume.manager [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_db.sqlalchemy.engines [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86446) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 06:33:55 devstack cinder-volume[86446]: INFO oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] Starting 1 workers Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] Started child 86659 {{(pid=86446) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] Full set of CONF: {{(pid=86446) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] ******************************************************************************** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] Configuration options gathered from: {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] ================================================================================ {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] allow_availability_zone_fallback = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] allow_compression_on_image_upload = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] allowed_direct_url_schemes = [] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] api_rate_limit = True {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] auth_strategy = keystone {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_availability_zone = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86659]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_host = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_name = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_stats_polling_interval = 60 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backup_api_class = cinder.backup.api.API {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backup_name_template = backup-%s {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backup_use_same_host = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backup_use_temp_snapshot = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] chap_password = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] chap_username = {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cinder_internal_tenant_project_id = 5b9fa264368a45ebbd501dd189e8a471 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cinder_internal_tenant_user_id = 76e5c2fdc6864f4e8dcbd897816b3f25 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cluster = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] compression_format = gzip {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] compute_api_class = cinder.compute.nova.API {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] config_dir = [] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] config_source = [] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] control_exchange = openstack {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] debug = True {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] default_availability_zone = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] default_group_type = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] default_volume_type = QuobyteHD {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] disk_geometry = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] driver_client_cert = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] driver_client_cert_key = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] driver_data_namespace = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] driver_ssl_cert_path = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] driver_ssl_cert_verify = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] driver_use_ssl = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] enable_new_services = True {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] enable_unsupported_driver = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] enabled_backends = ['QuobyteHD'] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] enforce_multipath_for_image_xfer = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-b96100f5-1ee5-480f-a51e-fc396c3abc7e None None] Starting volume driver QuobyteDriver (1.1.14) Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] filter_function = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] glance_api_insecure = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] glance_api_servers = ['http://192.168.122.62/image'] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] glance_api_ssl_compression = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] glance_ca_certificates_file = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] glance_catalog_info = image:glance:publicURL {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] glance_certfile = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.remotefs [None req-b96100f5-1ee5-480f-a51e-fc396c3abc7e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86659) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] glance_keyfile = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] glance_num_retries = 3 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] glance_request_timeout = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] goodness_function = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] graceful_shutdown_timeout = 5 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] group_api_class = cinder.group.api.API {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] host = devstack {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] image_compress_on_upload = True {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] image_conversion_address_space_limit = 1 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] image_conversion_cpu_limit = 60 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] image_conversion_disable = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] image_upload_use_cinder_backend = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] image_upload_use_internal_tenant = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] image_volume_cache_enabled = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] image_volume_cache_max_count = 0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] image_volume_cache_max_size_gb = 0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] init_host_max_objects_retrieval = 0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] instance_format = [instance: %(uuid)s] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] iscsi_target_flags = {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] iscsi_write_cache = on {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] iser_helper = tgtadm {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] iser_ip_address = 192.168.122.62 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] iser_port = 3260 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] log_color = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] log_config_append = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] log_dir = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] log_file = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] log_options = True {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] log_rotate_interval = 1 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] log_rotate_interval_type = days {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] log_rotation_type = none {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] max_age = 0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] max_logfile_count = 30 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] max_logfile_size_mb = 200 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] max_over_subscription_ratio = 20.0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] message_reap_interval = 86400 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] message_ttl = 2592000 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] migration_create_volume_timeout_secs = 300 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] monkey_patch = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] monkey_patch_modules = [] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] my_ip = 192.168.122.62 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] no_snapshot_gb_quota = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] num_iser_scan_tries = 3 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] num_shell_tries = 3 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] num_volume_device_scan_tries = 3 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] nvmeof_conn_info_version = 1 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] nvmet_ns_id = 10 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] nvmet_port_id = 1 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] osapi_max_limit = 1000 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] osapi_volume_ext_list = [] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] osapi_volume_listen_port = 8776 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] osapi_volume_use_ssl = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] osapi_volume_workers = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] per_volume_size_limit = -1 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] periodic_fuzzy_delay = 60 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] periodic_interval = 60 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] public_endpoint = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] publish_errors = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] quota_backup_gigabytes = 1000 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] quota_backups = 10 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] quota_gigabytes = 1000 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] quota_groups = 10 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] quota_snapshots = 10 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] quota_volumes = 10 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] rate_limit_burst = 0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] rate_limit_except_level = CRITICAL {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] rate_limit_interval = 0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] reinit_driver_count = 3 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] replication_device = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] report_discard_supported = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] report_interval = 120 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] reservation_clean_interval = 86400 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] reservation_expire = 86400 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] reserved_image_namespaces = [] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] reserved_percentage = 0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] rpc_response_timeout = 120 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] run_external_periodic_tasks = True {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] scst_target_driver = iscsi {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] scst_target_iqn_name = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] service_down_time = 720 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] shell_completion = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] snapshot_name_template = snapshot-%s {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] split_loggers = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] state_path = /opt/stack/data/cinder {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] storage_availability_zone = nova {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] storage_protocol = iSCSI {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] syslog_log_facility = LOG_USER {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] target_helper = lioadm {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] target_ip_address = 192.168.122.62 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] target_port = 3260 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] target_protocol = iscsi {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] target_secondary_ip_addresses = [] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] trace_flags = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] transport_url = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] until_refresh = 0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] use_chap_auth = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] use_default_quota_class = True {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] use_journal = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] use_json = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] use_multipath_for_image_xfer = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] use_stderr = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] use_syslog = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] verify_glance_signatures = enabled {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] volume_api_class = cinder.volume.api.API {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] volume_backend_name = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] volume_clear = zero {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] volume_clear_ionice = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] volume_clear_size = 0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] volume_copy_bps_limit = 0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] volume_dd_blocksize = 1M {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] volume_name_template = volume-%s {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] volume_service_inithost_offload = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] volume_usage_audit_period = month {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b96100f5-1ee5-480f-a51e-fc396c3abc7e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86659) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] zoning_mode = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_concurrency.disable_process_locking = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.quobyte [None req-b96100f5-1ee5-480f-a51e-fc396c3abc7e None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86659]: WARNING cinder.volume.drivers.quobyte [None req-b96100f5-1ee5-480f-a51e-fc396c3abc7e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b96100f5-1ee5-480f-a51e-fc396c3abc7e None None] Running cmd (subprocess): mount.quobyte {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] keystone_authtoken.auth_section = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] keystone_authtoken.auth_type = password {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] keystone_authtoken.auth_version = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] keystone_authtoken.cache = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] keystone_authtoken.certfile = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] keystone_authtoken.include_service_catalog = True {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] keystone_authtoken.insecure = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] keystone_authtoken.interface = public {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] keystone_authtoken.keyfile = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] keystone_authtoken.memcache_password = {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] keystone_authtoken.memcache_username = {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] keystone_authtoken.region_name = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] keystone_authtoken.service_type = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.62/identity {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cache.backend = dogpile.cache.null {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cache.backend_argument = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cache.backend_expiration_time = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cache.config_prefix = cache.oslo {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cache.debug_cache_backend = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cache.enable_retry_client = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cache.enable_socket_keepalive = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cache.enabled = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cache.expiration_time = 600 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cache.hashclient_retry_attempts = 2 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cache.memcache_dead_retry = 300 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cache.memcache_pool_maxsize = 10 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cache.memcache_sasl_enabled = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cache.password = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cache.proxies = [] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cache.redis_db = 0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cache.redis_server = localhost:6379 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cache.retry_attempts = 2 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cache.retry_delay = 0.0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cache.socket_keepalive_count = 1 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cache.socket_keepalive_idle = 1 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cache.socket_keepalive_interval = 1 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cache.socket_timeout = 1.0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cache.tls_allowed_ciphers = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cache.tls_cafile = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cache.tls_certfile = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cache.tls_enabled = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cache.tls_keyfile = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cache.username = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] coordination.backend_url = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] database.asyncio_connection = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] database.asyncio_slave_connection = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] database.backend = sqlalchemy {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] database.connection = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] database.connection_debug = 0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] database.connection_parameters = {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] database.connection_recycle_time = 3600 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] database.connection_trace = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] database.db_inc_retry_interval = True {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] database.db_max_retries = 20 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] database.db_max_retry_interval = 10 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] database.db_retry_interval = 1 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] database.max_overflow = 50 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] database.max_pool_size = 5 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] database.max_retries = 10 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] database.mysql_wsrep_sync_wait = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] database.pool_timeout = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] database.retry_interval = 10 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] database.slave_connection = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] database.sqlite_synchronous = True {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] database.synchronous_reader = True {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] database.use_db_reconnect = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] profiler.connection_string = messaging:// {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] profiler.enabled = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] profiler.es_doc_type = notification {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] profiler.es_scroll_size = 10000 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] profiler.es_scroll_time = 2m {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] profiler.filter_error_trace = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] profiler.hmac_keys = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] profiler.sentinel_service_name = mymaster {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] profiler.socket_timeout = 0.1 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] profiler.trace_requests = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] profiler.trace_sqlalchemy = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] profiler_jaeger.process_tags = {} {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] profiler_jaeger.service_name_prefix = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] profiler_otlp.service_name_prefix = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_policy.enforce_new_defaults = True {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_policy.enforce_scope = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_policy.policy_default_rule = default {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_policy.policy_file = policy.yaml {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] privsep_osbrick.group = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] privsep_osbrick.helper_command = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] privsep_osbrick.user = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cinder_sys_admin.group = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cinder_sys_admin.helper_command = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] cinder_sys_admin.user = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] service_user.auth_section = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] service_user.auth_type = password {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] service_user.cafile = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] service_user.certfile = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] service_user.collect_timing = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] service_user.insecure = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] service_user.keyfile = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] service_user.send_service_user_token = True {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] service_user.split_loggers = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] service_user.timeout = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] glance.auth_section = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b96100f5-1ee5-480f-a51e-fc396c3abc7e None None] CMD "mount.quobyte" returned: 1 in 0.110s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:33:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b96100f5-1ee5-480f-a51e-fc396c3abc7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] glance.auth_type = password {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b96100f5-1ee5-480f-a51e-fc396c3abc7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:33:55 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b96100f5-1ee5-480f-a51e-fc396c3abc7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] glance.certfile = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] glance.collect_timing = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86659]: INFO cinder.volume.drivers.quobyte [None req-b96100f5-1ee5-480f-a51e-fc396c3abc7e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 ... Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] glance.insecure = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] glance.keyfile = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] glance.region_name = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] glance.split_loggers = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] glance.timeout = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.backend_availability_zone = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.chap_password = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.chap_username = {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b96100f5-1ee5-480f-a51e-fc396c3abc7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 -c /etc/quobyte/client-cinder.cfg {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.disk_geometry = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.driver_client_cert = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.driver_client_cert_key = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.driver_data_namespace = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.driver_use_ssl = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.extra_capabilities = {} {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.filter_function = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.goodness_function = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.iscsi_target_flags = {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.iscsi_write_cache = on {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.iser_helper = tgtadm {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.iser_ip_address = 192.168.122.62 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.iser_port = 3260 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.nas_host = {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.nas_login = admin {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.nas_mount_options = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.nas_password = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.nas_private_key = {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.nas_share_path = {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.num_shell_tries = 3 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.quobyte_volume_url = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.replication_device = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.report_discard_supported = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.reserved_percentage = 0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.target_helper = tgtadm {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.target_ip_address = 192.168.122.62 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.target_port = 3260 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.target_protocol = iscsi {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.trace_flags = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.unique_fqdn_network = True {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.use_chap_auth = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.volume_backend_name = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack sudo[86663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 -c /etc/quobyte/client-cinder.cfg Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.volume_clear = zero {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.volume_clear_ionice = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.volume_clear_size = 0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack sudo[86663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_reports.file_event_handler = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_reports.log_dir = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.backend_availability_zone = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.backend_host = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.chap_password = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.chap_username = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.chiscsi_conf = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.disk_geometry = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.driver_client_cert = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.driver_data_namespace = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.driver_use_ssl = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.extra_capabilities = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.filter_function = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.goodness_function = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.iser_helper = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.iser_ip_address = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.iser_port = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.iser_target_prefix = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.nas_host = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.nas_login = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.nas_mount_options = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.nas_password = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.nas_private_key = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.nas_share_path = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.nas_ssh_port = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.num_shell_tries = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.nvmet_port_id = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.replication_device = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.report_discard_supported = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.reserved_percentage = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.scst_target_driver = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.storage_protocol = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.target_helper = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.target_ip_address = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.target_port = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.target_prefix = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.target_protocol = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.trace_flags = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.use_chap_auth = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.volume_clear = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.volume_clear_size = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] QuobyteHD.volumes_dir = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_messaging_rabbit.ssl = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_messaging_notifications.driver = [] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_messaging_notifications.retry = -1 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] key_manager.fixed_key = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] barbican.barbican_api_version = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] barbican.barbican_endpoint = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] barbican.barbican_endpoint_type = public {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] barbican.barbican_region_name = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] barbican.cafile = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] barbican.certfile = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] barbican.collect_timing = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] barbican.insecure = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] barbican.keyfile = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] barbican.number_of_retries = 60 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] barbican.retry_delay = 1 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] barbican.send_service_user_token = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] barbican.split_loggers = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] barbican.timeout = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] barbican.verify_ssl = True {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] barbican.verify_ssl_path = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] barbican_service_user.auth_section = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] barbican_service_user.auth_type = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] barbican_service_user.cafile = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] barbican_service_user.certfile = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] barbican_service_user.collect_timing = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] barbican_service_user.insecure = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] barbican_service_user.keyfile = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] barbican_service_user.split_loggers = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] barbican_service_user.timeout = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] vault.approle_role_id = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] vault.approle_secret_id = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] vault.kv_mountpoint = secret {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] vault.kv_path = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] vault.kv_version = 2 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] vault.namespace = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] vault.root_token_id = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] vault.ssl_ca_crt_file = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] vault.timeout = 60.0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] vault.use_ssl = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:33:55 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] ******************************************************************************** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 10 06:33:56 devstack sudo[86663]: pam_unix(sudo:session): session closed for user root Jul 10 06:33:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b96100f5-1ee5-480f-a51e-fc396c3abc7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.795s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:33:56 devstack cinder-volume[86659]: INFO cinder.volume.drivers.quobyte [None req-b96100f5-1ee5-480f-a51e-fc396c3abc7e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 succeeded Jul 10 06:33:56 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b96100f5-1ee5-480f-a51e-fc396c3abc7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:33:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b96100f5-1ee5-480f-a51e-fc396c3abc7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.830s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:33:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b96100f5-1ee5-480f-a51e-fc396c3abc7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:33:56 devstack sudo[86734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:33:56 devstack sudo[86734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:33:56 devstack sudo[86734]: pam_unix(sudo:session): session closed for user root Jul 10 06:33:56 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b96100f5-1ee5-480f-a51e-fc396c3abc7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.628s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:33:56 devstack cinder-volume[86659]: INFO cinder.volume.driver [None req-b96100f5-1ee5-480f-a51e-fc396c3abc7e None None] Driver hasn't implemented _init_vendor_properties() Jul 10 06:33:56 devstack cinder-volume[86659]: DEBUG cinder.volume.driver [None req-b96100f5-1ee5-480f-a51e-fc396c3abc7e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86659) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 10 06:33:56 devstack cinder-volume[86659]: DEBUG oslo_db.sqlalchemy.engines [None req-b96100f5-1ee5-480f-a51e-fc396c3abc7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86659) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 06:33:56 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writer thread running {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 06:33:56 devstack cinder-volume[86659]: DEBUG cinder.db.api [None req-b96100f5-1ee5-480f-a51e-fc396c3abc7e None None] Building query based on filter {{(pid=86659) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 10 06:33:56 devstack cinder-volume[86659]: DEBUG cinder.image.image_utils [None req-b96100f5-1ee5-480f-a51e-fc396c3abc7e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86659) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 10 06:33:56 devstack cinder-volume[86659]: INFO cinder.keymgr.migration [None req-ad47ea31-f613-4d75-af8e-7dc62eb62188 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 10 06:33:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b96100f5-1ee5-480f-a51e-fc396c3abc7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:33:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b96100f5-1ee5-480f-a51e-fc396c3abc7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:33:57 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b96100f5-1ee5-480f-a51e-fc396c3abc7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:33:57 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b96100f5-1ee5-480f-a51e-fc396c3abc7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:33:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b96100f5-1ee5-480f-a51e-fc396c3abc7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:33:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b96100f5-1ee5-480f-a51e-fc396c3abc7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:33:57 devstack sudo[86740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:33:57 devstack sudo[86740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:33:57 devstack sudo[86740]: pam_unix(sudo:session): session closed for user root Jul 10 06:33:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b96100f5-1ee5-480f-a51e-fc396c3abc7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.601s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:33:57 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-b96100f5-1ee5-480f-a51e-fc396c3abc7e None None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:33:57 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-b96100f5-1ee5-480f-a51e-fc396c3abc7e None None] Driver initialization completed successfully. Jul 10 06:33:57 devstack cinder-volume[86659]: INFO cinder.manager [None req-b96100f5-1ee5-480f-a51e-fc396c3abc7e None None] Initiating service 3 cleanup Jul 10 06:33:57 devstack cinder-volume[86659]: INFO cinder.manager [None req-b96100f5-1ee5-480f-a51e-fc396c3abc7e None None] Service 3 cleanup completed. Jul 10 06:33:57 devstack cinder-volume[86659]: DEBUG cinder.service [None req-b96100f5-1ee5-480f-a51e-fc396c3abc7e None None] Creating RPC server for service cinder-volume {{(pid=86659) start /opt/stack/cinder/cinder/service.py:231}} Jul 10 06:33:57 devstack cinder-volume[86659]: DEBUG cinder.service [None req-b96100f5-1ee5-480f-a51e-fc396c3abc7e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86659) start /opt/stack/cinder/cinder/service.py:237}} Jul 10 06:33:57 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-b96100f5-1ee5-480f-a51e-fc396c3abc7e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 10 06:33:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b96100f5-1ee5-480f-a51e-fc396c3abc7e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:33:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b96100f5-1ee5-480f-a51e-fc396c3abc7e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:33:57 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b96100f5-1ee5-480f-a51e-fc396c3abc7e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:33:57 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b96100f5-1ee5-480f-a51e-fc396c3abc7e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:33:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b96100f5-1ee5-480f-a51e-fc396c3abc7e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:33:57 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b96100f5-1ee5-480f-a51e-fc396c3abc7e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:33:57 devstack sudo[86748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:33:57 devstack sudo[86748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:33:58 devstack sudo[86748]: pam_unix(sudo:session): session closed for user root Jul 10 06:33:58 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b96100f5-1ee5-480f-a51e-fc396c3abc7e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.716s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:33:58 devstack cinder-volume[86659]: INFO cinder.volume.manager [None req-b96100f5-1ee5-480f-a51e-fc396c3abc7e None None] Driver post RPC initialization completed successfully. Jul 10 06:34:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b1c0961d-35d6-405d-b6d1-835de4ae0f64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:34:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b1c0961d-35d6-405d-b6d1-835de4ae0f64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:34:02 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b1c0961d-35d6-405d-b6d1-835de4ae0f64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=86659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:34:02 devstack cinder-volume[86659]: DEBUG cinder.volume.drivers.quobyte [None req-b1c0961d-35d6-405d-b6d1-835de4ae0f64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=86659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:34:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-b1c0961d-35d6-405d-b6d1-835de4ae0f64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:34:02 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b1c0961d-35d6-405d-b6d1-835de4ae0f64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:34:02 devstack sudo[86865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:34:02 devstack sudo[86865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:34:03 devstack sudo[86865]: pam_unix(sudo:session): session closed for user root Jul 10 06:34:03 devstack cinder-volume[86659]: DEBUG oslo_concurrency.processutils [None req-b1c0961d-35d6-405d-b6d1-835de4ae0f64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.576s {{(pid=86659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:34:03 devstack cinder-volume[86659]: DEBUG cinder.manager [None req-b1c0961d-35d6-405d-b6d1-835de4ae0f64 None None] Notifying Schedulers of capabilities ... {{(pid=86659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:34:05 devstack cinder-volume[86446]: INFO oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] Caught SIGTERM, stopping children Jul 10 06:34:05 devstack cinder-volume[86446]: DEBUG oslo_concurrency.lockutils [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] Acquiring lock "singleton_lock" {{(pid=86446) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 06:34:05 devstack cinder-volume[86446]: DEBUG oslo_concurrency.lockutils [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] Acquired lock "singleton_lock" {{(pid=86446) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 06:34:05 devstack cinder-volume[86446]: DEBUG oslo_concurrency.lockutils [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] Releasing lock "singleton_lock" {{(pid=86446) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 06:34:05 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] Stop services. {{(pid=86446) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 10 06:34:05 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] Killing children. {{(pid=86446) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 10 06:34:05 devstack cinder-volume[86446]: INFO oslo_service.backend._eventlet.service [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] Waiting on 1 children to exit Jul 10 06:34:07 devstack cinder-volume[86659]: DEBUG oslo_service.periodic_task [None req-b5d922cb-098d-4c8d-aa26-c3740fc0614e None None] Running periodic task VolumeManager._thread_info {{(pid=86659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:34:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b5d922cb-098d-4c8d-aa26-c3740fc0614e None None] thread count: 6 {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:34:07 devstack cinder-volume[86659]: DEBUG cinder.volume.manager [None req-b5d922cb-098d-4c8d-aa26-c3740fc0614e None None] thread info: [<_MainThread(MainThread, started 140002455310464)>, , , , , ] {{(pid=86659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:34:08 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=2 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:34:08 devstack cinder-volume[86659]: DEBUG dbcounter [-] [86659] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=86659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:34:10 devstack cinder-volume[86659]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 10 06:34:10 devstack cinder-volume[86996]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 10 06:34:10 devstack cinder-volume[86996]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 06:34:10 devstack cinder-volume[86996]: we strongly recommend against using it for new projects. Jul 10 06:34:10 devstack cinder-volume[86996]: If you are already using Eventlet, we recommend migrating to a different Jul 10 06:34:10 devstack cinder-volume[86996]: framework. For more detail see Jul 10 06:34:10 devstack cinder-volume[86996]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 06:34:10 devstack cinder-volume[86996]: import eventlet # noqa Jul 10 06:34:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] Acquiring lock "singleton_lock" {{(pid=86659) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 06:34:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] Acquired lock "singleton_lock" {{(pid=86659) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 06:34:11 devstack cinder-volume[86659]: DEBUG oslo_concurrency.lockutils [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] Releasing lock "singleton_lock" {{(pid=86659) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 06:34:11 devstack cinder-volume[86659]: WARNING amqp [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 06:34:11 devstack cinder-volume[86659]: WARNING amqp [None req-9f78f11a-f3ec-4810-94de-3ec9406412f0 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 06:34:12 devstack cinder-volume[86996]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86996) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 06:34:12 devstack cinder-volume[86996]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86996) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 06:34:12 devstack cinder-volume[86996]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86996) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 06:34:13 devstack cinder-volume[86996]: INFO dbcounter [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] Registered counter for database cinder Jul 10 06:34:13 devstack cinder-volume[86996]: DEBUG oslo_db.sqlalchemy.engines [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86996) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG dbcounter [-] [86996] Writer thread running {{(pid=86996) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 06:34:14 devstack cinder-volume[86996]: INFO cinder.rpc [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 10 06:34:14 devstack cinder-volume[86996]: INFO cinder.rpc [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_db.sqlalchemy.engines [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86996) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 06:34:14 devstack cinder-volume[86996]: INFO cinder.volume.manager [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] Determined volume DB was empty at startup. Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG cinder.volume.manager [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86996) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 10 06:34:14 devstack cinder-volume[86996]: WARNING stevedore.named [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 06:34:14 devstack cinder-volume[86996]: WARNING castellan.key_manager [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 06:34:14 devstack cinder-volume[86996]: WARNING cinder.keymgr.conf_key_mgr [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 06:34:14 devstack cinder-volume[86996]: INFO cinder.volume.manager [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_db.sqlalchemy.engines [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86996) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 06:34:14 devstack cinder-volume[86996]: INFO oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] Starting 1 workers Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] Started child 87294 {{(pid=86996) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] Full set of CONF: {{(pid=86996) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] ******************************************************************************** {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] Configuration options gathered from: {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] ================================================================================ {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] allow_availability_zone_fallback = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] allow_compression_on_image_upload = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] allowed_direct_url_schemes = [] {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] api_rate_limit = True {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] auth_strategy = keystone {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_availability_zone = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_host = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_name = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_stats_polling_interval = 60 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backup_api_class = cinder.backup.api.API {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[87294]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backup_name_template = backup-%s {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backup_use_same_host = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backup_use_temp_snapshot = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] chap_password = **** {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] chap_username = {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cinder_internal_tenant_project_id = 5b9fa264368a45ebbd501dd189e8a471 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cinder_internal_tenant_user_id = 76e5c2fdc6864f4e8dcbd897816b3f25 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cluster = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] compression_format = gzip {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] compute_api_class = cinder.compute.nova.API {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] config_dir = [] {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] config_source = [] {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] control_exchange = openstack {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] debug = True {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] default_availability_zone = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] default_group_type = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] default_volume_type = QuobyteHD {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] disk_geometry = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] driver_client_cert = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] driver_client_cert_key = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] driver_data_namespace = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] driver_ssl_cert_path = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] driver_ssl_cert_verify = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] driver_use_ssl = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] enable_new_services = True {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] enable_unsupported_driver = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] enabled_backends = ['QuobyteHD'] {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] enforce_multipath_for_image_xfer = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] filter_function = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] glance_api_insecure = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] glance_api_servers = ['http://192.168.122.62/image'] {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] glance_api_ssl_compression = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] glance_ca_certificates_file = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] glance_catalog_info = image:glance:publicURL {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] glance_certfile = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] glance_keyfile = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] glance_num_retries = 3 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] glance_request_timeout = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] goodness_function = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] graceful_shutdown_timeout = 5 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] group_api_class = cinder.group.api.API {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] host = devstack {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] image_compress_on_upload = True {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] image_conversion_address_space_limit = 1 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] image_conversion_cpu_limit = 60 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] image_conversion_disable = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] image_upload_use_cinder_backend = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] image_upload_use_internal_tenant = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] image_volume_cache_enabled = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] image_volume_cache_max_count = 0 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] image_volume_cache_max_size_gb = 0 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] init_host_max_objects_retrieval = 0 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] instance_format = [instance: %(uuid)s] {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] iscsi_target_flags = {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] iscsi_write_cache = on {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] iser_helper = tgtadm {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] iser_ip_address = 192.168.122.62 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] iser_port = 3260 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] log_color = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] log_config_append = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] log_dir = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] log_file = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] log_options = True {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] log_rotate_interval = 1 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] log_rotate_interval_type = days {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] log_rotation_type = none {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] max_age = 0 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] max_logfile_count = 30 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] max_logfile_size_mb = 200 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] max_over_subscription_ratio = 20.0 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] message_reap_interval = 86400 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] message_ttl = 2592000 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] migration_create_volume_timeout_secs = 300 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] monkey_patch = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] monkey_patch_modules = [] {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] my_ip = 192.168.122.62 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] no_snapshot_gb_quota = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] num_iser_scan_tries = 3 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] num_shell_tries = 3 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] num_volume_device_scan_tries = 3 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] nvmeof_conn_info_version = 1 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] nvmet_ns_id = 10 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] nvmet_port_id = 1 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] osapi_max_limit = 1000 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] osapi_volume_ext_list = [] {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] osapi_volume_listen_port = 8776 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] osapi_volume_use_ssl = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] osapi_volume_workers = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] per_volume_size_limit = -1 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] periodic_fuzzy_delay = 60 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] periodic_interval = 60 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] public_endpoint = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] publish_errors = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] quota_backup_gigabytes = 1000 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] quota_backups = 10 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] quota_gigabytes = 1000 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] quota_groups = 10 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] quota_snapshots = 10 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] quota_volumes = 10 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] rate_limit_burst = 0 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] rate_limit_except_level = CRITICAL {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] rate_limit_interval = 0 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] reinit_driver_count = 3 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] replication_device = **** {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] report_discard_supported = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-e8764713-e067-4377-8f1f-d1cfbda73b40 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] report_interval = 120 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] reservation_clean_interval = 86400 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] reservation_expire = 86400 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] reserved_image_namespaces = [] {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] reserved_percentage = 0 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] rpc_response_timeout = 120 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] run_external_periodic_tasks = True {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] scst_target_driver = iscsi {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] scst_target_iqn_name = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-e8764713-e067-4377-8f1f-d1cfbda73b40 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87294) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] service_down_time = 720 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] shell_completion = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] snapshot_name_template = snapshot-%s {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] split_loggers = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] state_path = /opt/stack/data/cinder {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] storage_availability_zone = nova {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] storage_protocol = iSCSI {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] syslog_log_facility = LOG_USER {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] target_helper = lioadm {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] target_ip_address = 192.168.122.62 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] target_port = 3260 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] target_protocol = iscsi {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] target_secondary_ip_addresses = [] {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] trace_flags = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] transport_url = **** {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] until_refresh = 0 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] use_chap_auth = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] use_default_quota_class = True {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] use_journal = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] use_json = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] use_multipath_for_image_xfer = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] use_stderr = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] use_syslog = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] verify_glance_signatures = enabled {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] volume_api_class = cinder.volume.api.API {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] volume_backend_name = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] volume_clear = zero {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] volume_clear_ionice = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] volume_clear_size = 0 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] volume_copy_bps_limit = 0 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] volume_dd_blocksize = 1M {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] volume_name_template = volume-%s {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] volume_service_inithost_offload = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] volume_usage_audit_period = month {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] zoning_mode = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_concurrency.disable_process_locking = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] keystone_authtoken.auth_section = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] keystone_authtoken.auth_type = password {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] keystone_authtoken.auth_version = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] keystone_authtoken.cache = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] keystone_authtoken.certfile = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] keystone_authtoken.include_service_catalog = True {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] keystone_authtoken.insecure = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] keystone_authtoken.interface = public {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] keystone_authtoken.keyfile = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] keystone_authtoken.memcache_password = {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] keystone_authtoken.memcache_username = {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] keystone_authtoken.region_name = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] keystone_authtoken.service_type = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.62/identity {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cache.backend = dogpile.cache.null {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cache.backend_argument = **** {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cache.backend_expiration_time = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cache.config_prefix = cache.oslo {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cache.debug_cache_backend = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cache.enable_retry_client = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cache.enable_socket_keepalive = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cache.enabled = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cache.expiration_time = 600 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cache.hashclient_retry_attempts = 2 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cache.memcache_dead_retry = 300 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cache.memcache_pool_maxsize = 10 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cache.memcache_sasl_enabled = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cache.password = **** {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cache.proxies = [] {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cache.redis_db = 0 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cache.redis_server = localhost:6379 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cache.retry_attempts = 2 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cache.retry_delay = 0.0 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cache.socket_keepalive_count = 1 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cache.socket_keepalive_idle = 1 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cache.socket_keepalive_interval = 1 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cache.socket_timeout = 1.0 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cache.tls_allowed_ciphers = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cache.tls_cafile = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cache.tls_certfile = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cache.tls_enabled = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cache.tls_keyfile = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cache.username = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] coordination.backend_url = **** {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] database.asyncio_connection = **** {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] database.asyncio_slave_connection = **** {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] database.backend = sqlalchemy {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] database.connection = **** {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] database.connection_debug = 0 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] database.connection_parameters = {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] database.connection_recycle_time = 3600 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] database.connection_trace = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] database.db_inc_retry_interval = True {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] database.db_max_retries = 20 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] database.db_max_retry_interval = 10 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] database.db_retry_interval = 1 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] database.max_overflow = 50 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] database.max_pool_size = 5 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] database.max_retries = 10 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] database.mysql_wsrep_sync_wait = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] database.pool_timeout = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] database.retry_interval = 10 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] database.slave_connection = **** {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] database.sqlite_synchronous = True {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] database.synchronous_reader = True {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] database.use_db_reconnect = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] profiler.connection_string = messaging:// {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] profiler.enabled = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] profiler.es_doc_type = notification {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] profiler.es_scroll_size = 10000 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] profiler.es_scroll_time = 2m {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] profiler.filter_error_trace = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] profiler.hmac_keys = **** {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] profiler.sentinel_service_name = mymaster {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] profiler.socket_timeout = 0.1 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] profiler.trace_requests = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] profiler.trace_sqlalchemy = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] profiler_jaeger.process_tags = {} {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] profiler_jaeger.service_name_prefix = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] profiler_otlp.service_name_prefix = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_policy.enforce_new_defaults = True {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_policy.enforce_scope = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_policy.policy_default_rule = default {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_policy.policy_file = policy.yaml {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] privsep_osbrick.group = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] privsep_osbrick.helper_command = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] privsep_osbrick.user = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cinder_sys_admin.group = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cinder_sys_admin.helper_command = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-e8764713-e067-4377-8f1f-d1cfbda73b40 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87294) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] cinder_sys_admin.user = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] service_user.auth_section = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] service_user.auth_type = password {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] service_user.cafile = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] service_user.certfile = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.quobyte [None req-e8764713-e067-4377-8f1f-d1cfbda73b40 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] service_user.collect_timing = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.quobyte [None req-e8764713-e067-4377-8f1f-d1cfbda73b40 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] service_user.insecure = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] service_user.keyfile = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] service_user.send_service_user_token = True {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] service_user.split_loggers = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e8764713-e067-4377-8f1f-d1cfbda73b40 None None] Running cmd (subprocess): mount.quobyte {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] service_user.timeout = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] glance.auth_section = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] glance.auth_type = password {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] glance.certfile = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] glance.collect_timing = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] glance.insecure = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] glance.keyfile = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] glance.region_name = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] glance.split_loggers = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] glance.timeout = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.backend_availability_zone = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.chap_password = **** {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.chap_username = {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.disk_geometry = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.driver_client_cert = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.driver_client_cert_key = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.driver_data_namespace = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.driver_use_ssl = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.extra_capabilities = {} {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.filter_function = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.goodness_function = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.iscsi_target_flags = {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.iscsi_write_cache = on {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.iser_helper = tgtadm {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.iser_ip_address = 192.168.122.62 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.iser_port = 3260 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.nas_host = {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.nas_login = admin {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.nas_mount_options = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.nas_password = **** {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.nas_private_key = {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.nas_share_path = {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.num_shell_tries = 3 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.quobyte_volume_url = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.replication_device = **** {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.report_discard_supported = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.reserved_percentage = 0 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.target_helper = tgtadm {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.target_ip_address = 192.168.122.62 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.target_port = 3260 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.target_protocol = iscsi {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.trace_flags = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.unique_fqdn_network = True {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.use_chap_auth = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.volume_backend_name = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.volume_clear = zero {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.volume_clear_ionice = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.volume_clear_size = 0 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_reports.file_event_handler = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_reports.log_dir = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.backend_availability_zone = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.backend_host = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.chap_password = **** {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.chap_username = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.chiscsi_conf = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.disk_geometry = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.driver_client_cert = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.driver_data_namespace = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.driver_use_ssl = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.extra_capabilities = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.filter_function = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.goodness_function = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.iser_helper = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.iser_ip_address = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.iser_port = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.iser_target_prefix = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.nas_host = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.nas_login = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.nas_mount_options = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.nas_password = **** {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.nas_private_key = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.nas_share_path = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.nas_ssh_port = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.num_shell_tries = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.nvmet_port_id = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.replication_device = **** {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.report_discard_supported = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.reserved_percentage = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.scst_target_driver = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.storage_protocol = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.target_helper = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.target_ip_address = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.target_port = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack quobyte-client[87298]: Reading configuration file: /etc/quobyte/client.cfg Jul 10 06:34:14 devstack quobyte-client[87298]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.target_prefix = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.target_protocol = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.trace_flags = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.use_chap_auth = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.volume_clear = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.volume_clear_size = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e8764713-e067-4377-8f1f-d1cfbda73b40 None None] CMD "mount.quobyte" returned: 1 in 0.058s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e8764713-e067-4377-8f1f-d1cfbda73b40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e8764713-e067-4377-8f1f-d1cfbda73b40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-e8764713-e067-4377-8f1f-d1cfbda73b40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] QuobyteHD.volumes_dir = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-e8764713-e067-4377-8f1f-d1cfbda73b40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e8764713-e067-4377-8f1f-d1cfbda73b40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e8764713-e067-4377-8f1f-d1cfbda73b40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_messaging_rabbit.ssl = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_messaging_notifications.driver = [] {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_messaging_notifications.retry = -1 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] key_manager.fixed_key = **** {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] barbican.barbican_api_version = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] barbican.barbican_endpoint = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] barbican.barbican_endpoint_type = public {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] barbican.barbican_region_name = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] barbican.cafile = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] barbican.certfile = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] barbican.collect_timing = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] barbican.insecure = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] barbican.keyfile = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] barbican.number_of_retries = 60 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] barbican.retry_delay = 1 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] barbican.send_service_user_token = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] barbican.split_loggers = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] barbican.timeout = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] barbican.verify_ssl = True {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] barbican.verify_ssl_path = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] barbican_service_user.auth_section = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] barbican_service_user.auth_type = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] barbican_service_user.cafile = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] barbican_service_user.certfile = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] barbican_service_user.collect_timing = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] barbican_service_user.insecure = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] barbican_service_user.keyfile = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] barbican_service_user.split_loggers = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] barbican_service_user.timeout = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] vault.approle_role_id = **** {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] vault.approle_secret_id = **** {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] vault.kv_mountpoint = secret {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] vault.kv_path = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] vault.kv_version = 2 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] vault.namespace = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] vault.root_token_id = **** {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] vault.ssl_ca_crt_file = None {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] vault.timeout = 60.0 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] vault.use_ssl = False {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 06:34:14 devstack cinder-volume[86996]: DEBUG oslo_service.backend._eventlet.service [None req-de33ee0c-3a5a-4a84-a211-20e09a7d1b85 None None] ******************************************************************************** {{(pid=86996) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 10 06:34:14 devstack sudo[87299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:34:14 devstack sudo[87299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:34:15 devstack sudo[87299]: pam_unix(sudo:session): session closed for user root Jul 10 06:34:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e8764713-e067-4377-8f1f-d1cfbda73b40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.704s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:34:15 devstack cinder-volume[87294]: INFO cinder.volume.driver [None req-e8764713-e067-4377-8f1f-d1cfbda73b40 None None] Driver hasn't implemented _init_vendor_properties() Jul 10 06:34:15 devstack cinder-volume[87294]: DEBUG cinder.volume.driver [None req-e8764713-e067-4377-8f1f-d1cfbda73b40 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87294) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 10 06:34:15 devstack cinder-volume[87294]: DEBUG oslo_db.sqlalchemy.engines [None req-e8764713-e067-4377-8f1f-d1cfbda73b40 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87294) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 06:34:15 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writer thread running {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 06:34:15 devstack cinder-volume[87294]: DEBUG cinder.db.api [None req-e8764713-e067-4377-8f1f-d1cfbda73b40 None None] Building query based on filter {{(pid=87294) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 10 06:34:15 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-e8764713-e067-4377-8f1f-d1cfbda73b40 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87294) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 10 06:34:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e8764713-e067-4377-8f1f-d1cfbda73b40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:34:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e8764713-e067-4377-8f1f-d1cfbda73b40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:34:15 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-e8764713-e067-4377-8f1f-d1cfbda73b40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:34:15 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-e8764713-e067-4377-8f1f-d1cfbda73b40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:34:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e8764713-e067-4377-8f1f-d1cfbda73b40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:34:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e8764713-e067-4377-8f1f-d1cfbda73b40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:34:15 devstack cinder-volume[87294]: INFO cinder.keymgr.migration [None req-fe353b24-4f76-4ff7-acfc-2fba5cf59921 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 10 06:34:15 devstack sudo[87318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:34:15 devstack sudo[87318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:34:16 devstack sudo[87318]: pam_unix(sudo:session): session closed for user root Jul 10 06:34:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e8764713-e067-4377-8f1f-d1cfbda73b40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.690s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:34:16 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-e8764713-e067-4377-8f1f-d1cfbda73b40 None None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:34:16 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-e8764713-e067-4377-8f1f-d1cfbda73b40 None None] Driver initialization completed successfully. Jul 10 06:34:16 devstack cinder-volume[87294]: INFO cinder.manager [None req-e8764713-e067-4377-8f1f-d1cfbda73b40 None None] Initiating service 3 cleanup Jul 10 06:34:16 devstack cinder-volume[87294]: INFO cinder.manager [None req-e8764713-e067-4377-8f1f-d1cfbda73b40 None None] Service 3 cleanup completed. Jul 10 06:34:16 devstack cinder-volume[87294]: DEBUG cinder.service [None req-e8764713-e067-4377-8f1f-d1cfbda73b40 None None] Creating RPC server for service cinder-volume {{(pid=87294) start /opt/stack/cinder/cinder/service.py:231}} Jul 10 06:34:16 devstack cinder-volume[87294]: DEBUG cinder.service [None req-e8764713-e067-4377-8f1f-d1cfbda73b40 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87294) start /opt/stack/cinder/cinder/service.py:237}} Jul 10 06:34:16 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-e8764713-e067-4377-8f1f-d1cfbda73b40 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 10 06:34:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e8764713-e067-4377-8f1f-d1cfbda73b40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:34:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e8764713-e067-4377-8f1f-d1cfbda73b40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:34:16 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-e8764713-e067-4377-8f1f-d1cfbda73b40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:34:16 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-e8764713-e067-4377-8f1f-d1cfbda73b40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:34:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e8764713-e067-4377-8f1f-d1cfbda73b40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:34:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e8764713-e067-4377-8f1f-d1cfbda73b40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:34:16 devstack sudo[87366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:34:16 devstack sudo[87366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:34:16 devstack sudo[87366]: pam_unix(sudo:session): session closed for user root Jul 10 06:34:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e8764713-e067-4377-8f1f-d1cfbda73b40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.684s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:34:16 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-e8764713-e067-4377-8f1f-d1cfbda73b40 None None] Driver post RPC initialization completed successfully. Jul 10 06:34:21 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager._thread_info {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:34:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread count: 6 {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:34:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread info: [<_MainThread(MainThread, started 139245706264704)>, , , , , ] {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:34:24 devstack cinder-volume[86996]: DEBUG dbcounter [-] [86996] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86996) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:34:26 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:34:26 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:SELECT=3 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:35:21 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:35:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:35:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:35:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:35:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:35:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:35:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:35:21 devstack sudo[87811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:35:21 devstack sudo[87811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:35:23 devstack sudo[87811]: pam_unix(sudo:session): session closed for user root Jul 10 06:35:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.263s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:35:23 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:35:23 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager._thread_info {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:35:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread count: 6 {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:35:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread info: [<_MainThread(MainThread, started 139245706264704)>, , , , , ] {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:35:37 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-b770a379-64a7-48c0-8cc8-ad97308ad481 tempest-DeleteServersTestJSON-28821453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:35:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b770a379-64a7-48c0-8cc8-ad97308ad481 tempest-DeleteServersTestJSON-28821453 None] Flow 'volume_create_manager' (b8c7726b-8a2f-43f5-ab59-0a905a741ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:35:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b770a379-64a7-48c0-8cc8-ad97308ad481 tempest-DeleteServersTestJSON-28821453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (117d8ab3-9fab-4cf3-888a-0c9d374e73c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:35:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b770a379-64a7-48c0-8cc8-ad97308ad481 tempest-DeleteServersTestJSON-28821453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (117d8ab3-9fab-4cf3-888a-0c9d374e73c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-92996453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b663380-4930-4ad7-b5b3-e20d58981f18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d5391c84c3548cbb94f8d8de117aadd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:35:37Z,use_quota=True,user_id='78c6f00657a54e409d6ecd8f1f0ccceb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:35:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b770a379-64a7-48c0-8cc8-ad97308ad481 tempest-DeleteServersTestJSON-28821453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (940bdacb-2d72-4015-b60a-f8ff088f1166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:35:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b770a379-64a7-48c0-8cc8-ad97308ad481 tempest-DeleteServersTestJSON-28821453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (940bdacb-2d72-4015-b60a-f8ff088f1166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:35:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b770a379-64a7-48c0-8cc8-ad97308ad481 tempest-DeleteServersTestJSON-28821453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (873da476-fec6-4d8e-8284-10e8bcaea475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:35:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b770a379-64a7-48c0-8cc8-ad97308ad481 tempest-DeleteServersTestJSON-28821453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (873da476-fec6-4d8e-8284-10e8bcaea475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b663380-4930-4ad7-b5b3-e20d58981f18', 'volume_name': 'volume-6b663380-4930-4ad7-b5b3-e20d58981f18', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:35:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b770a379-64a7-48c0-8cc8-ad97308ad481 tempest-DeleteServersTestJSON-28821453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cdb16e0-d5b6-4cee-80e3-20593d0236a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:35:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b770a379-64a7-48c0-8cc8-ad97308ad481 tempest-DeleteServersTestJSON-28821453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cdb16e0-d5b6-4cee-80e3-20593d0236a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:35:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b770a379-64a7-48c0-8cc8-ad97308ad481 tempest-DeleteServersTestJSON-28821453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33816dda-d0a5-4351-af03-c6767c2e58de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:35:37 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-b770a379-64a7-48c0-8cc8-ad97308ad481 tempest-DeleteServersTestJSON-28821453 None] Volume 6b663380-4930-4ad7-b5b3-e20d58981f18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b663380-4930-4ad7-b5b3-e20d58981f18', 'volume_size': 1} Jul 10 06:35:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b770a379-64a7-48c0-8cc8-ad97308ad481 tempest-DeleteServersTestJSON-28821453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:35:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b770a379-64a7-48c0-8cc8-ad97308ad481 tempest-DeleteServersTestJSON-28821453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:35:37 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b770a379-64a7-48c0-8cc8-ad97308ad481 tempest-DeleteServersTestJSON-28821453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-92996453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b663380-4930-4ad7-b5b3-e20d58981f18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d5391c84c3548cbb94f8d8de117aadd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:35:37Z,use_quota=True,user_id='78c6f00657a54e409d6ecd8f1f0ccceb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:35:37 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-b770a379-64a7-48c0-8cc8-ad97308ad481 tempest-DeleteServersTestJSON-28821453 None] Creating volume 6b663380-4930-4ad7-b5b3-e20d58981f18 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:35:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b770a379-64a7-48c0-8cc8-ad97308ad481 tempest-DeleteServersTestJSON-28821453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:35:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b770a379-64a7-48c0-8cc8-ad97308ad481 tempest-DeleteServersTestJSON-28821453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:35:37 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b770a379-64a7-48c0-8cc8-ad97308ad481 tempest-DeleteServersTestJSON-28821453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:35:37 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b770a379-64a7-48c0-8cc8-ad97308ad481 tempest-DeleteServersTestJSON-28821453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:35:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b770a379-64a7-48c0-8cc8-ad97308ad481 tempest-DeleteServersTestJSON-28821453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:35:37 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b770a379-64a7-48c0-8cc8-ad97308ad481 tempest-DeleteServersTestJSON-28821453 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:35:37 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-b770a379-64a7-48c0-8cc8-ad97308ad481 tempest-DeleteServersTestJSON-28821453 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:35:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b770a379-64a7-48c0-8cc8-ad97308ad481 tempest-DeleteServersTestJSON-28821453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6b663380-4930-4ad7-b5b3-e20d58981f18 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:35:37 devstack sudo[88068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6b663380-4930-4ad7-b5b3-e20d58981f18 1073741824 Jul 10 06:35:37 devstack sudo[88068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:35:39 devstack sudo[88068]: pam_unix(sudo:session): session closed for user root Jul 10 06:35:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b770a379-64a7-48c0-8cc8-ad97308ad481 tempest-DeleteServersTestJSON-28821453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6b663380-4930-4ad7-b5b3-e20d58981f18 1073741824" returned: 0 in 2.274s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:35:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b770a379-64a7-48c0-8cc8-ad97308ad481 tempest-DeleteServersTestJSON-28821453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6b663380-4930-4ad7-b5b3-e20d58981f18 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:35:39 devstack sudo[88392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6b663380-4930-4ad7-b5b3-e20d58981f18 Jul 10 06:35:39 devstack sudo[88392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:35:41 devstack sudo[88392]: pam_unix(sudo:session): session closed for user root Jul 10 06:35:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b770a379-64a7-48c0-8cc8-ad97308ad481 tempest-DeleteServersTestJSON-28821453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6b663380-4930-4ad7-b5b3-e20d58981f18" returned: 0 in 1.257s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:35:41 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b770a379-64a7-48c0-8cc8-ad97308ad481 tempest-DeleteServersTestJSON-28821453 None] <== create_volume: return (3689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:35:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b770a379-64a7-48c0-8cc8-ad97308ad481 tempest-DeleteServersTestJSON-28821453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.702s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:35:41 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b770a379-64a7-48c0-8cc8-ad97308ad481 tempest-DeleteServersTestJSON-28821453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33816dda-d0a5-4351-af03-c6767c2e58de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b663380-4930-4ad7-b5b3-e20d58981f18', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:35:41 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b770a379-64a7-48c0-8cc8-ad97308ad481 tempest-DeleteServersTestJSON-28821453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (664bc6d8-2c43-489d-8ff2-aee8b34b1ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:35:41 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-b770a379-64a7-48c0-8cc8-ad97308ad481 tempest-DeleteServersTestJSON-28821453 None] Volume volume-6b663380-4930-4ad7-b5b3-e20d58981f18 (6b663380-4930-4ad7-b5b3-e20d58981f18): created successfully Jul 10 06:35:41 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b770a379-64a7-48c0-8cc8-ad97308ad481 tempest-DeleteServersTestJSON-28821453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (664bc6d8-2c43-489d-8ff2-aee8b34b1ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:35:41 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b770a379-64a7-48c0-8cc8-ad97308ad481 tempest-DeleteServersTestJSON-28821453 None] Flow 'volume_create_manager' (b8c7726b-8a2f-43f5-ab59-0a905a741ace) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:35:41 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-b770a379-64a7-48c0-8cc8-ad97308ad481 tempest-DeleteServersTestJSON-28821453 None] Created volume successfully. Jul 10 06:35:41 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-827fc7d5-acb4-483b-be50-e632d6796dd7 tempest-VolumesAdminNegativeTest-1680269323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:35:41 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-827fc7d5-acb4-483b-be50-e632d6796dd7 tempest-VolumesAdminNegativeTest-1680269323 None] Flow 'volume_create_manager' (af3c0e11-eb20-4e63-b523-0d5d9e30d65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:35:41 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-827fc7d5-acb4-483b-be50-e632d6796dd7 tempest-VolumesAdminNegativeTest-1680269323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeef765b-dd7b-4273-ab0e-b2cdac880ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:35:41 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-827fc7d5-acb4-483b-be50-e632d6796dd7 tempest-VolumesAdminNegativeTest-1680269323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeef765b-dd7b-4273-ab0e-b2cdac880ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1027633363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72480e58-4afa-46dd-80a3-bbb0293b4088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85ce66af6a2f424fb5d5e5a3241c4c7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:35:42Z,use_quota=True,user_id='9f6889df41fb4680b95f2b3be7560cd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:35:41 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-827fc7d5-acb4-483b-be50-e632d6796dd7 tempest-VolumesAdminNegativeTest-1680269323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37b7a309-96f1-49b3-af91-3f43ea95e694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:35:41 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-827fc7d5-acb4-483b-be50-e632d6796dd7 tempest-VolumesAdminNegativeTest-1680269323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37b7a309-96f1-49b3-af91-3f43ea95e694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:35:41 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-827fc7d5-acb4-483b-be50-e632d6796dd7 tempest-VolumesAdminNegativeTest-1680269323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1a668e1-83a3-4728-90aa-b10d15a4a483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:35:41 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-827fc7d5-acb4-483b-be50-e632d6796dd7 tempest-VolumesAdminNegativeTest-1680269323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1a668e1-83a3-4728-90aa-b10d15a4a483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72480e58-4afa-46dd-80a3-bbb0293b4088', 'volume_name': 'volume-72480e58-4afa-46dd-80a3-bbb0293b4088', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:35:41 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-827fc7d5-acb4-483b-be50-e632d6796dd7 tempest-VolumesAdminNegativeTest-1680269323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f50b6435-889e-4731-ae58-31cd503ea011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:35:41 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-827fc7d5-acb4-483b-be50-e632d6796dd7 tempest-VolumesAdminNegativeTest-1680269323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f50b6435-889e-4731-ae58-31cd503ea011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:35:41 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-827fc7d5-acb4-483b-be50-e632d6796dd7 tempest-VolumesAdminNegativeTest-1680269323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acd16028-b1dd-46d6-adac-ab6c89d7ae17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:35:41 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-827fc7d5-acb4-483b-be50-e632d6796dd7 tempest-VolumesAdminNegativeTest-1680269323 None] Volume 72480e58-4afa-46dd-80a3-bbb0293b4088: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72480e58-4afa-46dd-80a3-bbb0293b4088', 'volume_size': 1} Jul 10 06:35:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-827fc7d5-acb4-483b-be50-e632d6796dd7 tempest-VolumesAdminNegativeTest-1680269323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:35:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-827fc7d5-acb4-483b-be50-e632d6796dd7 tempest-VolumesAdminNegativeTest-1680269323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:35:41 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-827fc7d5-acb4-483b-be50-e632d6796dd7 tempest-VolumesAdminNegativeTest-1680269323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1027633363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72480e58-4afa-46dd-80a3-bbb0293b4088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85ce66af6a2f424fb5d5e5a3241c4c7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:35:42Z,use_quota=True,user_id='9f6889df41fb4680b95f2b3be7560cd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:35:41 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-827fc7d5-acb4-483b-be50-e632d6796dd7 tempest-VolumesAdminNegativeTest-1680269323 None] Creating volume 72480e58-4afa-46dd-80a3-bbb0293b4088 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:35:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-827fc7d5-acb4-483b-be50-e632d6796dd7 tempest-VolumesAdminNegativeTest-1680269323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:35:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-827fc7d5-acb4-483b-be50-e632d6796dd7 tempest-VolumesAdminNegativeTest-1680269323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:35:41 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-827fc7d5-acb4-483b-be50-e632d6796dd7 tempest-VolumesAdminNegativeTest-1680269323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:35:41 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-827fc7d5-acb4-483b-be50-e632d6796dd7 tempest-VolumesAdminNegativeTest-1680269323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:35:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-827fc7d5-acb4-483b-be50-e632d6796dd7 tempest-VolumesAdminNegativeTest-1680269323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:35:41 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-827fc7d5-acb4-483b-be50-e632d6796dd7 tempest-VolumesAdminNegativeTest-1680269323 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:35:41 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-827fc7d5-acb4-483b-be50-e632d6796dd7 tempest-VolumesAdminNegativeTest-1680269323 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:35:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-827fc7d5-acb4-483b-be50-e632d6796dd7 tempest-VolumesAdminNegativeTest-1680269323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-72480e58-4afa-46dd-80a3-bbb0293b4088 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:35:42 devstack sudo[88397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-72480e58-4afa-46dd-80a3-bbb0293b4088 1073741824 Jul 10 06:35:42 devstack sudo[88397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:35:43 devstack sudo[88397]: pam_unix(sudo:session): session closed for user root Jul 10 06:35:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-827fc7d5-acb4-483b-be50-e632d6796dd7 tempest-VolumesAdminNegativeTest-1680269323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-72480e58-4afa-46dd-80a3-bbb0293b4088 1073741824" returned: 0 in 1.495s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:35:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-827fc7d5-acb4-483b-be50-e632d6796dd7 tempest-VolumesAdminNegativeTest-1680269323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-72480e58-4afa-46dd-80a3-bbb0293b4088 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:35:43 devstack sudo[88452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-72480e58-4afa-46dd-80a3-bbb0293b4088 Jul 10 06:35:43 devstack sudo[88452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:35:44 devstack sudo[88452]: pam_unix(sudo:session): session closed for user root Jul 10 06:35:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-827fc7d5-acb4-483b-be50-e632d6796dd7 tempest-VolumesAdminNegativeTest-1680269323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-72480e58-4afa-46dd-80a3-bbb0293b4088" returned: 0 in 1.093s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:35:44 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-827fc7d5-acb4-483b-be50-e632d6796dd7 tempest-VolumesAdminNegativeTest-1680269323 None] <== create_volume: return (2671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:35:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-827fc7d5-acb4-483b-be50-e632d6796dd7 tempest-VolumesAdminNegativeTest-1680269323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.675s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:35:44 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-827fc7d5-acb4-483b-be50-e632d6796dd7 tempest-VolumesAdminNegativeTest-1680269323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acd16028-b1dd-46d6-adac-ab6c89d7ae17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72480e58-4afa-46dd-80a3-bbb0293b4088', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:35:44 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-827fc7d5-acb4-483b-be50-e632d6796dd7 tempest-VolumesAdminNegativeTest-1680269323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15d97ba0-f2ca-404a-9b41-370fcb428404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:35:44 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-827fc7d5-acb4-483b-be50-e632d6796dd7 tempest-VolumesAdminNegativeTest-1680269323 None] Volume volume-72480e58-4afa-46dd-80a3-bbb0293b4088 (72480e58-4afa-46dd-80a3-bbb0293b4088): created successfully Jul 10 06:35:44 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-827fc7d5-acb4-483b-be50-e632d6796dd7 tempest-VolumesAdminNegativeTest-1680269323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15d97ba0-f2ca-404a-9b41-370fcb428404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:35:44 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-827fc7d5-acb4-483b-be50-e632d6796dd7 tempest-VolumesAdminNegativeTest-1680269323 None] Flow 'volume_create_manager' (af3c0e11-eb20-4e63-b523-0d5d9e30d65c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:35:44 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-827fc7d5-acb4-483b-be50-e632d6796dd7 tempest-VolumesAdminNegativeTest-1680269323 None] Created volume successfully. Jul 10 06:35:45 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-5a2134b6-1cc9-4dbd-a73b-7e7d632958a4 tempest-VolumesAdminNegativeTest-1680269323 None] Acquiring lock "cinder-72480e58-4afa-46dd-80a3-bbb0293b4088-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:35:45 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-5a2134b6-1cc9-4dbd-a73b-7e7d632958a4 tempest-VolumesAdminNegativeTest-1680269323 None] Lock "cinder-72480e58-4afa-46dd-80a3-bbb0293b4088-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:35:45 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-5a2134b6-1cc9-4dbd-a73b-7e7d632958a4 tempest-VolumesAdminNegativeTest-1680269323 None] Acquiring lock "cinder-quobyte-72480e58-4afa-46dd-80a3-bbb0293b4088" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:35:45 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-5a2134b6-1cc9-4dbd-a73b-7e7d632958a4 tempest-VolumesAdminNegativeTest-1680269323 None] Lock "cinder-quobyte-72480e58-4afa-46dd-80a3-bbb0293b4088" acquired by "delete_volume" :: waited 0.026s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:35:45 devstack cinder-volume[87294]: INFO oslo.privsep.daemon [None req-5a2134b6-1cc9-4dbd-a73b-7e7d632958a4 tempest-VolumesAdminNegativeTest-1680269323 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp11yrxbc6/privsep.sock'] Jul 10 06:35:45 devstack sudo[88462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp11yrxbc6/privsep.sock Jul 10 06:35:45 devstack sudo[88462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:35:46 devstack cinder-volume[87294]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 10 06:35:46 devstack cinder-volume[87294]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 06:35:46 devstack cinder-volume[87294]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 10 06:35:46 devstack cinder-volume[87294]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 06:35:46 devstack cinder-volume[87294]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 10 06:35:46 devstack cinder-volume[87294]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 10 06:35:46 devstack cinder-volume[87294]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 06:35:46 devstack cinder-volume[87294]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 06:35:46 devstack cinder-volume[87294]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 10 06:35:47 devstack cinder-volume[87294]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 10 06:35:47 devstack cinder-volume[87294]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 06:35:47 devstack cinder-volume[87294]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 10 06:35:47 devstack cinder-volume[87294]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 06:35:47 devstack cinder-volume[87294]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 10 06:35:47 devstack cinder-volume[87294]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 10 06:35:47 devstack cinder-volume[87294]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 06:35:47 devstack cinder-volume[87294]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 06:35:47 devstack cinder-volume[87294]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 10 06:35:47 devstack sudo[88462]: pam_unix(sudo:session): session closed for user root Jul 10 06:35:47 devstack cinder-volume[87294]: INFO oslo.privsep.daemon [None req-5a2134b6-1cc9-4dbd-a73b-7e7d632958a4 tempest-VolumesAdminNegativeTest-1680269323 None] Spawned new privsep daemon via rootwrap Jul 10 06:35:47 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [None req-5a2134b6-1cc9-4dbd-a73b-7e7d632958a4 tempest-VolumesAdminNegativeTest-1680269323 None] Accepted privsep connection to /tmp/tmp11yrxbc6/privsep.sock {{(pid=87294) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 10 06:35:47 devstack cinder-volume[87294]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 10 06:35:47 devstack cinder-volume[87294]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 10 06:35:47 devstack cinder-volume[87294]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 10 06:35:47 devstack cinder-volume[87294]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88469 Jul 10 06:35:47 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[7252f960-e5c2-4e0e-b097-0d4cdbb3bc70]: (2,) {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:35:47 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9831d10-e2e8-4db9-b3aa-74551602924b]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:35:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5a2134b6-1cc9-4dbd-a73b-7e7d632958a4 tempest-VolumesAdminNegativeTest-1680269323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-72480e58-4afa-46dd-80a3-bbb0293b4088 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:35:47 devstack sudo[88471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-72480e58-4afa-46dd-80a3-bbb0293b4088 Jul 10 06:35:47 devstack sudo[88471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:35:48 devstack sudo[88471]: pam_unix(sudo:session): session closed for user root Jul 10 06:35:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5a2134b6-1cc9-4dbd-a73b-7e7d632958a4 tempest-VolumesAdminNegativeTest-1680269323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-72480e58-4afa-46dd-80a3-bbb0293b4088" returned: 0 in 0.959s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:35:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5a2134b6-1cc9-4dbd-a73b-7e7d632958a4 tempest-VolumesAdminNegativeTest-1680269323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-72480e58-4afa-46dd-80a3-bbb0293b4088 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:35:48 devstack sudo[88489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-72480e58-4afa-46dd-80a3-bbb0293b4088 Jul 10 06:35:48 devstack sudo[88489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:35:48 devstack cinder-volume[87294]: WARNING py.warnings [req-171f0c79-247b-403d-9b74-ca8139342039 req-6f7c8e45-e104-4ded-852b-75a10bf827b4 tempest-DeleteServersTestJSON-28821453 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jul 10 06:35:48 devstack cinder-volume[87294]: .first() Jul 10 06:35:48 devstack cinder-volume[87294]: Jul 10 06:35:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-171f0c79-247b-403d-9b74-ca8139342039 req-6f7c8e45-e104-4ded-852b-75a10bf827b4 tempest-DeleteServersTestJSON-28821453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:35:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-171f0c79-247b-403d-9b74-ca8139342039 req-6f7c8e45-e104-4ded-852b-75a10bf827b4 tempest-DeleteServersTestJSON-28821453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:35:48 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98e8aa7-0237-46b5-805e-cb690e944a89]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:35:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-171f0c79-247b-403d-9b74-ca8139342039 req-6f7c8e45-e104-4ded-852b-75a10bf827b4 tempest-DeleteServersTestJSON-28821453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6b663380-4930-4ad7-b5b3-e20d58981f18 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:35:49 devstack sudo[88492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6b663380-4930-4ad7-b5b3-e20d58981f18 Jul 10 06:35:49 devstack sudo[88492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:35:49 devstack sudo[88489]: pam_unix(sudo:session): session closed for user root Jul 10 06:35:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5a2134b6-1cc9-4dbd-a73b-7e7d632958a4 tempest-VolumesAdminNegativeTest-1680269323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-72480e58-4afa-46dd-80a3-bbb0293b4088" returned: 0 in 1.027s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:35:49 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-5a2134b6-1cc9-4dbd-a73b-7e7d632958a4 tempest-VolumesAdminNegativeTest-1680269323 None] Lock "cinder-quobyte-72480e58-4afa-46dd-80a3-bbb0293b4088" released by "delete_volume" :: held 3.836s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:35:49 devstack cinder-volume[87294]: WARNING cinder.quota [None req-5a2134b6-1cc9-4dbd-a73b-7e7d632958a4 tempest-VolumesAdminNegativeTest-1680269323 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:35:49 devstack cinder-volume[87294]: WARNING cinder.quota [None req-5a2134b6-1cc9-4dbd-a73b-7e7d632958a4 tempest-VolumesAdminNegativeTest-1680269323 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:35:49 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-5a2134b6-1cc9-4dbd-a73b-7e7d632958a4 tempest-VolumesAdminNegativeTest-1680269323 None] Created reservations ['5cc96b57-de59-4f26-bbaf-1a79595fd2bc', '9d501bb7-f3fe-4db6-ae70-35aa79e46793', '6c06f486-b058-45e4-9f25-afe8ff88aed1', '427ce4b6-c7c6-47b5-9c3b-a73e56d6d0a6'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:35:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5a2134b6-1cc9-4dbd-a73b-7e7d632958a4 tempest-VolumesAdminNegativeTest-1680269323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:35:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5a2134b6-1cc9-4dbd-a73b-7e7d632958a4 tempest-VolumesAdminNegativeTest-1680269323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:35:49 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5a2134b6-1cc9-4dbd-a73b-7e7d632958a4 tempest-VolumesAdminNegativeTest-1680269323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:35:49 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5a2134b6-1cc9-4dbd-a73b-7e7d632958a4 tempest-VolumesAdminNegativeTest-1680269323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:35:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5a2134b6-1cc9-4dbd-a73b-7e7d632958a4 tempest-VolumesAdminNegativeTest-1680269323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:35:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5a2134b6-1cc9-4dbd-a73b-7e7d632958a4 tempest-VolumesAdminNegativeTest-1680269323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:35:49 devstack sudo[88497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:35:49 devstack sudo[88497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:35:50 devstack sudo[88492]: pam_unix(sudo:session): session closed for user root Jul 10 06:35:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-171f0c79-247b-403d-9b74-ca8139342039 req-6f7c8e45-e104-4ded-852b-75a10bf827b4 tempest-DeleteServersTestJSON-28821453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6b663380-4930-4ad7-b5b3-e20d58981f18" returned: 0 in 1.651s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:35:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-171f0c79-247b-403d-9b74-ca8139342039 req-6f7c8e45-e104-4ded-852b-75a10bf827b4 tempest-DeleteServersTestJSON-28821453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.671s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:35:50 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-171f0c79-247b-403d-9b74-ca8139342039 req-6f7c8e45-e104-4ded-852b-75a10bf827b4 tempest-DeleteServersTestJSON-28821453 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804', 'name': 'volume-6b663380-4930-4ad7-b5b3-e20d58981f18', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '92f919dd-ed33-4275-88a1-49f995e0c077', 'enforce_multipath': True} {{(pid=87294) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:35:50 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-171f0c79-247b-403d-9b74-ca8139342039 req-6f7c8e45-e104-4ded-852b-75a10bf827b4 tempest-DeleteServersTestJSON-28821453 None] attachment_update completed successfully. Jul 10 06:35:51 devstack sudo[88497]: pam_unix(sudo:session): session closed for user root Jul 10 06:35:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5a2134b6-1cc9-4dbd-a73b-7e7d632958a4 tempest-VolumesAdminNegativeTest-1680269323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.421s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:35:51 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-5a2134b6-1cc9-4dbd-a73b-7e7d632958a4 tempest-VolumesAdminNegativeTest-1680269323 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:35:51 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-5a2134b6-1cc9-4dbd-a73b-7e7d632958a4 tempest-VolumesAdminNegativeTest-1680269323 None] Deleted volume successfully. Jul 10 06:35:51 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-5a2134b6-1cc9-4dbd-a73b-7e7d632958a4 tempest-VolumesAdminNegativeTest-1680269323 None] Lock "cinder-72480e58-4afa-46dd-80a3-bbb0293b4088-delete_volume" released by "delete_volume" :: held 5.690s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:36:00 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:SELECT=13,cinder:UPDATE=17,cinder:DELETE=1,cinder:INSERT=3 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:36:01 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:UPDATE=14,cinder:SELECT=16,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:36:01 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-7a0568a1-90f0-4a87-bf57-1f095576413d req-3c8f24fa-6d7a-4756-8628-50a7bf559432 tempest-DeleteServersTestJSON-28821453 None] Terminate volume connection completed successfully. Jul 10 06:36:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-7a0568a1-90f0-4a87-bf57-1f095576413d req-3c8f24fa-6d7a-4756-8628-50a7bf559432 tempest-DeleteServersTestJSON-28821453 None] Deleting attachment 92f919dd-ed33-4275-88a1-49f995e0c077. {{(pid=87294) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:36:05 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1acf683e-f666-4066-8d88-2045379ba74a tempest-DeleteServersTestJSON-28821453 None] Acquiring lock "cinder-6b663380-4930-4ad7-b5b3-e20d58981f18-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:36:05 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1acf683e-f666-4066-8d88-2045379ba74a tempest-DeleteServersTestJSON-28821453 None] Lock "cinder-6b663380-4930-4ad7-b5b3-e20d58981f18-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:36:05 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1acf683e-f666-4066-8d88-2045379ba74a tempest-DeleteServersTestJSON-28821453 None] Acquiring lock "cinder-quobyte-6b663380-4930-4ad7-b5b3-e20d58981f18" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:36:05 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1acf683e-f666-4066-8d88-2045379ba74a tempest-DeleteServersTestJSON-28821453 None] Lock "cinder-quobyte-6b663380-4930-4ad7-b5b3-e20d58981f18" acquired by "delete_volume" :: waited 0.034s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:36:05 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9dae0ec-d7f7-41a2-8a16-c130b4b630d4]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:36:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1acf683e-f666-4066-8d88-2045379ba74a tempest-DeleteServersTestJSON-28821453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6b663380-4930-4ad7-b5b3-e20d58981f18 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:36:05 devstack sudo[88978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6b663380-4930-4ad7-b5b3-e20d58981f18 Jul 10 06:36:05 devstack sudo[88978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:36:06 devstack sudo[88978]: pam_unix(sudo:session): session closed for user root Jul 10 06:36:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1acf683e-f666-4066-8d88-2045379ba74a tempest-DeleteServersTestJSON-28821453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6b663380-4930-4ad7-b5b3-e20d58981f18" returned: 0 in 0.935s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:36:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1acf683e-f666-4066-8d88-2045379ba74a tempest-DeleteServersTestJSON-28821453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6b663380-4930-4ad7-b5b3-e20d58981f18 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:36:06 devstack sudo[88983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6b663380-4930-4ad7-b5b3-e20d58981f18 Jul 10 06:36:06 devstack sudo[88983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:36:07 devstack sudo[88983]: pam_unix(sudo:session): session closed for user root Jul 10 06:36:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1acf683e-f666-4066-8d88-2045379ba74a tempest-DeleteServersTestJSON-28821453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6b663380-4930-4ad7-b5b3-e20d58981f18" returned: 0 in 0.820s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:36:07 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1acf683e-f666-4066-8d88-2045379ba74a tempest-DeleteServersTestJSON-28821453 None] Lock "cinder-quobyte-6b663380-4930-4ad7-b5b3-e20d58981f18" released by "delete_volume" :: held 1.822s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:36:07 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-1acf683e-f666-4066-8d88-2045379ba74a tempest-DeleteServersTestJSON-28821453 None] Created reservations ['4be95d0c-d18e-4afd-8705-50c1375ee13d', '56091ff5-f4d4-4e37-962f-8a832d5bf297', 'f47624da-9847-4764-94b5-ae5e3b5e54e7', 'c22ee3e9-20d4-46ba-8aaf-d61bdc319f1e'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:36:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-1acf683e-f666-4066-8d88-2045379ba74a tempest-DeleteServersTestJSON-28821453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:36:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-1acf683e-f666-4066-8d88-2045379ba74a tempest-DeleteServersTestJSON-28821453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:36:07 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-1acf683e-f666-4066-8d88-2045379ba74a tempest-DeleteServersTestJSON-28821453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:36:07 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-1acf683e-f666-4066-8d88-2045379ba74a tempest-DeleteServersTestJSON-28821453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:36:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-1acf683e-f666-4066-8d88-2045379ba74a tempest-DeleteServersTestJSON-28821453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:36:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1acf683e-f666-4066-8d88-2045379ba74a tempest-DeleteServersTestJSON-28821453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:36:07 devstack sudo[88989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:36:07 devstack sudo[88989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:36:08 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-17c89bdf-3d3a-4837-a5c5-185a41096fdd tempest-AttachVolumeNegativeTest-501522069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:36:08 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-17c89bdf-3d3a-4837-a5c5-185a41096fdd tempest-AttachVolumeNegativeTest-501522069 None] Flow 'volume_create_manager' (b33b8e83-6bba-4aa6-9ed8-81d424308158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:36:08 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-17c89bdf-3d3a-4837-a5c5-185a41096fdd tempest-AttachVolumeNegativeTest-501522069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73641887-73e0-47bd-a659-4fec431228ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:36:08 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-17c89bdf-3d3a-4837-a5c5-185a41096fdd tempest-AttachVolumeNegativeTest-501522069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73641887-73e0-47bd-a659-4fec431228ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-745902082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8755029e-3182-47c0-869a-f3d229b759ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d67c175cc144f4dbe428efa469dea02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:36:08Z,use_quota=True,user_id='ac6666bc6cf64f2880f353064ab98213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:36:08 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-17c89bdf-3d3a-4837-a5c5-185a41096fdd tempest-AttachVolumeNegativeTest-501522069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40f3c949-e815-470d-86c6-f764eff37be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:36:08 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-17c89bdf-3d3a-4837-a5c5-185a41096fdd tempest-AttachVolumeNegativeTest-501522069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40f3c949-e815-470d-86c6-f764eff37be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:36:08 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-17c89bdf-3d3a-4837-a5c5-185a41096fdd tempest-AttachVolumeNegativeTest-501522069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43f7499f-c184-4518-ae54-eb9dfff69784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:36:08 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-17c89bdf-3d3a-4837-a5c5-185a41096fdd tempest-AttachVolumeNegativeTest-501522069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43f7499f-c184-4518-ae54-eb9dfff69784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8755029e-3182-47c0-869a-f3d229b759ba', 'volume_name': 'volume-8755029e-3182-47c0-869a-f3d229b759ba', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:36:08 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-17c89bdf-3d3a-4837-a5c5-185a41096fdd tempest-AttachVolumeNegativeTest-501522069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56e114d4-eb3f-47f7-a2c2-124d7810d426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:36:08 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-17c89bdf-3d3a-4837-a5c5-185a41096fdd tempest-AttachVolumeNegativeTest-501522069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56e114d4-eb3f-47f7-a2c2-124d7810d426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:36:08 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-17c89bdf-3d3a-4837-a5c5-185a41096fdd tempest-AttachVolumeNegativeTest-501522069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9db2aea9-2a7e-4dd3-b93b-d4383f8620ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:36:08 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-17c89bdf-3d3a-4837-a5c5-185a41096fdd tempest-AttachVolumeNegativeTest-501522069 None] Volume 8755029e-3182-47c0-869a-f3d229b759ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8755029e-3182-47c0-869a-f3d229b759ba', 'volume_size': 1} Jul 10 06:36:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-17c89bdf-3d3a-4837-a5c5-185a41096fdd tempest-AttachVolumeNegativeTest-501522069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:36:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-17c89bdf-3d3a-4837-a5c5-185a41096fdd tempest-AttachVolumeNegativeTest-501522069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:36:08 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-17c89bdf-3d3a-4837-a5c5-185a41096fdd tempest-AttachVolumeNegativeTest-501522069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-745902082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8755029e-3182-47c0-869a-f3d229b759ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d67c175cc144f4dbe428efa469dea02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:36:08Z,use_quota=True,user_id='ac6666bc6cf64f2880f353064ab98213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:36:08 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-17c89bdf-3d3a-4837-a5c5-185a41096fdd tempest-AttachVolumeNegativeTest-501522069 None] Creating volume 8755029e-3182-47c0-869a-f3d229b759ba {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:36:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-17c89bdf-3d3a-4837-a5c5-185a41096fdd tempest-AttachVolumeNegativeTest-501522069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:36:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-17c89bdf-3d3a-4837-a5c5-185a41096fdd tempest-AttachVolumeNegativeTest-501522069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:36:08 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-17c89bdf-3d3a-4837-a5c5-185a41096fdd tempest-AttachVolumeNegativeTest-501522069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:36:08 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-17c89bdf-3d3a-4837-a5c5-185a41096fdd tempest-AttachVolumeNegativeTest-501522069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:36:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-17c89bdf-3d3a-4837-a5c5-185a41096fdd tempest-AttachVolumeNegativeTest-501522069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:36:08 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-17c89bdf-3d3a-4837-a5c5-185a41096fdd tempest-AttachVolumeNegativeTest-501522069 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:36:08 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-17c89bdf-3d3a-4837-a5c5-185a41096fdd tempest-AttachVolumeNegativeTest-501522069 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:36:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-17c89bdf-3d3a-4837-a5c5-185a41096fdd tempest-AttachVolumeNegativeTest-501522069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8755029e-3182-47c0-869a-f3d229b759ba 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:36:08 devstack sudo[88992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8755029e-3182-47c0-869a-f3d229b759ba 1073741824 Jul 10 06:36:08 devstack sudo[88992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:36:08 devstack sudo[88989]: pam_unix(sudo:session): session closed for user root Jul 10 06:36:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1acf683e-f666-4066-8d88-2045379ba74a tempest-DeleteServersTestJSON-28821453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.884s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:36:08 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-1acf683e-f666-4066-8d88-2045379ba74a tempest-DeleteServersTestJSON-28821453 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:36:08 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-1acf683e-f666-4066-8d88-2045379ba74a tempest-DeleteServersTestJSON-28821453 None] Deleted volume successfully. Jul 10 06:36:08 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1acf683e-f666-4066-8d88-2045379ba74a tempest-DeleteServersTestJSON-28821453 None] Lock "cinder-6b663380-4930-4ad7-b5b3-e20d58981f18-delete_volume" released by "delete_volume" :: held 3.013s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:36:09 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-725d1150-8804-495d-9a8c-9d83393aedb6 tempest-TaggedAttachmentsTest-2083764151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:36:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-725d1150-8804-495d-9a8c-9d83393aedb6 tempest-TaggedAttachmentsTest-2083764151 None] Flow 'volume_create_manager' (9810215d-5b94-495c-9c1e-179aa0ee122f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:36:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-725d1150-8804-495d-9a8c-9d83393aedb6 tempest-TaggedAttachmentsTest-2083764151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdf86a42-184b-4342-b455-6f33cb925733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:36:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-725d1150-8804-495d-9a8c-9d83393aedb6 tempest-TaggedAttachmentsTest-2083764151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdf86a42-184b-4342-b455-6f33cb925733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1345749029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df54afd9-6122-4f7c-b99a-476f7d574f5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4570fc56d1014e65912c55d4c1983d15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:36:09Z,use_quota=True,user_id='4a7f6d97135a4a91bc15da7796f5c0da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:36:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-725d1150-8804-495d-9a8c-9d83393aedb6 tempest-TaggedAttachmentsTest-2083764151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (240d7229-ad3a-46a0-b6c8-3dc69326cd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:36:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-725d1150-8804-495d-9a8c-9d83393aedb6 tempest-TaggedAttachmentsTest-2083764151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (240d7229-ad3a-46a0-b6c8-3dc69326cd8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:36:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-725d1150-8804-495d-9a8c-9d83393aedb6 tempest-TaggedAttachmentsTest-2083764151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0805dbd7-891a-44b1-880c-49944d75b4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:36:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-725d1150-8804-495d-9a8c-9d83393aedb6 tempest-TaggedAttachmentsTest-2083764151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0805dbd7-891a-44b1-880c-49944d75b4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df54afd9-6122-4f7c-b99a-476f7d574f5a', 'volume_name': 'volume-df54afd9-6122-4f7c-b99a-476f7d574f5a', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:36:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-725d1150-8804-495d-9a8c-9d83393aedb6 tempest-TaggedAttachmentsTest-2083764151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58229bb4-a5ff-411c-a3c2-e378756d3987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:36:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-725d1150-8804-495d-9a8c-9d83393aedb6 tempest-TaggedAttachmentsTest-2083764151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58229bb4-a5ff-411c-a3c2-e378756d3987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:36:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-725d1150-8804-495d-9a8c-9d83393aedb6 tempest-TaggedAttachmentsTest-2083764151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43931ecf-13cd-4c06-bb7a-33f67ab93741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:36:09 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-725d1150-8804-495d-9a8c-9d83393aedb6 tempest-TaggedAttachmentsTest-2083764151 None] Volume df54afd9-6122-4f7c-b99a-476f7d574f5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df54afd9-6122-4f7c-b99a-476f7d574f5a', 'volume_size': 1} Jul 10 06:36:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-725d1150-8804-495d-9a8c-9d83393aedb6 tempest-TaggedAttachmentsTest-2083764151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:36:09 devstack sudo[88992]: pam_unix(sudo:session): session closed for user root Jul 10 06:36:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-17c89bdf-3d3a-4837-a5c5-185a41096fdd tempest-AttachVolumeNegativeTest-501522069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8755029e-3182-47c0-869a-f3d229b759ba 1073741824" returned: 0 in 1.202s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:36:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-17c89bdf-3d3a-4837-a5c5-185a41096fdd tempest-AttachVolumeNegativeTest-501522069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8755029e-3182-47c0-869a-f3d229b759ba {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:36:09 devstack sudo[89000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8755029e-3182-47c0-869a-f3d229b759ba Jul 10 06:36:09 devstack sudo[89000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:36:10 devstack sudo[89000]: pam_unix(sudo:session): session closed for user root Jul 10 06:36:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-17c89bdf-3d3a-4837-a5c5-185a41096fdd tempest-AttachVolumeNegativeTest-501522069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8755029e-3182-47c0-869a-f3d229b759ba" returned: 0 in 0.828s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:36:10 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-17c89bdf-3d3a-4837-a5c5-185a41096fdd tempest-AttachVolumeNegativeTest-501522069 None] <== create_volume: return (2096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:36:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-17c89bdf-3d3a-4837-a5c5-185a41096fdd tempest-AttachVolumeNegativeTest-501522069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.100s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:36:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-725d1150-8804-495d-9a8c-9d83393aedb6 tempest-TaggedAttachmentsTest-2083764151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.065s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:36:10 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-725d1150-8804-495d-9a8c-9d83393aedb6 tempest-TaggedAttachmentsTest-2083764151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1345749029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df54afd9-6122-4f7c-b99a-476f7d574f5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4570fc56d1014e65912c55d4c1983d15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:36:09Z,use_quota=True,user_id='4a7f6d97135a4a91bc15da7796f5c0da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:36:10 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-725d1150-8804-495d-9a8c-9d83393aedb6 tempest-TaggedAttachmentsTest-2083764151 None] Creating volume df54afd9-6122-4f7c-b99a-476f7d574f5a {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:36:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-725d1150-8804-495d-9a8c-9d83393aedb6 tempest-TaggedAttachmentsTest-2083764151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:36:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-725d1150-8804-495d-9a8c-9d83393aedb6 tempest-TaggedAttachmentsTest-2083764151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:36:10 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-725d1150-8804-495d-9a8c-9d83393aedb6 tempest-TaggedAttachmentsTest-2083764151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:36:10 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-725d1150-8804-495d-9a8c-9d83393aedb6 tempest-TaggedAttachmentsTest-2083764151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:36:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-725d1150-8804-495d-9a8c-9d83393aedb6 tempest-TaggedAttachmentsTest-2083764151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:36:10 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-725d1150-8804-495d-9a8c-9d83393aedb6 tempest-TaggedAttachmentsTest-2083764151 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:36:10 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-725d1150-8804-495d-9a8c-9d83393aedb6 tempest-TaggedAttachmentsTest-2083764151 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:36:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-725d1150-8804-495d-9a8c-9d83393aedb6 tempest-TaggedAttachmentsTest-2083764151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-df54afd9-6122-4f7c-b99a-476f7d574f5a 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:36:10 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-17c89bdf-3d3a-4837-a5c5-185a41096fdd tempest-AttachVolumeNegativeTest-501522069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9db2aea9-2a7e-4dd3-b93b-d4383f8620ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8755029e-3182-47c0-869a-f3d229b759ba', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:36:10 devstack sudo[89018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-df54afd9-6122-4f7c-b99a-476f7d574f5a 1073741824 Jul 10 06:36:10 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-17c89bdf-3d3a-4837-a5c5-185a41096fdd tempest-AttachVolumeNegativeTest-501522069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dd78f27-dac4-4d26-b30a-84183927ecad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:36:10 devstack sudo[89018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:36:10 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-17c89bdf-3d3a-4837-a5c5-185a41096fdd tempest-AttachVolumeNegativeTest-501522069 None] Volume volume-8755029e-3182-47c0-869a-f3d229b759ba (8755029e-3182-47c0-869a-f3d229b759ba): created successfully Jul 10 06:36:10 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-17c89bdf-3d3a-4837-a5c5-185a41096fdd tempest-AttachVolumeNegativeTest-501522069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dd78f27-dac4-4d26-b30a-84183927ecad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:36:10 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-17c89bdf-3d3a-4837-a5c5-185a41096fdd tempest-AttachVolumeNegativeTest-501522069 None] Flow 'volume_create_manager' (b33b8e83-6bba-4aa6-9ed8-81d424308158) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:36:10 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-17c89bdf-3d3a-4837-a5c5-185a41096fdd tempest-AttachVolumeNegativeTest-501522069 None] Created volume successfully. Jul 10 06:36:11 devstack sudo[89018]: pam_unix(sudo:session): session closed for user root Jul 10 06:36:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-725d1150-8804-495d-9a8c-9d83393aedb6 tempest-TaggedAttachmentsTest-2083764151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-df54afd9-6122-4f7c-b99a-476f7d574f5a 1073741824" returned: 0 in 1.268s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:36:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-725d1150-8804-495d-9a8c-9d83393aedb6 tempest-TaggedAttachmentsTest-2083764151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-df54afd9-6122-4f7c-b99a-476f7d574f5a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:36:11 devstack sudo[89052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-df54afd9-6122-4f7c-b99a-476f7d574f5a Jul 10 06:36:11 devstack sudo[89052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:36:12 devstack sudo[89052]: pam_unix(sudo:session): session closed for user root Jul 10 06:36:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-725d1150-8804-495d-9a8c-9d83393aedb6 tempest-TaggedAttachmentsTest-2083764151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-df54afd9-6122-4f7c-b99a-476f7d574f5a" returned: 0 in 0.775s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:36:12 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-725d1150-8804-495d-9a8c-9d83393aedb6 tempest-TaggedAttachmentsTest-2083764151 None] <== create_volume: return (2096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:36:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-725d1150-8804-495d-9a8c-9d83393aedb6 tempest-TaggedAttachmentsTest-2083764151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.104s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:36:12 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-725d1150-8804-495d-9a8c-9d83393aedb6 tempest-TaggedAttachmentsTest-2083764151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43931ecf-13cd-4c06-bb7a-33f67ab93741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df54afd9-6122-4f7c-b99a-476f7d574f5a', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:36:12 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-725d1150-8804-495d-9a8c-9d83393aedb6 tempest-TaggedAttachmentsTest-2083764151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (768c0f36-f9d0-4642-8a50-b6d611c4edef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:36:12 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-725d1150-8804-495d-9a8c-9d83393aedb6 tempest-TaggedAttachmentsTest-2083764151 None] Volume volume-df54afd9-6122-4f7c-b99a-476f7d574f5a (df54afd9-6122-4f7c-b99a-476f7d574f5a): created successfully Jul 10 06:36:12 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-725d1150-8804-495d-9a8c-9d83393aedb6 tempest-TaggedAttachmentsTest-2083764151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (768c0f36-f9d0-4642-8a50-b6d611c4edef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:36:12 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-725d1150-8804-495d-9a8c-9d83393aedb6 tempest-TaggedAttachmentsTest-2083764151 None] Flow 'volume_create_manager' (9810215d-5b94-495c-9c1e-179aa0ee122f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:36:12 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-725d1150-8804-495d-9a8c-9d83393aedb6 tempest-TaggedAttachmentsTest-2083764151 None] Created volume successfully. Jul 10 06:36:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-994aabe8-8149-4bc3-a6f9-e7e854c9d26e req-668d1609-459d-4d7e-96a5-34455260c7ac tempest-AttachVolumeNegativeTest-501522069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:36:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-994aabe8-8149-4bc3-a6f9-e7e854c9d26e req-668d1609-459d-4d7e-96a5-34455260c7ac tempest-AttachVolumeNegativeTest-501522069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:36:15 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d958feb-5285-4be4-a7f3-03cd7d7199a8]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:36:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-994aabe8-8149-4bc3-a6f9-e7e854c9d26e req-668d1609-459d-4d7e-96a5-34455260c7ac tempest-AttachVolumeNegativeTest-501522069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8755029e-3182-47c0-869a-f3d229b759ba {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:36:15 devstack sudo[89067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8755029e-3182-47c0-869a-f3d229b759ba Jul 10 06:36:15 devstack sudo[89067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:36:16 devstack sudo[89067]: pam_unix(sudo:session): session closed for user root Jul 10 06:36:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-994aabe8-8149-4bc3-a6f9-e7e854c9d26e req-668d1609-459d-4d7e-96a5-34455260c7ac tempest-AttachVolumeNegativeTest-501522069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8755029e-3182-47c0-869a-f3d229b759ba" returned: 0 in 0.944s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:36:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-994aabe8-8149-4bc3-a6f9-e7e854c9d26e req-668d1609-459d-4d7e-96a5-34455260c7ac tempest-AttachVolumeNegativeTest-501522069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.981s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:36:16 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-994aabe8-8149-4bc3-a6f9-e7e854c9d26e req-668d1609-459d-4d7e-96a5-34455260c7ac tempest-AttachVolumeNegativeTest-501522069 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804', 'name': 'volume-8755029e-3182-47c0-869a-f3d229b759ba', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8a69dcee-1f2a-4f4c-a5b6-bdb1af0e93ea', 'enforce_multipath': True} {{(pid=87294) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:36:16 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-994aabe8-8149-4bc3-a6f9-e7e854c9d26e req-668d1609-459d-4d7e-96a5-34455260c7ac tempest-AttachVolumeNegativeTest-501522069 None] attachment_update completed successfully. Jul 10 06:36:21 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:36:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:36:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:36:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:36:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:36:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:36:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:36:21 devstack sudo[89473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:36:21 devstack sudo[89473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:36:22 devstack sudo[89473]: pam_unix(sudo:session): session closed for user root Jul 10 06:36:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.732s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:36:22 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:36:26 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:SELECT=15,cinder:UPDATE=16,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:36:26 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:SELECT=17,cinder:INSERT=4,cinder:UPDATE=16,cinder:DELETE=2 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:37:20 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cab0a07-714c-4f29-a93f-708c305414ab tempest-ServerRescueNegativeTestJSON-299288954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:37:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9cab0a07-714c-4f29-a93f-708c305414ab tempest-ServerRescueNegativeTestJSON-299288954 None] Flow 'volume_create_manager' (e43b1b0a-606b-4f9b-96a1-a0cdd92fbfd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:37:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9cab0a07-714c-4f29-a93f-708c305414ab tempest-ServerRescueNegativeTestJSON-299288954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f00d33fa-20a1-400e-b36b-a11eed48128d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:37:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9cab0a07-714c-4f29-a93f-708c305414ab tempest-ServerRescueNegativeTestJSON-299288954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f00d33fa-20a1-400e-b36b-a11eed48128d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-495447971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eac6149-3060-48db-84b8-0370c1a39518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c56ce71bfb3437d8a338b4ba899d1c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:37:21Z,use_quota=True,user_id='49d67c4e6c5141cabaf3c9c4fac727dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:37:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9cab0a07-714c-4f29-a93f-708c305414ab tempest-ServerRescueNegativeTestJSON-299288954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (738a8d1c-d71c-4e95-875a-09221f9a448c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:37:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9cab0a07-714c-4f29-a93f-708c305414ab tempest-ServerRescueNegativeTestJSON-299288954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (738a8d1c-d71c-4e95-875a-09221f9a448c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:37:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9cab0a07-714c-4f29-a93f-708c305414ab tempest-ServerRescueNegativeTestJSON-299288954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (278e88c8-aa5d-4fef-b593-fb82786ef3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:37:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9cab0a07-714c-4f29-a93f-708c305414ab tempest-ServerRescueNegativeTestJSON-299288954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (278e88c8-aa5d-4fef-b593-fb82786ef3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1eac6149-3060-48db-84b8-0370c1a39518', 'volume_name': 'volume-1eac6149-3060-48db-84b8-0370c1a39518', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:37:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9cab0a07-714c-4f29-a93f-708c305414ab tempest-ServerRescueNegativeTestJSON-299288954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1913593a-2d87-4cfd-8927-06a18a26bd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:37:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9cab0a07-714c-4f29-a93f-708c305414ab tempest-ServerRescueNegativeTestJSON-299288954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1913593a-2d87-4cfd-8927-06a18a26bd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:37:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9cab0a07-714c-4f29-a93f-708c305414ab tempest-ServerRescueNegativeTestJSON-299288954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d998777c-ecf0-4b72-b543-b8168f858f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:37:21 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-9cab0a07-714c-4f29-a93f-708c305414ab tempest-ServerRescueNegativeTestJSON-299288954 None] Volume 1eac6149-3060-48db-84b8-0370c1a39518: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1eac6149-3060-48db-84b8-0370c1a39518', 'volume_size': 1} Jul 10 06:37:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9cab0a07-714c-4f29-a93f-708c305414ab tempest-ServerRescueNegativeTestJSON-299288954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:37:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9cab0a07-714c-4f29-a93f-708c305414ab tempest-ServerRescueNegativeTestJSON-299288954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:37:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9cab0a07-714c-4f29-a93f-708c305414ab tempest-ServerRescueNegativeTestJSON-299288954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-495447971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eac6149-3060-48db-84b8-0370c1a39518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c56ce71bfb3437d8a338b4ba899d1c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:37:21Z,use_quota=True,user_id='49d67c4e6c5141cabaf3c9c4fac727dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:37:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-9cab0a07-714c-4f29-a93f-708c305414ab tempest-ServerRescueNegativeTestJSON-299288954 None] Creating volume 1eac6149-3060-48db-84b8-0370c1a39518 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:37:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9cab0a07-714c-4f29-a93f-708c305414ab tempest-ServerRescueNegativeTestJSON-299288954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:37:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9cab0a07-714c-4f29-a93f-708c305414ab tempest-ServerRescueNegativeTestJSON-299288954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:37:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9cab0a07-714c-4f29-a93f-708c305414ab tempest-ServerRescueNegativeTestJSON-299288954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:37:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9cab0a07-714c-4f29-a93f-708c305414ab tempest-ServerRescueNegativeTestJSON-299288954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:37:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9cab0a07-714c-4f29-a93f-708c305414ab tempest-ServerRescueNegativeTestJSON-299288954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:37:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9cab0a07-714c-4f29-a93f-708c305414ab tempest-ServerRescueNegativeTestJSON-299288954 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:37:21 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-9cab0a07-714c-4f29-a93f-708c305414ab tempest-ServerRescueNegativeTestJSON-299288954 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:37:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9cab0a07-714c-4f29-a93f-708c305414ab tempest-ServerRescueNegativeTestJSON-299288954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1eac6149-3060-48db-84b8-0370c1a39518 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:37:21 devstack sudo[90221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1eac6149-3060-48db-84b8-0370c1a39518 1073741824 Jul 10 06:37:21 devstack sudo[90221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:37:21 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:37:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:37:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:37:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:37:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:37:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:37:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:37:21 devstack sudo[90240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:37:21 devstack sudo[90240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:37:22 devstack sudo[90221]: pam_unix(sudo:session): session closed for user root Jul 10 06:37:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9cab0a07-714c-4f29-a93f-708c305414ab tempest-ServerRescueNegativeTestJSON-299288954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1eac6149-3060-48db-84b8-0370c1a39518 1073741824" returned: 0 in 1.528s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:37:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9cab0a07-714c-4f29-a93f-708c305414ab tempest-ServerRescueNegativeTestJSON-299288954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1eac6149-3060-48db-84b8-0370c1a39518 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:37:22 devstack sudo[90279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1eac6149-3060-48db-84b8-0370c1a39518 Jul 10 06:37:22 devstack sudo[90279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:37:23 devstack sudo[90240]: pam_unix(sudo:session): session closed for user root Jul 10 06:37:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.452s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:37:23 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:37:23 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager._thread_info {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:37:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread count: 8 {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:37:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread info: [<_MainThread(MainThread, started 139245706264704)>, , , , , , , ] {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:37:24 devstack sudo[90279]: pam_unix(sudo:session): session closed for user root Jul 10 06:37:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9cab0a07-714c-4f29-a93f-708c305414ab tempest-ServerRescueNegativeTestJSON-299288954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1eac6149-3060-48db-84b8-0370c1a39518" returned: 0 in 1.337s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:37:24 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9cab0a07-714c-4f29-a93f-708c305414ab tempest-ServerRescueNegativeTestJSON-299288954 None] <== create_volume: return (2968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:37:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9cab0a07-714c-4f29-a93f-708c305414ab tempest-ServerRescueNegativeTestJSON-299288954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.970s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:37:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9cab0a07-714c-4f29-a93f-708c305414ab tempest-ServerRescueNegativeTestJSON-299288954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d998777c-ecf0-4b72-b543-b8168f858f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1eac6149-3060-48db-84b8-0370c1a39518', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:37:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9cab0a07-714c-4f29-a93f-708c305414ab tempest-ServerRescueNegativeTestJSON-299288954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f937cc7-b011-4645-9aeb-bfd165c3a4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:37:24 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-9cab0a07-714c-4f29-a93f-708c305414ab tempest-ServerRescueNegativeTestJSON-299288954 None] Volume volume-1eac6149-3060-48db-84b8-0370c1a39518 (1eac6149-3060-48db-84b8-0370c1a39518): created successfully Jul 10 06:37:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9cab0a07-714c-4f29-a93f-708c305414ab tempest-ServerRescueNegativeTestJSON-299288954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f937cc7-b011-4645-9aeb-bfd165c3a4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:37:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9cab0a07-714c-4f29-a93f-708c305414ab tempest-ServerRescueNegativeTestJSON-299288954 None] Flow 'volume_create_manager' (e43b1b0a-606b-4f9b-96a1-a0cdd92fbfd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:37:24 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-9cab0a07-714c-4f29-a93f-708c305414ab tempest-ServerRescueNegativeTestJSON-299288954 None] Created volume successfully. Jul 10 06:37:25 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bb6f70d-3449-4f28-bad4-d6cc973a2350 tempest-ServersNegativeTestJSON-1063162600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:37:25 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5bb6f70d-3449-4f28-bad4-d6cc973a2350 tempest-ServersNegativeTestJSON-1063162600 None] Flow 'volume_create_manager' (0d1e56e1-1d86-4f69-9deb-a8c142310a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:37:25 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5bb6f70d-3449-4f28-bad4-d6cc973a2350 tempest-ServersNegativeTestJSON-1063162600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64a5e222-ecf5-4ebb-aac5-d864b2d97c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:37:25 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5bb6f70d-3449-4f28-bad4-d6cc973a2350 tempest-ServersNegativeTestJSON-1063162600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64a5e222-ecf5-4ebb-aac5-d864b2d97c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-474814622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28767b80-77c4-498d-bc31-5775def75852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfba82c9cc4043d9a8b6ae36f7431ab6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:37:25Z,use_quota=True,user_id='773d527f39574b05a8d6a4ee4237376c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:37:25 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5bb6f70d-3449-4f28-bad4-d6cc973a2350 tempest-ServersNegativeTestJSON-1063162600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f7af1a1-41b1-408a-a1cc-8dd17a04cd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:37:25 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5bb6f70d-3449-4f28-bad4-d6cc973a2350 tempest-ServersNegativeTestJSON-1063162600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f7af1a1-41b1-408a-a1cc-8dd17a04cd83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:37:25 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5bb6f70d-3449-4f28-bad4-d6cc973a2350 tempest-ServersNegativeTestJSON-1063162600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7093ec3d-73af-4d1d-a513-01b48d0448e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:37:25 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5bb6f70d-3449-4f28-bad4-d6cc973a2350 tempest-ServersNegativeTestJSON-1063162600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7093ec3d-73af-4d1d-a513-01b48d0448e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28767b80-77c4-498d-bc31-5775def75852', 'volume_name': 'volume-28767b80-77c4-498d-bc31-5775def75852', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:37:25 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5bb6f70d-3449-4f28-bad4-d6cc973a2350 tempest-ServersNegativeTestJSON-1063162600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d177bea4-e5e4-4210-8f8c-000a47bda9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:37:25 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5bb6f70d-3449-4f28-bad4-d6cc973a2350 tempest-ServersNegativeTestJSON-1063162600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d177bea4-e5e4-4210-8f8c-000a47bda9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:37:25 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5bb6f70d-3449-4f28-bad4-d6cc973a2350 tempest-ServersNegativeTestJSON-1063162600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d62f6a25-343c-4505-8b04-9c473c23305f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:37:25 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-5bb6f70d-3449-4f28-bad4-d6cc973a2350 tempest-ServersNegativeTestJSON-1063162600 None] Volume 28767b80-77c4-498d-bc31-5775def75852: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28767b80-77c4-498d-bc31-5775def75852', 'volume_size': 1} Jul 10 06:37:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5bb6f70d-3449-4f28-bad4-d6cc973a2350 tempest-ServersNegativeTestJSON-1063162600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:37:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5bb6f70d-3449-4f28-bad4-d6cc973a2350 tempest-ServersNegativeTestJSON-1063162600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:37:25 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5bb6f70d-3449-4f28-bad4-d6cc973a2350 tempest-ServersNegativeTestJSON-1063162600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-474814622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28767b80-77c4-498d-bc31-5775def75852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfba82c9cc4043d9a8b6ae36f7431ab6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:37:25Z,use_quota=True,user_id='773d527f39574b05a8d6a4ee4237376c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:37:25 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-5bb6f70d-3449-4f28-bad4-d6cc973a2350 tempest-ServersNegativeTestJSON-1063162600 None] Creating volume 28767b80-77c4-498d-bc31-5775def75852 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:37:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5bb6f70d-3449-4f28-bad4-d6cc973a2350 tempest-ServersNegativeTestJSON-1063162600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:37:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5bb6f70d-3449-4f28-bad4-d6cc973a2350 tempest-ServersNegativeTestJSON-1063162600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:37:25 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5bb6f70d-3449-4f28-bad4-d6cc973a2350 tempest-ServersNegativeTestJSON-1063162600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:37:25 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5bb6f70d-3449-4f28-bad4-d6cc973a2350 tempest-ServersNegativeTestJSON-1063162600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:37:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5bb6f70d-3449-4f28-bad4-d6cc973a2350 tempest-ServersNegativeTestJSON-1063162600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:37:25 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5bb6f70d-3449-4f28-bad4-d6cc973a2350 tempest-ServersNegativeTestJSON-1063162600 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:37:25 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-5bb6f70d-3449-4f28-bad4-d6cc973a2350 tempest-ServersNegativeTestJSON-1063162600 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:37:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5bb6f70d-3449-4f28-bad4-d6cc973a2350 tempest-ServersNegativeTestJSON-1063162600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-28767b80-77c4-498d-bc31-5775def75852 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:37:25 devstack sudo[90338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-28767b80-77c4-498d-bc31-5775def75852 1073741824 Jul 10 06:37:25 devstack sudo[90338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:37:26 devstack sudo[90338]: pam_unix(sudo:session): session closed for user root Jul 10 06:37:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5bb6f70d-3449-4f28-bad4-d6cc973a2350 tempest-ServersNegativeTestJSON-1063162600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-28767b80-77c4-498d-bc31-5775def75852 1073741824" returned: 0 in 1.116s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:37:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5bb6f70d-3449-4f28-bad4-d6cc973a2350 tempest-ServersNegativeTestJSON-1063162600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-28767b80-77c4-498d-bc31-5775def75852 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:37:26 devstack sudo[90348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-28767b80-77c4-498d-bc31-5775def75852 Jul 10 06:37:26 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:37:27 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root Jul 10 06:37:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5bb6f70d-3449-4f28-bad4-d6cc973a2350 tempest-ServersNegativeTestJSON-1063162600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-28767b80-77c4-498d-bc31-5775def75852" returned: 0 in 0.841s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:37:27 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5bb6f70d-3449-4f28-bad4-d6cc973a2350 tempest-ServersNegativeTestJSON-1063162600 None] <== create_volume: return (2033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:37:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5bb6f70d-3449-4f28-bad4-d6cc973a2350 tempest-ServersNegativeTestJSON-1063162600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.035s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:37:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5bb6f70d-3449-4f28-bad4-d6cc973a2350 tempest-ServersNegativeTestJSON-1063162600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d62f6a25-343c-4505-8b04-9c473c23305f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28767b80-77c4-498d-bc31-5775def75852', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:37:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5bb6f70d-3449-4f28-bad4-d6cc973a2350 tempest-ServersNegativeTestJSON-1063162600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5e943cb-5612-4b00-831f-b5feeb43e4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:37:27 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-5bb6f70d-3449-4f28-bad4-d6cc973a2350 tempest-ServersNegativeTestJSON-1063162600 None] Volume volume-28767b80-77c4-498d-bc31-5775def75852 (28767b80-77c4-498d-bc31-5775def75852): created successfully Jul 10 06:37:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5bb6f70d-3449-4f28-bad4-d6cc973a2350 tempest-ServersNegativeTestJSON-1063162600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5e943cb-5612-4b00-831f-b5feeb43e4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:37:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5bb6f70d-3449-4f28-bad4-d6cc973a2350 tempest-ServersNegativeTestJSON-1063162600 None] Flow 'volume_create_manager' (0d1e56e1-1d86-4f69-9deb-a8c142310a46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:37:27 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-5bb6f70d-3449-4f28-bad4-d6cc973a2350 tempest-ServersNegativeTestJSON-1063162600 None] Created volume successfully. Jul 10 06:37:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-dc07cfdd-ca51-4d34-929f-27fc88bc704c req-805b93fc-6d62-412e-9288-8d9cd7c35a4e tempest-TaggedAttachmentsTest-2083764151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:37:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-dc07cfdd-ca51-4d34-929f-27fc88bc704c req-805b93fc-6d62-412e-9288-8d9cd7c35a4e tempest-TaggedAttachmentsTest-2083764151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:37:29 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcbc0dc-8b97-4371-910d-165e56897784]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:37:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-dc07cfdd-ca51-4d34-929f-27fc88bc704c req-805b93fc-6d62-412e-9288-8d9cd7c35a4e tempest-TaggedAttachmentsTest-2083764151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-df54afd9-6122-4f7c-b99a-476f7d574f5a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:37:29 devstack sudo[90367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-df54afd9-6122-4f7c-b99a-476f7d574f5a Jul 10 06:37:29 devstack sudo[90367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:37:30 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-139065dd-db0c-4eeb-9efc-47911c663e77 tempest-ServersNegativeTestJSON-1063162600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:37:30 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-139065dd-db0c-4eeb-9efc-47911c663e77 tempest-ServersNegativeTestJSON-1063162600 None] Flow 'volume_create_manager' (b8437757-155b-4f85-a76e-1bd37d0e05a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:37:30 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-139065dd-db0c-4eeb-9efc-47911c663e77 tempest-ServersNegativeTestJSON-1063162600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b98d4cf-be9a-4717-9428-72252dd76459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:37:30 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-139065dd-db0c-4eeb-9efc-47911c663e77 tempest-ServersNegativeTestJSON-1063162600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b98d4cf-be9a-4717-9428-72252dd76459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:37:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1964481526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fa2e72f-0f05-4437-8def-7e43025ae07f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfba82c9cc4043d9a8b6ae36f7431ab6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:37:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:37:30Z,use_quota=True,user_id='773d527f39574b05a8d6a4ee4237376c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:37:30 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-139065dd-db0c-4eeb-9efc-47911c663e77 tempest-ServersNegativeTestJSON-1063162600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f34eb7d2-a807-4fa3-bfaf-812ea53acdec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:37:30 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-139065dd-db0c-4eeb-9efc-47911c663e77 tempest-ServersNegativeTestJSON-1063162600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f34eb7d2-a807-4fa3-bfaf-812ea53acdec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:37:30 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-139065dd-db0c-4eeb-9efc-47911c663e77 tempest-ServersNegativeTestJSON-1063162600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f24875c2-f2ce-462b-8010-d43ef488db9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:37:30 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-139065dd-db0c-4eeb-9efc-47911c663e77 tempest-ServersNegativeTestJSON-1063162600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f24875c2-f2ce-462b-8010-d43ef488db9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fa2e72f-0f05-4437-8def-7e43025ae07f', 'volume_name': 'volume-8fa2e72f-0f05-4437-8def-7e43025ae07f', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:37:30 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-139065dd-db0c-4eeb-9efc-47911c663e77 tempest-ServersNegativeTestJSON-1063162600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d9cef5-8173-4f19-8215-d6b74778b0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:37:30 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-139065dd-db0c-4eeb-9efc-47911c663e77 tempest-ServersNegativeTestJSON-1063162600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d9cef5-8173-4f19-8215-d6b74778b0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:37:30 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-139065dd-db0c-4eeb-9efc-47911c663e77 tempest-ServersNegativeTestJSON-1063162600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe8eaccc-d88b-4397-ae35-7e766e07867c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:37:30 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-139065dd-db0c-4eeb-9efc-47911c663e77 tempest-ServersNegativeTestJSON-1063162600 None] Volume 8fa2e72f-0f05-4437-8def-7e43025ae07f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fa2e72f-0f05-4437-8def-7e43025ae07f', 'volume_size': 1} Jul 10 06:37:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-139065dd-db0c-4eeb-9efc-47911c663e77 tempest-ServersNegativeTestJSON-1063162600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:37:30 devstack sudo[90367]: pam_unix(sudo:session): session closed for user root Jul 10 06:37:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-dc07cfdd-ca51-4d34-929f-27fc88bc704c req-805b93fc-6d62-412e-9288-8d9cd7c35a4e tempest-TaggedAttachmentsTest-2083764151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-df54afd9-6122-4f7c-b99a-476f7d574f5a" returned: 0 in 1.147s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:37:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-dc07cfdd-ca51-4d34-929f-27fc88bc704c req-805b93fc-6d62-412e-9288-8d9cd7c35a4e tempest-TaggedAttachmentsTest-2083764151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.179s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:37:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-139065dd-db0c-4eeb-9efc-47911c663e77 tempest-ServersNegativeTestJSON-1063162600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.412s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:37:30 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-139065dd-db0c-4eeb-9efc-47911c663e77 tempest-ServersNegativeTestJSON-1063162600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:37:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1964481526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fa2e72f-0f05-4437-8def-7e43025ae07f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfba82c9cc4043d9a8b6ae36f7431ab6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:37:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:37:30Z,use_quota=True,user_id='773d527f39574b05a8d6a4ee4237376c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:37:30 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-139065dd-db0c-4eeb-9efc-47911c663e77 tempest-ServersNegativeTestJSON-1063162600 None] Creating volume 8fa2e72f-0f05-4437-8def-7e43025ae07f {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:37:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-139065dd-db0c-4eeb-9efc-47911c663e77 tempest-ServersNegativeTestJSON-1063162600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:37:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-139065dd-db0c-4eeb-9efc-47911c663e77 tempest-ServersNegativeTestJSON-1063162600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:37:30 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-139065dd-db0c-4eeb-9efc-47911c663e77 tempest-ServersNegativeTestJSON-1063162600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:37:30 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-139065dd-db0c-4eeb-9efc-47911c663e77 tempest-ServersNegativeTestJSON-1063162600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:37:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-139065dd-db0c-4eeb-9efc-47911c663e77 tempest-ServersNegativeTestJSON-1063162600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:37:30 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-139065dd-db0c-4eeb-9efc-47911c663e77 tempest-ServersNegativeTestJSON-1063162600 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:37:30 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-139065dd-db0c-4eeb-9efc-47911c663e77 tempest-ServersNegativeTestJSON-1063162600 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:37:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-139065dd-db0c-4eeb-9efc-47911c663e77 tempest-ServersNegativeTestJSON-1063162600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8fa2e72f-0f05-4437-8def-7e43025ae07f 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:37:30 devstack sudo[90386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8fa2e72f-0f05-4437-8def-7e43025ae07f 1073741824 Jul 10 06:37:30 devstack sudo[90386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:37:30 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-dc07cfdd-ca51-4d34-929f-27fc88bc704c req-805b93fc-6d62-412e-9288-8d9cd7c35a4e tempest-TaggedAttachmentsTest-2083764151 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804', 'name': 'volume-df54afd9-6122-4f7c-b99a-476f7d574f5a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '247f30f5-03a7-4c1b-8a6b-a047f493d6af', 'enforce_multipath': True} {{(pid=87294) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:37:30 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-dc07cfdd-ca51-4d34-929f-27fc88bc704c req-805b93fc-6d62-412e-9288-8d9cd7c35a4e tempest-TaggedAttachmentsTest-2083764151 None] attachment_update completed successfully. Jul 10 06:37:31 devstack sudo[90386]: pam_unix(sudo:session): session closed for user root Jul 10 06:37:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-139065dd-db0c-4eeb-9efc-47911c663e77 tempest-ServersNegativeTestJSON-1063162600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8fa2e72f-0f05-4437-8def-7e43025ae07f 1073741824" returned: 0 in 0.923s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:37:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-139065dd-db0c-4eeb-9efc-47911c663e77 tempest-ServersNegativeTestJSON-1063162600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8fa2e72f-0f05-4437-8def-7e43025ae07f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:37:31 devstack sudo[90394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8fa2e72f-0f05-4437-8def-7e43025ae07f Jul 10 06:37:31 devstack sudo[90394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:37:32 devstack sudo[90394]: pam_unix(sudo:session): session closed for user root Jul 10 06:37:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-139065dd-db0c-4eeb-9efc-47911c663e77 tempest-ServersNegativeTestJSON-1063162600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8fa2e72f-0f05-4437-8def-7e43025ae07f" returned: 0 in 0.761s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:37:32 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-139065dd-db0c-4eeb-9efc-47911c663e77 tempest-ServersNegativeTestJSON-1063162600 None] <== create_volume: return (1726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:37:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-139065dd-db0c-4eeb-9efc-47911c663e77 tempest-ServersNegativeTestJSON-1063162600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.729s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:37:32 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-139065dd-db0c-4eeb-9efc-47911c663e77 tempest-ServersNegativeTestJSON-1063162600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe8eaccc-d88b-4397-ae35-7e766e07867c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fa2e72f-0f05-4437-8def-7e43025ae07f', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:37:32 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-139065dd-db0c-4eeb-9efc-47911c663e77 tempest-ServersNegativeTestJSON-1063162600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ef25d29-7da3-4894-b737-c466da22a8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:37:32 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-139065dd-db0c-4eeb-9efc-47911c663e77 tempest-ServersNegativeTestJSON-1063162600 None] Volume volume-8fa2e72f-0f05-4437-8def-7e43025ae07f (8fa2e72f-0f05-4437-8def-7e43025ae07f): created successfully Jul 10 06:37:32 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-139065dd-db0c-4eeb-9efc-47911c663e77 tempest-ServersNegativeTestJSON-1063162600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ef25d29-7da3-4894-b737-c466da22a8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:37:32 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-139065dd-db0c-4eeb-9efc-47911c663e77 tempest-ServersNegativeTestJSON-1063162600 None] Flow 'volume_create_manager' (b8437757-155b-4f85-a76e-1bd37d0e05a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:37:32 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-139065dd-db0c-4eeb-9efc-47911c663e77 tempest-ServersNegativeTestJSON-1063162600 None] Created volume successfully. Jul 10 06:37:33 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7f88ff06-eeaa-48cc-8a79-ab2e8f185718 tempest-ServersNegativeTestJSON-1063162600 None] Acquiring lock "cinder-8fa2e72f-0f05-4437-8def-7e43025ae07f-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:37:33 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7f88ff06-eeaa-48cc-8a79-ab2e8f185718 tempest-ServersNegativeTestJSON-1063162600 None] Lock "cinder-8fa2e72f-0f05-4437-8def-7e43025ae07f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:37:33 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7f88ff06-eeaa-48cc-8a79-ab2e8f185718 tempest-ServersNegativeTestJSON-1063162600 None] Acquiring lock "cinder-quobyte-8fa2e72f-0f05-4437-8def-7e43025ae07f" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:37:33 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7f88ff06-eeaa-48cc-8a79-ab2e8f185718 tempest-ServersNegativeTestJSON-1063162600 None] Lock "cinder-quobyte-8fa2e72f-0f05-4437-8def-7e43025ae07f" acquired by "delete_volume" :: waited 0.018s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:37:33 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[45692f79-497d-4a79-a171-70fff4fe9a6b]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:37:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7f88ff06-eeaa-48cc-8a79-ab2e8f185718 tempest-ServersNegativeTestJSON-1063162600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8fa2e72f-0f05-4437-8def-7e43025ae07f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:37:33 devstack sudo[90411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8fa2e72f-0f05-4437-8def-7e43025ae07f Jul 10 06:37:33 devstack sudo[90411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:37:34 devstack sudo[90411]: pam_unix(sudo:session): session closed for user root Jul 10 06:37:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7f88ff06-eeaa-48cc-8a79-ab2e8f185718 tempest-ServersNegativeTestJSON-1063162600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8fa2e72f-0f05-4437-8def-7e43025ae07f" returned: 0 in 1.029s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:37:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7f88ff06-eeaa-48cc-8a79-ab2e8f185718 tempest-ServersNegativeTestJSON-1063162600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8fa2e72f-0f05-4437-8def-7e43025ae07f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:37:34 devstack sudo[90442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8fa2e72f-0f05-4437-8def-7e43025ae07f Jul 10 06:37:34 devstack sudo[90442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:37:35 devstack sudo[90442]: pam_unix(sudo:session): session closed for user root Jul 10 06:37:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7f88ff06-eeaa-48cc-8a79-ab2e8f185718 tempest-ServersNegativeTestJSON-1063162600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8fa2e72f-0f05-4437-8def-7e43025ae07f" returned: 0 in 0.965s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:37:35 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7f88ff06-eeaa-48cc-8a79-ab2e8f185718 tempest-ServersNegativeTestJSON-1063162600 None] Lock "cinder-quobyte-8fa2e72f-0f05-4437-8def-7e43025ae07f" released by "delete_volume" :: held 2.076s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:37:35 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-7f88ff06-eeaa-48cc-8a79-ab2e8f185718 tempest-ServersNegativeTestJSON-1063162600 None] Created reservations ['dd38c75b-990e-4183-8be4-8cedd34d6cc0', '98b02950-99fe-4921-8fec-ece5886847d7', 'f06e14a2-b517-4e04-a832-9a102c0ba385', 'bb7eccb3-476f-4670-bd8f-a29426a11def'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:37:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7f88ff06-eeaa-48cc-8a79-ab2e8f185718 tempest-ServersNegativeTestJSON-1063162600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:37:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7f88ff06-eeaa-48cc-8a79-ab2e8f185718 tempest-ServersNegativeTestJSON-1063162600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:37:36 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-7f88ff06-eeaa-48cc-8a79-ab2e8f185718 tempest-ServersNegativeTestJSON-1063162600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:37:36 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-7f88ff06-eeaa-48cc-8a79-ab2e8f185718 tempest-ServersNegativeTestJSON-1063162600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:37:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7f88ff06-eeaa-48cc-8a79-ab2e8f185718 tempest-ServersNegativeTestJSON-1063162600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:37:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7f88ff06-eeaa-48cc-8a79-ab2e8f185718 tempest-ServersNegativeTestJSON-1063162600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:37:36 devstack sudo[90447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:37:36 devstack sudo[90447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:37:36 devstack sudo[90447]: pam_unix(sudo:session): session closed for user root Jul 10 06:37:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7f88ff06-eeaa-48cc-8a79-ab2e8f185718 tempest-ServersNegativeTestJSON-1063162600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.758s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:37:36 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-7f88ff06-eeaa-48cc-8a79-ab2e8f185718 tempest-ServersNegativeTestJSON-1063162600 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:37:36 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-7f88ff06-eeaa-48cc-8a79-ab2e8f185718 tempest-ServersNegativeTestJSON-1063162600 None] Deleted volume successfully. Jul 10 06:37:36 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7f88ff06-eeaa-48cc-8a79-ab2e8f185718 tempest-ServersNegativeTestJSON-1063162600 None] Lock "cinder-8fa2e72f-0f05-4437-8def-7e43025ae07f-delete_volume" released by "delete_volume" :: held 3.245s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:37:37 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c1e7b724-51ed-4f33-aed2-ff1e694cab18 tempest-ServersNegativeTestJSON-1063162600 None] Acquiring lock "cinder-28767b80-77c4-498d-bc31-5775def75852-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:37:37 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c1e7b724-51ed-4f33-aed2-ff1e694cab18 tempest-ServersNegativeTestJSON-1063162600 None] Lock "cinder-28767b80-77c4-498d-bc31-5775def75852-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:37:37 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c1e7b724-51ed-4f33-aed2-ff1e694cab18 tempest-ServersNegativeTestJSON-1063162600 None] Acquiring lock "cinder-quobyte-28767b80-77c4-498d-bc31-5775def75852" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:37:37 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c1e7b724-51ed-4f33-aed2-ff1e694cab18 tempest-ServersNegativeTestJSON-1063162600 None] Lock "cinder-quobyte-28767b80-77c4-498d-bc31-5775def75852" acquired by "delete_volume" :: waited 0.031s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:37:37 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d50a82-478d-4301-9300-715812f96a82]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:37:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c1e7b724-51ed-4f33-aed2-ff1e694cab18 tempest-ServersNegativeTestJSON-1063162600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-28767b80-77c4-498d-bc31-5775def75852 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:37:37 devstack sudo[90451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-28767b80-77c4-498d-bc31-5775def75852 Jul 10 06:37:37 devstack sudo[90451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:37:37 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-af54b156-53c6-4486-bf98-3568e533ccda req-f2f8ec94-a402-4bbe-9000-303a1bff6457 tempest-TaggedAttachmentsTest-2083764151 None] Terminate volume connection completed successfully. Jul 10 06:37:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-af54b156-53c6-4486-bf98-3568e533ccda req-f2f8ec94-a402-4bbe-9000-303a1bff6457 tempest-TaggedAttachmentsTest-2083764151 None] Deleting attachment 247f30f5-03a7-4c1b-8a6b-a047f493d6af. {{(pid=87294) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:37:38 devstack sudo[90451]: pam_unix(sudo:session): session closed for user root Jul 10 06:37:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c1e7b724-51ed-4f33-aed2-ff1e694cab18 tempest-ServersNegativeTestJSON-1063162600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-28767b80-77c4-498d-bc31-5775def75852" returned: 0 in 1.182s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:37:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c1e7b724-51ed-4f33-aed2-ff1e694cab18 tempest-ServersNegativeTestJSON-1063162600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-28767b80-77c4-498d-bc31-5775def75852 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:37:38 devstack sudo[90460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-28767b80-77c4-498d-bc31-5775def75852 Jul 10 06:37:38 devstack sudo[90460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:37:39 devstack sudo[90460]: pam_unix(sudo:session): session closed for user root Jul 10 06:37:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c1e7b724-51ed-4f33-aed2-ff1e694cab18 tempest-ServersNegativeTestJSON-1063162600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-28767b80-77c4-498d-bc31-5775def75852" returned: 0 in 1.120s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:37:39 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c1e7b724-51ed-4f33-aed2-ff1e694cab18 tempest-ServersNegativeTestJSON-1063162600 None] Lock "cinder-quobyte-28767b80-77c4-498d-bc31-5775def75852" released by "delete_volume" :: held 2.397s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:37:39 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-c1e7b724-51ed-4f33-aed2-ff1e694cab18 tempest-ServersNegativeTestJSON-1063162600 None] Created reservations ['06830b97-c2d5-42c6-9805-dd97951128a8', '0213b73c-7187-41eb-8b9f-ea4c97287822', '4325f925-f188-4a75-8f3c-857afd675fc6', 'e725c592-2f96-4b1b-9ff5-4fe019dabbea'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:37:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c1e7b724-51ed-4f33-aed2-ff1e694cab18 tempest-ServersNegativeTestJSON-1063162600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:37:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c1e7b724-51ed-4f33-aed2-ff1e694cab18 tempest-ServersNegativeTestJSON-1063162600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:37:40 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-c1e7b724-51ed-4f33-aed2-ff1e694cab18 tempest-ServersNegativeTestJSON-1063162600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:37:40 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-c1e7b724-51ed-4f33-aed2-ff1e694cab18 tempest-ServersNegativeTestJSON-1063162600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:37:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c1e7b724-51ed-4f33-aed2-ff1e694cab18 tempest-ServersNegativeTestJSON-1063162600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:37:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c1e7b724-51ed-4f33-aed2-ff1e694cab18 tempest-ServersNegativeTestJSON-1063162600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:37:40 devstack sudo[90467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:37:40 devstack sudo[90467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:37:41 devstack sudo[90467]: pam_unix(sudo:session): session closed for user root Jul 10 06:37:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c1e7b724-51ed-4f33-aed2-ff1e694cab18 tempest-ServersNegativeTestJSON-1063162600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.400s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:37:41 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-c1e7b724-51ed-4f33-aed2-ff1e694cab18 tempest-ServersNegativeTestJSON-1063162600 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:37:41 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-c1e7b724-51ed-4f33-aed2-ff1e694cab18 tempest-ServersNegativeTestJSON-1063162600 None] Deleted volume successfully. Jul 10 06:37:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c1e7b724-51ed-4f33-aed2-ff1e694cab18 tempest-ServersNegativeTestJSON-1063162600 None] Lock "cinder-28767b80-77c4-498d-bc31-5775def75852-delete_volume" released by "delete_volume" :: held 4.349s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:37:44 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a2e30ba6-633b-4cb7-85a4-5a294d145dee tempest-ServerRescueNegativeTestJSON-299288954 None] Acquiring lock "cinder-1eac6149-3060-48db-84b8-0370c1a39518-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:37:44 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a2e30ba6-633b-4cb7-85a4-5a294d145dee tempest-ServerRescueNegativeTestJSON-299288954 None] Lock "cinder-1eac6149-3060-48db-84b8-0370c1a39518-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:37:44 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a2e30ba6-633b-4cb7-85a4-5a294d145dee tempest-ServerRescueNegativeTestJSON-299288954 None] Acquiring lock "cinder-quobyte-1eac6149-3060-48db-84b8-0370c1a39518" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:37:44 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a2e30ba6-633b-4cb7-85a4-5a294d145dee tempest-ServerRescueNegativeTestJSON-299288954 None] Lock "cinder-quobyte-1eac6149-3060-48db-84b8-0370c1a39518" acquired by "delete_volume" :: waited 0.030s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:37:44 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fe1c1e-5248-459b-9fe6-a25744260713]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:37:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a2e30ba6-633b-4cb7-85a4-5a294d145dee tempest-ServerRescueNegativeTestJSON-299288954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1eac6149-3060-48db-84b8-0370c1a39518 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:37:44 devstack sudo[90568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1eac6149-3060-48db-84b8-0370c1a39518 Jul 10 06:37:44 devstack sudo[90568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:37:46 devstack sudo[90568]: pam_unix(sudo:session): session closed for user root Jul 10 06:37:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a2e30ba6-633b-4cb7-85a4-5a294d145dee tempest-ServerRescueNegativeTestJSON-299288954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1eac6149-3060-48db-84b8-0370c1a39518" returned: 0 in 1.347s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:37:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a2e30ba6-633b-4cb7-85a4-5a294d145dee tempest-ServerRescueNegativeTestJSON-299288954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1eac6149-3060-48db-84b8-0370c1a39518 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:37:46 devstack sudo[90579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1eac6149-3060-48db-84b8-0370c1a39518 Jul 10 06:37:46 devstack sudo[90579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:37:46 devstack sudo[90579]: pam_unix(sudo:session): session closed for user root Jul 10 06:37:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a2e30ba6-633b-4cb7-85a4-5a294d145dee tempest-ServerRescueNegativeTestJSON-299288954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1eac6149-3060-48db-84b8-0370c1a39518" returned: 0 in 0.754s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:37:46 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a2e30ba6-633b-4cb7-85a4-5a294d145dee tempest-ServerRescueNegativeTestJSON-299288954 None] Lock "cinder-quobyte-1eac6149-3060-48db-84b8-0370c1a39518" released by "delete_volume" :: held 2.201s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:37:46 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-a2e30ba6-633b-4cb7-85a4-5a294d145dee tempest-ServerRescueNegativeTestJSON-299288954 None] Created reservations ['624c93b8-e1e2-48d6-a916-470af8b359c6', '6c96eb4e-916b-49af-b04d-7228eee85f55', '8990ce76-6d17-4c1d-b3cc-b8553139dcd0', 'f83c2d77-23b8-4536-b09c-cba1d04f413a'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:37:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a2e30ba6-633b-4cb7-85a4-5a294d145dee tempest-ServerRescueNegativeTestJSON-299288954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:37:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a2e30ba6-633b-4cb7-85a4-5a294d145dee tempest-ServerRescueNegativeTestJSON-299288954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:37:47 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-a2e30ba6-633b-4cb7-85a4-5a294d145dee tempest-ServerRescueNegativeTestJSON-299288954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:37:47 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-a2e30ba6-633b-4cb7-85a4-5a294d145dee tempest-ServerRescueNegativeTestJSON-299288954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:37:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a2e30ba6-633b-4cb7-85a4-5a294d145dee tempest-ServerRescueNegativeTestJSON-299288954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:37:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a2e30ba6-633b-4cb7-85a4-5a294d145dee tempest-ServerRescueNegativeTestJSON-299288954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:37:47 devstack sudo[90584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:37:47 devstack sudo[90584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:37:47 devstack sudo[90584]: pam_unix(sudo:session): session closed for user root Jul 10 06:37:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a2e30ba6-633b-4cb7-85a4-5a294d145dee tempest-ServerRescueNegativeTestJSON-299288954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.694s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:37:47 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-a2e30ba6-633b-4cb7-85a4-5a294d145dee tempest-ServerRescueNegativeTestJSON-299288954 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:37:47 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-a2e30ba6-633b-4cb7-85a4-5a294d145dee tempest-ServerRescueNegativeTestJSON-299288954 None] Deleted volume successfully. Jul 10 06:37:47 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a2e30ba6-633b-4cb7-85a4-5a294d145dee tempest-ServerRescueNegativeTestJSON-299288954 None] Lock "cinder-1eac6149-3060-48db-84b8-0370c1a39518-delete_volume" released by "delete_volume" :: held 3.229s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:37:55 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-6cc7cf85-5932-434a-a276-6ec281b0b00d req-a5ada543-c355-4d6e-a325-a96dcf887752 tempest-AttachVolumeNegativeTest-501522069 None] Terminate volume connection completed successfully. Jul 10 06:37:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-6cc7cf85-5932-434a-a276-6ec281b0b00d req-a5ada543-c355-4d6e-a325-a96dcf887752 tempest-AttachVolumeNegativeTest-501522069 None] Deleting attachment 8a69dcee-1f2a-4f4c-a5b6-bdb1af0e93ea. {{(pid=87294) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:37:57 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:UPDATE=34,cinder:SELECT=28,cinder:INSERT=6,cinder:DELETE=4 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:38:00 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-608aa4a2-a4f9-4b4f-818a-c9b00276e084 tempest-TaggedAttachmentsTest-2083764151 None] Acquiring lock "cinder-df54afd9-6122-4f7c-b99a-476f7d574f5a-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:38:00 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-608aa4a2-a4f9-4b4f-818a-c9b00276e084 tempest-TaggedAttachmentsTest-2083764151 None] Lock "cinder-df54afd9-6122-4f7c-b99a-476f7d574f5a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:38:00 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-608aa4a2-a4f9-4b4f-818a-c9b00276e084 tempest-TaggedAttachmentsTest-2083764151 None] Acquiring lock "cinder-quobyte-df54afd9-6122-4f7c-b99a-476f7d574f5a" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:38:00 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-608aa4a2-a4f9-4b4f-818a-c9b00276e084 tempest-TaggedAttachmentsTest-2083764151 None] Lock "cinder-quobyte-df54afd9-6122-4f7c-b99a-476f7d574f5a" acquired by "delete_volume" :: waited 0.030s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:38:00 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[323fb0e7-62e1-4deb-bd80-2d8fee7559f1]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:38:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-608aa4a2-a4f9-4b4f-818a-c9b00276e084 tempest-TaggedAttachmentsTest-2083764151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-df54afd9-6122-4f7c-b99a-476f7d574f5a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:38:00 devstack sudo[90699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-df54afd9-6122-4f7c-b99a-476f7d574f5a Jul 10 06:38:00 devstack sudo[90699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:38:01 devstack sudo[90699]: pam_unix(sudo:session): session closed for user root Jul 10 06:38:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-608aa4a2-a4f9-4b4f-818a-c9b00276e084 tempest-TaggedAttachmentsTest-2083764151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-df54afd9-6122-4f7c-b99a-476f7d574f5a" returned: 0 in 0.964s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:38:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-608aa4a2-a4f9-4b4f-818a-c9b00276e084 tempest-TaggedAttachmentsTest-2083764151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-df54afd9-6122-4f7c-b99a-476f7d574f5a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:38:01 devstack sudo[90709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-df54afd9-6122-4f7c-b99a-476f7d574f5a Jul 10 06:38:01 devstack sudo[90709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:38:02 devstack sudo[90709]: pam_unix(sudo:session): session closed for user root Jul 10 06:38:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-608aa4a2-a4f9-4b4f-818a-c9b00276e084 tempest-TaggedAttachmentsTest-2083764151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-df54afd9-6122-4f7c-b99a-476f7d574f5a" returned: 0 in 0.819s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:38:02 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-608aa4a2-a4f9-4b4f-818a-c9b00276e084 tempest-TaggedAttachmentsTest-2083764151 None] Lock "cinder-quobyte-df54afd9-6122-4f7c-b99a-476f7d574f5a" released by "delete_volume" :: held 1.851s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:38:02 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-608aa4a2-a4f9-4b4f-818a-c9b00276e084 tempest-TaggedAttachmentsTest-2083764151 None] Created reservations ['55f27630-4d6c-42c8-8aba-e129fa22954a', '489704b2-4bd1-4d62-92e5-ae01c76595ea', '91245d01-55d7-4320-a3e1-6cd841765f31', '9dbaf8c2-8128-44ed-9327-34d0f7cdb3de'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:38:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-608aa4a2-a4f9-4b4f-818a-c9b00276e084 tempest-TaggedAttachmentsTest-2083764151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:38:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-608aa4a2-a4f9-4b4f-818a-c9b00276e084 tempest-TaggedAttachmentsTest-2083764151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:38:02 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-608aa4a2-a4f9-4b4f-818a-c9b00276e084 tempest-TaggedAttachmentsTest-2083764151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:38:02 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-608aa4a2-a4f9-4b4f-818a-c9b00276e084 tempest-TaggedAttachmentsTest-2083764151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:38:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-608aa4a2-a4f9-4b4f-818a-c9b00276e084 tempest-TaggedAttachmentsTest-2083764151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:38:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-608aa4a2-a4f9-4b4f-818a-c9b00276e084 tempest-TaggedAttachmentsTest-2083764151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:38:02 devstack sudo[90713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:38:02 devstack sudo[90713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:38:03 devstack sudo[90713]: pam_unix(sudo:session): session closed for user root Jul 10 06:38:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-608aa4a2-a4f9-4b4f-818a-c9b00276e084 tempest-TaggedAttachmentsTest-2083764151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.738s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:38:03 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-608aa4a2-a4f9-4b4f-818a-c9b00276e084 tempest-TaggedAttachmentsTest-2083764151 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:38:03 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-608aa4a2-a4f9-4b4f-818a-c9b00276e084 tempest-TaggedAttachmentsTest-2083764151 None] Deleted volume successfully. Jul 10 06:38:03 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-608aa4a2-a4f9-4b4f-818a-c9b00276e084 tempest-TaggedAttachmentsTest-2083764151 None] Lock "cinder-df54afd9-6122-4f7c-b99a-476f7d574f5a-delete_volume" released by "delete_volume" :: held 2.867s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:38:12 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:SELECT=34,cinder:UPDATE=42,cinder:DELETE=2,cinder:INSERT=12 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:38:13 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:UPDATE=9,cinder:SELECT=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:38:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-421957f2-4a50-4d0e-96cf-6d597d1bb8a3 tempest-BackendsCapabilitiesAdminTestsJSON-1839640027 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87294) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 10 06:38:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d2ca4588-ac5c-4a5b-8895-7d7826f80d7f tempest-BackendsCapabilitiesAdminTestsJSON-1839640027 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87294) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 10 06:38:21 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:38:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:38:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:38:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:38:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:38:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:38:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:38:21 devstack sudo[90774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:38:21 devstack sudo[90774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:38:22 devstack sudo[90774]: pam_unix(sudo:session): session closed for user root Jul 10 06:38:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.811s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:38:22 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:38:26 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:SELECT=1 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:38:26 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:UPDATE=1 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:38:48 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-633c421c-d457-419b-bf9f-9039e610c79e tempest-VolumeQuotasAdminTestJSON-1253267533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:38:48 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-633c421c-d457-419b-bf9f-9039e610c79e tempest-VolumeQuotasAdminTestJSON-1253267533 None] Flow 'volume_create_manager' (f5577d04-873c-4f82-8927-d674bb320c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:38:48 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-633c421c-d457-419b-bf9f-9039e610c79e tempest-VolumeQuotasAdminTestJSON-1253267533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8917f908-7e9d-421c-b24e-83a0e3057234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:38:48 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-633c421c-d457-419b-bf9f-9039e610c79e tempest-VolumeQuotasAdminTestJSON-1253267533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8917f908-7e9d-421c-b24e-83a0e3057234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:38:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1372665766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df87df78-21fd-4b5d-b6cc-13edca3e848d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69b7c39250a840a7871c27d7a712c8a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:38:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:38:49Z,use_quota=True,user_id='31fd3541c79a4a9898501b2851c052e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:38:48 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-633c421c-d457-419b-bf9f-9039e610c79e tempest-VolumeQuotasAdminTestJSON-1253267533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c41dcdd-0d8b-472f-a49d-978f648a86ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:38:48 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-633c421c-d457-419b-bf9f-9039e610c79e tempest-VolumeQuotasAdminTestJSON-1253267533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c41dcdd-0d8b-472f-a49d-978f648a86ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:38:48 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-633c421c-d457-419b-bf9f-9039e610c79e tempest-VolumeQuotasAdminTestJSON-1253267533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dece63cb-f0a8-43b2-9888-f9c44959581a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:38:48 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-633c421c-d457-419b-bf9f-9039e610c79e tempest-VolumeQuotasAdminTestJSON-1253267533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dece63cb-f0a8-43b2-9888-f9c44959581a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df87df78-21fd-4b5d-b6cc-13edca3e848d', 'volume_name': 'volume-df87df78-21fd-4b5d-b6cc-13edca3e848d', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:38:48 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-633c421c-d457-419b-bf9f-9039e610c79e tempest-VolumeQuotasAdminTestJSON-1253267533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fad6670-ab37-495f-a6d4-aed88b7f12e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:38:48 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-633c421c-d457-419b-bf9f-9039e610c79e tempest-VolumeQuotasAdminTestJSON-1253267533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fad6670-ab37-495f-a6d4-aed88b7f12e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:38:48 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-633c421c-d457-419b-bf9f-9039e610c79e tempest-VolumeQuotasAdminTestJSON-1253267533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (960eec37-24d6-4360-8fda-cba523a29090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:38:48 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-633c421c-d457-419b-bf9f-9039e610c79e tempest-VolumeQuotasAdminTestJSON-1253267533 None] Volume df87df78-21fd-4b5d-b6cc-13edca3e848d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df87df78-21fd-4b5d-b6cc-13edca3e848d', 'volume_size': 1} Jul 10 06:38:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-633c421c-d457-419b-bf9f-9039e610c79e tempest-VolumeQuotasAdminTestJSON-1253267533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:38:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-633c421c-d457-419b-bf9f-9039e610c79e tempest-VolumeQuotasAdminTestJSON-1253267533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:38:48 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-633c421c-d457-419b-bf9f-9039e610c79e tempest-VolumeQuotasAdminTestJSON-1253267533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:38:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1372665766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df87df78-21fd-4b5d-b6cc-13edca3e848d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69b7c39250a840a7871c27d7a712c8a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:38:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:38:49Z,use_quota=True,user_id='31fd3541c79a4a9898501b2851c052e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:38:48 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-633c421c-d457-419b-bf9f-9039e610c79e tempest-VolumeQuotasAdminTestJSON-1253267533 None] Creating volume df87df78-21fd-4b5d-b6cc-13edca3e848d {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:38:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-633c421c-d457-419b-bf9f-9039e610c79e tempest-VolumeQuotasAdminTestJSON-1253267533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:38:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-633c421c-d457-419b-bf9f-9039e610c79e tempest-VolumeQuotasAdminTestJSON-1253267533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:38:48 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-633c421c-d457-419b-bf9f-9039e610c79e tempest-VolumeQuotasAdminTestJSON-1253267533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:38:48 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-633c421c-d457-419b-bf9f-9039e610c79e tempest-VolumeQuotasAdminTestJSON-1253267533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:38:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-633c421c-d457-419b-bf9f-9039e610c79e tempest-VolumeQuotasAdminTestJSON-1253267533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:38:48 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-633c421c-d457-419b-bf9f-9039e610c79e tempest-VolumeQuotasAdminTestJSON-1253267533 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:38:48 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-633c421c-d457-419b-bf9f-9039e610c79e tempest-VolumeQuotasAdminTestJSON-1253267533 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:38:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-633c421c-d457-419b-bf9f-9039e610c79e tempest-VolumeQuotasAdminTestJSON-1253267533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-df87df78-21fd-4b5d-b6cc-13edca3e848d 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:38:48 devstack sudo[90983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-df87df78-21fd-4b5d-b6cc-13edca3e848d 1073741824 Jul 10 06:38:48 devstack sudo[90983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:38:49 devstack sudo[90983]: pam_unix(sudo:session): session closed for user root Jul 10 06:38:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-633c421c-d457-419b-bf9f-9039e610c79e tempest-VolumeQuotasAdminTestJSON-1253267533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-df87df78-21fd-4b5d-b6cc-13edca3e848d 1073741824" returned: 0 in 1.092s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:38:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-633c421c-d457-419b-bf9f-9039e610c79e tempest-VolumeQuotasAdminTestJSON-1253267533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-df87df78-21fd-4b5d-b6cc-13edca3e848d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:38:49 devstack sudo[90990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-df87df78-21fd-4b5d-b6cc-13edca3e848d Jul 10 06:38:49 devstack sudo[90990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:38:50 devstack sudo[90990]: pam_unix(sudo:session): session closed for user root Jul 10 06:38:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-633c421c-d457-419b-bf9f-9039e610c79e tempest-VolumeQuotasAdminTestJSON-1253267533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-df87df78-21fd-4b5d-b6cc-13edca3e848d" returned: 0 in 0.855s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:38:50 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-633c421c-d457-419b-bf9f-9039e610c79e tempest-VolumeQuotasAdminTestJSON-1253267533 None] <== create_volume: return (1999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:38:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-633c421c-d457-419b-bf9f-9039e610c79e tempest-VolumeQuotasAdminTestJSON-1253267533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.003s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:38:50 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-633c421c-d457-419b-bf9f-9039e610c79e tempest-VolumeQuotasAdminTestJSON-1253267533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (960eec37-24d6-4360-8fda-cba523a29090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df87df78-21fd-4b5d-b6cc-13edca3e848d', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:38:50 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-633c421c-d457-419b-bf9f-9039e610c79e tempest-VolumeQuotasAdminTestJSON-1253267533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66329d2d-a15a-4eda-9eda-84a417dc8da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:38:50 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-633c421c-d457-419b-bf9f-9039e610c79e tempest-VolumeQuotasAdminTestJSON-1253267533 None] Volume volume-df87df78-21fd-4b5d-b6cc-13edca3e848d (df87df78-21fd-4b5d-b6cc-13edca3e848d): created successfully Jul 10 06:38:50 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-633c421c-d457-419b-bf9f-9039e610c79e tempest-VolumeQuotasAdminTestJSON-1253267533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66329d2d-a15a-4eda-9eda-84a417dc8da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:38:50 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-633c421c-d457-419b-bf9f-9039e610c79e tempest-VolumeQuotasAdminTestJSON-1253267533 None] Flow 'volume_create_manager' (f5577d04-873c-4f82-8927-d674bb320c84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:38:50 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-633c421c-d457-419b-bf9f-9039e610c79e tempest-VolumeQuotasAdminTestJSON-1253267533 None] Created volume successfully. Jul 10 06:38:52 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-882b03cb-6d05-4e16-8eb4-0e26dbaf5f45 tempest-VolumeQuotasAdminTestJSON-1253267533 None] Acquiring lock "cinder-df87df78-21fd-4b5d-b6cc-13edca3e848d-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:38:52 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-882b03cb-6d05-4e16-8eb4-0e26dbaf5f45 tempest-VolumeQuotasAdminTestJSON-1253267533 None] Lock "cinder-df87df78-21fd-4b5d-b6cc-13edca3e848d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:38:52 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-882b03cb-6d05-4e16-8eb4-0e26dbaf5f45 tempest-VolumeQuotasAdminTestJSON-1253267533 None] Acquiring lock "cinder-quobyte-df87df78-21fd-4b5d-b6cc-13edca3e848d" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:38:52 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-882b03cb-6d05-4e16-8eb4-0e26dbaf5f45 tempest-VolumeQuotasAdminTestJSON-1253267533 None] Lock "cinder-quobyte-df87df78-21fd-4b5d-b6cc-13edca3e848d" acquired by "delete_volume" :: waited 0.024s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:38:52 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ece606-1ede-4aa3-b09a-9933ade329cf]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:38:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-882b03cb-6d05-4e16-8eb4-0e26dbaf5f45 tempest-VolumeQuotasAdminTestJSON-1253267533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-df87df78-21fd-4b5d-b6cc-13edca3e848d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:38:52 devstack sudo[91072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-df87df78-21fd-4b5d-b6cc-13edca3e848d Jul 10 06:38:52 devstack sudo[91072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:38:53 devstack sudo[91072]: pam_unix(sudo:session): session closed for user root Jul 10 06:38:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-882b03cb-6d05-4e16-8eb4-0e26dbaf5f45 tempest-VolumeQuotasAdminTestJSON-1253267533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-df87df78-21fd-4b5d-b6cc-13edca3e848d" returned: 0 in 0.829s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:38:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-882b03cb-6d05-4e16-8eb4-0e26dbaf5f45 tempest-VolumeQuotasAdminTestJSON-1253267533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-df87df78-21fd-4b5d-b6cc-13edca3e848d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:38:53 devstack sudo[91097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-df87df78-21fd-4b5d-b6cc-13edca3e848d Jul 10 06:38:53 devstack sudo[91097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:38:53 devstack sudo[91097]: pam_unix(sudo:session): session closed for user root Jul 10 06:38:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-882b03cb-6d05-4e16-8eb4-0e26dbaf5f45 tempest-VolumeQuotasAdminTestJSON-1253267533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-df87df78-21fd-4b5d-b6cc-13edca3e848d" returned: 0 in 0.756s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:38:53 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-882b03cb-6d05-4e16-8eb4-0e26dbaf5f45 tempest-VolumeQuotasAdminTestJSON-1253267533 None] Lock "cinder-quobyte-df87df78-21fd-4b5d-b6cc-13edca3e848d" released by "delete_volume" :: held 1.636s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:38:53 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-882b03cb-6d05-4e16-8eb4-0e26dbaf5f45 tempest-VolumeQuotasAdminTestJSON-1253267533 None] Created reservations ['2992b8a2-49ad-4e05-8224-796e76a059c6', 'c020719d-c2c8-4f01-b952-8d1d8bbfefed', 'd0ae4e95-780d-45d7-8ceb-01e826adcb70', '3a0bec4f-8c7a-4b8a-9a95-695c814bad9c'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:38:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-882b03cb-6d05-4e16-8eb4-0e26dbaf5f45 tempest-VolumeQuotasAdminTestJSON-1253267533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:38:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-882b03cb-6d05-4e16-8eb4-0e26dbaf5f45 tempest-VolumeQuotasAdminTestJSON-1253267533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:38:54 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-882b03cb-6d05-4e16-8eb4-0e26dbaf5f45 tempest-VolumeQuotasAdminTestJSON-1253267533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:38:54 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-882b03cb-6d05-4e16-8eb4-0e26dbaf5f45 tempest-VolumeQuotasAdminTestJSON-1253267533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:38:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-882b03cb-6d05-4e16-8eb4-0e26dbaf5f45 tempest-VolumeQuotasAdminTestJSON-1253267533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:38:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-882b03cb-6d05-4e16-8eb4-0e26dbaf5f45 tempest-VolumeQuotasAdminTestJSON-1253267533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:38:54 devstack sudo[91118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:38:54 devstack sudo[91118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:38:54 devstack sudo[91118]: pam_unix(sudo:session): session closed for user root Jul 10 06:38:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-882b03cb-6d05-4e16-8eb4-0e26dbaf5f45 tempest-VolumeQuotasAdminTestJSON-1253267533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.713s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:38:54 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-882b03cb-6d05-4e16-8eb4-0e26dbaf5f45 tempest-VolumeQuotasAdminTestJSON-1253267533 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:38:54 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-882b03cb-6d05-4e16-8eb4-0e26dbaf5f45 tempest-VolumeQuotasAdminTestJSON-1253267533 None] Deleted volume successfully. Jul 10 06:38:54 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-882b03cb-6d05-4e16-8eb4-0e26dbaf5f45 tempest-VolumeQuotasAdminTestJSON-1253267533 None] Lock "cinder-df87df78-21fd-4b5d-b6cc-13edca3e848d-delete_volume" released by "delete_volume" :: held 2.584s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:38:55 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bba650c-4b09-4041-bd94-7b32250ce4bc tempest-VolumeQuotasAdminTestJSON-1253267533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:38:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-1bba650c-4b09-4041-bd94-7b32250ce4bc tempest-VolumeQuotasAdminTestJSON-1253267533 None] Flow 'volume_create_manager' (c7b75407-7fee-48ca-81e9-dcabbe5167d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:38:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-1bba650c-4b09-4041-bd94-7b32250ce4bc tempest-VolumeQuotasAdminTestJSON-1253267533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b3e5597-b961-4383-af63-a7513ccd5535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:38:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-1bba650c-4b09-4041-bd94-7b32250ce4bc tempest-VolumeQuotasAdminTestJSON-1253267533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b3e5597-b961-4383-af63-a7513ccd5535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-421925098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72c60ebf-2e1d-4d84-b677-54b225a2b5fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69b7c39250a840a7871c27d7a712c8a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:38:55Z,use_quota=True,user_id='31fd3541c79a4a9898501b2851c052e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:38:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-1bba650c-4b09-4041-bd94-7b32250ce4bc tempest-VolumeQuotasAdminTestJSON-1253267533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b5b434d-bc29-4901-abd2-a53c2153ea8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:38:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-1bba650c-4b09-4041-bd94-7b32250ce4bc tempest-VolumeQuotasAdminTestJSON-1253267533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b5b434d-bc29-4901-abd2-a53c2153ea8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:38:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-1bba650c-4b09-4041-bd94-7b32250ce4bc tempest-VolumeQuotasAdminTestJSON-1253267533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b22243-a809-426f-bc6c-5437baf98237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:38:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-1bba650c-4b09-4041-bd94-7b32250ce4bc tempest-VolumeQuotasAdminTestJSON-1253267533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b22243-a809-426f-bc6c-5437baf98237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72c60ebf-2e1d-4d84-b677-54b225a2b5fe', 'volume_name': 'volume-72c60ebf-2e1d-4d84-b677-54b225a2b5fe', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:38:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-1bba650c-4b09-4041-bd94-7b32250ce4bc tempest-VolumeQuotasAdminTestJSON-1253267533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e06c614-eb54-43e8-82e2-1e3fbd5e06fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:38:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-1bba650c-4b09-4041-bd94-7b32250ce4bc tempest-VolumeQuotasAdminTestJSON-1253267533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e06c614-eb54-43e8-82e2-1e3fbd5e06fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:38:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-1bba650c-4b09-4041-bd94-7b32250ce4bc tempest-VolumeQuotasAdminTestJSON-1253267533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8603c8db-8021-4424-ad2e-6ed754223381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:38:55 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-1bba650c-4b09-4041-bd94-7b32250ce4bc tempest-VolumeQuotasAdminTestJSON-1253267533 None] Volume 72c60ebf-2e1d-4d84-b677-54b225a2b5fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72c60ebf-2e1d-4d84-b677-54b225a2b5fe', 'volume_size': 1} Jul 10 06:38:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-1bba650c-4b09-4041-bd94-7b32250ce4bc tempest-VolumeQuotasAdminTestJSON-1253267533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:38:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-1bba650c-4b09-4041-bd94-7b32250ce4bc tempest-VolumeQuotasAdminTestJSON-1253267533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:38:55 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-1bba650c-4b09-4041-bd94-7b32250ce4bc tempest-VolumeQuotasAdminTestJSON-1253267533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-421925098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72c60ebf-2e1d-4d84-b677-54b225a2b5fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69b7c39250a840a7871c27d7a712c8a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:38:55Z,use_quota=True,user_id='31fd3541c79a4a9898501b2851c052e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:38:55 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-1bba650c-4b09-4041-bd94-7b32250ce4bc tempest-VolumeQuotasAdminTestJSON-1253267533 None] Creating volume 72c60ebf-2e1d-4d84-b677-54b225a2b5fe {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:38:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-1bba650c-4b09-4041-bd94-7b32250ce4bc tempest-VolumeQuotasAdminTestJSON-1253267533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:38:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-1bba650c-4b09-4041-bd94-7b32250ce4bc tempest-VolumeQuotasAdminTestJSON-1253267533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:38:55 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-1bba650c-4b09-4041-bd94-7b32250ce4bc tempest-VolumeQuotasAdminTestJSON-1253267533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:38:55 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-1bba650c-4b09-4041-bd94-7b32250ce4bc tempest-VolumeQuotasAdminTestJSON-1253267533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:38:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-1bba650c-4b09-4041-bd94-7b32250ce4bc tempest-VolumeQuotasAdminTestJSON-1253267533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:38:55 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-1bba650c-4b09-4041-bd94-7b32250ce4bc tempest-VolumeQuotasAdminTestJSON-1253267533 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:38:55 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-1bba650c-4b09-4041-bd94-7b32250ce4bc tempest-VolumeQuotasAdminTestJSON-1253267533 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:38:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1bba650c-4b09-4041-bd94-7b32250ce4bc tempest-VolumeQuotasAdminTestJSON-1253267533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-72c60ebf-2e1d-4d84-b677-54b225a2b5fe 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:38:55 devstack sudo[91121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-72c60ebf-2e1d-4d84-b677-54b225a2b5fe 1073741824 Jul 10 06:38:55 devstack sudo[91121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:38:56 devstack sudo[91121]: pam_unix(sudo:session): session closed for user root Jul 10 06:38:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1bba650c-4b09-4041-bd94-7b32250ce4bc tempest-VolumeQuotasAdminTestJSON-1253267533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-72c60ebf-2e1d-4d84-b677-54b225a2b5fe 1073741824" returned: 0 in 0.911s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:38:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1bba650c-4b09-4041-bd94-7b32250ce4bc tempest-VolumeQuotasAdminTestJSON-1253267533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-72c60ebf-2e1d-4d84-b677-54b225a2b5fe {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:38:56 devstack sudo[91127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-72c60ebf-2e1d-4d84-b677-54b225a2b5fe Jul 10 06:38:56 devstack sudo[91127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:38:56 devstack sudo[91127]: pam_unix(sudo:session): session closed for user root Jul 10 06:38:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1bba650c-4b09-4041-bd94-7b32250ce4bc tempest-VolumeQuotasAdminTestJSON-1253267533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-72c60ebf-2e1d-4d84-b677-54b225a2b5fe" returned: 0 in 0.666s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:38:56 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-1bba650c-4b09-4041-bd94-7b32250ce4bc tempest-VolumeQuotasAdminTestJSON-1253267533 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:38:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-1bba650c-4b09-4041-bd94-7b32250ce4bc tempest-VolumeQuotasAdminTestJSON-1253267533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:38:56 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-1bba650c-4b09-4041-bd94-7b32250ce4bc tempest-VolumeQuotasAdminTestJSON-1253267533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8603c8db-8021-4424-ad2e-6ed754223381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72c60ebf-2e1d-4d84-b677-54b225a2b5fe', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:38:56 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-1bba650c-4b09-4041-bd94-7b32250ce4bc tempest-VolumeQuotasAdminTestJSON-1253267533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f072e47-0bf1-42eb-8d70-688dc36ed1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:38:56 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-1bba650c-4b09-4041-bd94-7b32250ce4bc tempest-VolumeQuotasAdminTestJSON-1253267533 None] Volume volume-72c60ebf-2e1d-4d84-b677-54b225a2b5fe (72c60ebf-2e1d-4d84-b677-54b225a2b5fe): created successfully Jul 10 06:38:56 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-1bba650c-4b09-4041-bd94-7b32250ce4bc tempest-VolumeQuotasAdminTestJSON-1253267533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f072e47-0bf1-42eb-8d70-688dc36ed1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:38:56 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-1bba650c-4b09-4041-bd94-7b32250ce4bc tempest-VolumeQuotasAdminTestJSON-1253267533 None] Flow 'volume_create_manager' (c7b75407-7fee-48ca-81e9-dcabbe5167d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:38:57 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-1bba650c-4b09-4041-bd94-7b32250ce4bc tempest-VolumeQuotasAdminTestJSON-1253267533 None] Created volume successfully. Jul 10 06:38:58 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-3b702d61-0978-4ecd-a2b8-e5dd9d8f3956 tempest-VolumeQuotasAdminTestJSON-2063228375 None] Transfer volume completed successfully. Jul 10 06:38:59 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e2696642-c75b-4126-85a9-88610c5e73b2 tempest-VolumeQuotasAdminTestJSON-927161973 None] Acquiring lock "cinder-72c60ebf-2e1d-4d84-b677-54b225a2b5fe-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:38:59 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e2696642-c75b-4126-85a9-88610c5e73b2 tempest-VolumeQuotasAdminTestJSON-927161973 None] Lock "cinder-72c60ebf-2e1d-4d84-b677-54b225a2b5fe-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:38:59 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e2696642-c75b-4126-85a9-88610c5e73b2 tempest-VolumeQuotasAdminTestJSON-927161973 None] Acquiring lock "cinder-quobyte-72c60ebf-2e1d-4d84-b677-54b225a2b5fe" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:38:59 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e2696642-c75b-4126-85a9-88610c5e73b2 tempest-VolumeQuotasAdminTestJSON-927161973 None] Lock "cinder-quobyte-72c60ebf-2e1d-4d84-b677-54b225a2b5fe" acquired by "delete_volume" :: waited 0.026s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:38:59 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc444bb5-828f-4d40-8e26-e47df1b8a377]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:38:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e2696642-c75b-4126-85a9-88610c5e73b2 tempest-VolumeQuotasAdminTestJSON-927161973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-72c60ebf-2e1d-4d84-b677-54b225a2b5fe {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:38:59 devstack sudo[91135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-72c60ebf-2e1d-4d84-b677-54b225a2b5fe Jul 10 06:38:59 devstack sudo[91135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:39:00 devstack sudo[91135]: pam_unix(sudo:session): session closed for user root Jul 10 06:39:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e2696642-c75b-4126-85a9-88610c5e73b2 tempest-VolumeQuotasAdminTestJSON-927161973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-72c60ebf-2e1d-4d84-b677-54b225a2b5fe" returned: 0 in 0.830s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:39:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e2696642-c75b-4126-85a9-88610c5e73b2 tempest-VolumeQuotasAdminTestJSON-927161973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-72c60ebf-2e1d-4d84-b677-54b225a2b5fe {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:39:00 devstack sudo[91140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-72c60ebf-2e1d-4d84-b677-54b225a2b5fe Jul 10 06:39:00 devstack sudo[91140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:39:00 devstack sudo[91140]: pam_unix(sudo:session): session closed for user root Jul 10 06:39:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e2696642-c75b-4126-85a9-88610c5e73b2 tempest-VolumeQuotasAdminTestJSON-927161973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-72c60ebf-2e1d-4d84-b677-54b225a2b5fe" returned: 0 in 0.640s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:39:00 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e2696642-c75b-4126-85a9-88610c5e73b2 tempest-VolumeQuotasAdminTestJSON-927161973 None] Lock "cinder-quobyte-72c60ebf-2e1d-4d84-b677-54b225a2b5fe" released by "delete_volume" :: held 1.522s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:39:00 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-e2696642-c75b-4126-85a9-88610c5e73b2 tempest-VolumeQuotasAdminTestJSON-927161973 None] Created reservations ['56108921-a9be-4285-916d-bcfa4aa2d6a2', 'b415cfac-fa3d-40b3-9b8e-dc8a68cb0f9c', '6b5cd284-5de8-41b5-9a26-964313477a36', '322c46ea-fbeb-4ebc-bbb1-51072935af9f'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:39:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e2696642-c75b-4126-85a9-88610c5e73b2 tempest-VolumeQuotasAdminTestJSON-927161973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:39:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e2696642-c75b-4126-85a9-88610c5e73b2 tempest-VolumeQuotasAdminTestJSON-927161973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:39:00 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-e2696642-c75b-4126-85a9-88610c5e73b2 tempest-VolumeQuotasAdminTestJSON-927161973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:39:00 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-e2696642-c75b-4126-85a9-88610c5e73b2 tempest-VolumeQuotasAdminTestJSON-927161973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:39:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e2696642-c75b-4126-85a9-88610c5e73b2 tempest-VolumeQuotasAdminTestJSON-927161973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:39:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e2696642-c75b-4126-85a9-88610c5e73b2 tempest-VolumeQuotasAdminTestJSON-927161973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:39:00 devstack sudo[91143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:39:00 devstack sudo[91143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:39:01 devstack sudo[91143]: pam_unix(sudo:session): session closed for user root Jul 10 06:39:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e2696642-c75b-4126-85a9-88610c5e73b2 tempest-VolumeQuotasAdminTestJSON-927161973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.689s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:39:01 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-e2696642-c75b-4126-85a9-88610c5e73b2 tempest-VolumeQuotasAdminTestJSON-927161973 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:39:01 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-e2696642-c75b-4126-85a9-88610c5e73b2 tempest-VolumeQuotasAdminTestJSON-927161973 None] Deleted volume successfully. Jul 10 06:39:01 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e2696642-c75b-4126-85a9-88610c5e73b2 tempest-VolumeQuotasAdminTestJSON-927161973 None] Lock "cinder-72c60ebf-2e1d-4d84-b677-54b225a2b5fe-delete_volume" released by "delete_volume" :: held 2.475s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:39:05 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e863c48-db51-4e85-b290-b4c07863f964 tempest-AttachVolumeShelveTestJSON-2071360101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:39:05 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2e863c48-db51-4e85-b290-b4c07863f964 tempest-AttachVolumeShelveTestJSON-2071360101 None] Flow 'volume_create_manager' (9389f8bf-8150-45d0-9f2d-bd283b1078da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:39:05 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2e863c48-db51-4e85-b290-b4c07863f964 tempest-AttachVolumeShelveTestJSON-2071360101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2cb3d26-3ce8-4477-9add-77aa78535136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:39:05 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2e863c48-db51-4e85-b290-b4c07863f964 tempest-AttachVolumeShelveTestJSON-2071360101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2cb3d26-3ce8-4477-9add-77aa78535136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-497043578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23fed609-6fe1-498d-94a5-38540d0aa065,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a5b607302fd4c48b0e99ca6b2e16b54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:39:05Z,use_quota=True,user_id='72b3085f55074762a83449b68fa1b054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:39:05 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2e863c48-db51-4e85-b290-b4c07863f964 tempest-AttachVolumeShelveTestJSON-2071360101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2071187d-83c9-453d-a156-90cf9b0aa814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:39:05 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2e863c48-db51-4e85-b290-b4c07863f964 tempest-AttachVolumeShelveTestJSON-2071360101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2071187d-83c9-453d-a156-90cf9b0aa814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:39:05 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2e863c48-db51-4e85-b290-b4c07863f964 tempest-AttachVolumeShelveTestJSON-2071360101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5995f46-8288-4b04-88d4-c98c6cf43dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:39:05 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2e863c48-db51-4e85-b290-b4c07863f964 tempest-AttachVolumeShelveTestJSON-2071360101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5995f46-8288-4b04-88d4-c98c6cf43dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23fed609-6fe1-498d-94a5-38540d0aa065', 'volume_name': 'volume-23fed609-6fe1-498d-94a5-38540d0aa065', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:39:05 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2e863c48-db51-4e85-b290-b4c07863f964 tempest-AttachVolumeShelveTestJSON-2071360101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4aa1be2-3d15-4393-9901-0a1917e8246e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:39:05 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2e863c48-db51-4e85-b290-b4c07863f964 tempest-AttachVolumeShelveTestJSON-2071360101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4aa1be2-3d15-4393-9901-0a1917e8246e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:39:05 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2e863c48-db51-4e85-b290-b4c07863f964 tempest-AttachVolumeShelveTestJSON-2071360101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52be3379-247a-48b2-bf36-25f34ae0c7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:39:05 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-2e863c48-db51-4e85-b290-b4c07863f964 tempest-AttachVolumeShelveTestJSON-2071360101 None] Volume 23fed609-6fe1-498d-94a5-38540d0aa065: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23fed609-6fe1-498d-94a5-38540d0aa065', 'volume_size': 1} Jul 10 06:39:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2e863c48-db51-4e85-b290-b4c07863f964 tempest-AttachVolumeShelveTestJSON-2071360101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:39:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2e863c48-db51-4e85-b290-b4c07863f964 tempest-AttachVolumeShelveTestJSON-2071360101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:39:05 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-2e863c48-db51-4e85-b290-b4c07863f964 tempest-AttachVolumeShelveTestJSON-2071360101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-497043578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23fed609-6fe1-498d-94a5-38540d0aa065,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a5b607302fd4c48b0e99ca6b2e16b54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:39:05Z,use_quota=True,user_id='72b3085f55074762a83449b68fa1b054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:39:05 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-2e863c48-db51-4e85-b290-b4c07863f964 tempest-AttachVolumeShelveTestJSON-2071360101 None] Creating volume 23fed609-6fe1-498d-94a5-38540d0aa065 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:39:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2e863c48-db51-4e85-b290-b4c07863f964 tempest-AttachVolumeShelveTestJSON-2071360101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:39:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2e863c48-db51-4e85-b290-b4c07863f964 tempest-AttachVolumeShelveTestJSON-2071360101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:39:05 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-2e863c48-db51-4e85-b290-b4c07863f964 tempest-AttachVolumeShelveTestJSON-2071360101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:39:05 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-2e863c48-db51-4e85-b290-b4c07863f964 tempest-AttachVolumeShelveTestJSON-2071360101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:39:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2e863c48-db51-4e85-b290-b4c07863f964 tempest-AttachVolumeShelveTestJSON-2071360101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:39:05 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-2e863c48-db51-4e85-b290-b4c07863f964 tempest-AttachVolumeShelveTestJSON-2071360101 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:39:05 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-2e863c48-db51-4e85-b290-b4c07863f964 tempest-AttachVolumeShelveTestJSON-2071360101 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:39:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2e863c48-db51-4e85-b290-b4c07863f964 tempest-AttachVolumeShelveTestJSON-2071360101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-23fed609-6fe1-498d-94a5-38540d0aa065 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:39:05 devstack sudo[91148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-23fed609-6fe1-498d-94a5-38540d0aa065 1073741824 Jul 10 06:39:05 devstack sudo[91148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:39:06 devstack sudo[91148]: pam_unix(sudo:session): session closed for user root Jul 10 06:39:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2e863c48-db51-4e85-b290-b4c07863f964 tempest-AttachVolumeShelveTestJSON-2071360101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-23fed609-6fe1-498d-94a5-38540d0aa065 1073741824" returned: 0 in 0.990s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:39:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2e863c48-db51-4e85-b290-b4c07863f964 tempest-AttachVolumeShelveTestJSON-2071360101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-23fed609-6fe1-498d-94a5-38540d0aa065 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:39:06 devstack sudo[91174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-23fed609-6fe1-498d-94a5-38540d0aa065 Jul 10 06:39:06 devstack sudo[91174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:39:07 devstack sudo[91174]: pam_unix(sudo:session): session closed for user root Jul 10 06:39:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2e863c48-db51-4e85-b290-b4c07863f964 tempest-AttachVolumeShelveTestJSON-2071360101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-23fed609-6fe1-498d-94a5-38540d0aa065" returned: 0 in 0.702s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:39:07 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-2e863c48-db51-4e85-b290-b4c07863f964 tempest-AttachVolumeShelveTestJSON-2071360101 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:39:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2e863c48-db51-4e85-b290-b4c07863f964 tempest-AttachVolumeShelveTestJSON-2071360101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.741s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:39:07 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2e863c48-db51-4e85-b290-b4c07863f964 tempest-AttachVolumeShelveTestJSON-2071360101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52be3379-247a-48b2-bf36-25f34ae0c7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23fed609-6fe1-498d-94a5-38540d0aa065', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:39:07 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2e863c48-db51-4e85-b290-b4c07863f964 tempest-AttachVolumeShelveTestJSON-2071360101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaa81388-2eeb-4884-9292-cdca8e1082e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:39:07 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-2e863c48-db51-4e85-b290-b4c07863f964 tempest-AttachVolumeShelveTestJSON-2071360101 None] Volume volume-23fed609-6fe1-498d-94a5-38540d0aa065 (23fed609-6fe1-498d-94a5-38540d0aa065): created successfully Jul 10 06:39:07 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2e863c48-db51-4e85-b290-b4c07863f964 tempest-AttachVolumeShelveTestJSON-2071360101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaa81388-2eeb-4884-9292-cdca8e1082e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:39:07 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2e863c48-db51-4e85-b290-b4c07863f964 tempest-AttachVolumeShelveTestJSON-2071360101 None] Flow 'volume_create_manager' (9389f8bf-8150-45d0-9f2d-bd283b1078da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:39:07 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-2e863c48-db51-4e85-b290-b4c07863f964 tempest-AttachVolumeShelveTestJSON-2071360101 None] Created volume successfully. Jul 10 06:39:07 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fa08768-9c34-4b1e-8bf1-4a0572f67aa5 tempest-AttachVolumeNegativeTest-501522069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:39:07 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5fa08768-9c34-4b1e-8bf1-4a0572f67aa5 tempest-AttachVolumeNegativeTest-501522069 None] Flow 'volume_create_manager' (8b0f532b-f100-4f56-a427-b71bcfcca465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:39:07 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5fa08768-9c34-4b1e-8bf1-4a0572f67aa5 tempest-AttachVolumeNegativeTest-501522069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49c087c6-4c78-4ff1-aed6-a693cea16d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:39:07 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5fa08768-9c34-4b1e-8bf1-4a0572f67aa5 tempest-AttachVolumeNegativeTest-501522069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49c087c6-4c78-4ff1-aed6-a693cea16d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:39:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-996885567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=874b2f32-d55a-4c95-a29d-ebb7d0cd4a07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d67c175cc144f4dbe428efa469dea02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:39:08Z,use_quota=True,user_id='ac6666bc6cf64f2880f353064ab98213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:39:07 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5fa08768-9c34-4b1e-8bf1-4a0572f67aa5 tempest-AttachVolumeNegativeTest-501522069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fce34860-d276-4c37-ba30-be7e7b35ba59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:39:07 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5fa08768-9c34-4b1e-8bf1-4a0572f67aa5 tempest-AttachVolumeNegativeTest-501522069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fce34860-d276-4c37-ba30-be7e7b35ba59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:39:07 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5fa08768-9c34-4b1e-8bf1-4a0572f67aa5 tempest-AttachVolumeNegativeTest-501522069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc5d88e8-9fee-42aa-a412-2af06841125b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:39:07 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5fa08768-9c34-4b1e-8bf1-4a0572f67aa5 tempest-AttachVolumeNegativeTest-501522069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc5d88e8-9fee-42aa-a412-2af06841125b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '874b2f32-d55a-4c95-a29d-ebb7d0cd4a07', 'volume_name': 'volume-874b2f32-d55a-4c95-a29d-ebb7d0cd4a07', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:39:07 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5fa08768-9c34-4b1e-8bf1-4a0572f67aa5 tempest-AttachVolumeNegativeTest-501522069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd18d1c9-385b-4754-beb2-1b3ca7ec510e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:39:07 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5fa08768-9c34-4b1e-8bf1-4a0572f67aa5 tempest-AttachVolumeNegativeTest-501522069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd18d1c9-385b-4754-beb2-1b3ca7ec510e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:39:07 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5fa08768-9c34-4b1e-8bf1-4a0572f67aa5 tempest-AttachVolumeNegativeTest-501522069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27426ed3-e8ec-4621-a84f-d9aeceb42155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:39:07 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-5fa08768-9c34-4b1e-8bf1-4a0572f67aa5 tempest-AttachVolumeNegativeTest-501522069 None] Volume 874b2f32-d55a-4c95-a29d-ebb7d0cd4a07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-874b2f32-d55a-4c95-a29d-ebb7d0cd4a07', 'volume_size': 1} Jul 10 06:39:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5fa08768-9c34-4b1e-8bf1-4a0572f67aa5 tempest-AttachVolumeNegativeTest-501522069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:39:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5fa08768-9c34-4b1e-8bf1-4a0572f67aa5 tempest-AttachVolumeNegativeTest-501522069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:39:07 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5fa08768-9c34-4b1e-8bf1-4a0572f67aa5 tempest-AttachVolumeNegativeTest-501522069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:39:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-996885567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=874b2f32-d55a-4c95-a29d-ebb7d0cd4a07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d67c175cc144f4dbe428efa469dea02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:39:08Z,use_quota=True,user_id='ac6666bc6cf64f2880f353064ab98213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:39:07 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-5fa08768-9c34-4b1e-8bf1-4a0572f67aa5 tempest-AttachVolumeNegativeTest-501522069 None] Creating volume 874b2f32-d55a-4c95-a29d-ebb7d0cd4a07 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:39:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5fa08768-9c34-4b1e-8bf1-4a0572f67aa5 tempest-AttachVolumeNegativeTest-501522069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:39:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5fa08768-9c34-4b1e-8bf1-4a0572f67aa5 tempest-AttachVolumeNegativeTest-501522069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:39:07 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5fa08768-9c34-4b1e-8bf1-4a0572f67aa5 tempest-AttachVolumeNegativeTest-501522069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:39:07 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5fa08768-9c34-4b1e-8bf1-4a0572f67aa5 tempest-AttachVolumeNegativeTest-501522069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:39:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5fa08768-9c34-4b1e-8bf1-4a0572f67aa5 tempest-AttachVolumeNegativeTest-501522069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:39:07 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5fa08768-9c34-4b1e-8bf1-4a0572f67aa5 tempest-AttachVolumeNegativeTest-501522069 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:39:07 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-5fa08768-9c34-4b1e-8bf1-4a0572f67aa5 tempest-AttachVolumeNegativeTest-501522069 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:39:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5fa08768-9c34-4b1e-8bf1-4a0572f67aa5 tempest-AttachVolumeNegativeTest-501522069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-874b2f32-d55a-4c95-a29d-ebb7d0cd4a07 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:39:07 devstack sudo[91185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-874b2f32-d55a-4c95-a29d-ebb7d0cd4a07 1073741824 Jul 10 06:39:07 devstack sudo[91185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:39:08 devstack sudo[91185]: pam_unix(sudo:session): session closed for user root Jul 10 06:39:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5fa08768-9c34-4b1e-8bf1-4a0572f67aa5 tempest-AttachVolumeNegativeTest-501522069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-874b2f32-d55a-4c95-a29d-ebb7d0cd4a07 1073741824" returned: 0 in 1.060s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:39:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5fa08768-9c34-4b1e-8bf1-4a0572f67aa5 tempest-AttachVolumeNegativeTest-501522069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-874b2f32-d55a-4c95-a29d-ebb7d0cd4a07 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:39:09 devstack sudo[91194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-874b2f32-d55a-4c95-a29d-ebb7d0cd4a07 Jul 10 06:39:09 devstack sudo[91194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:39:09 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-bce4f28f-27bc-44a5-b47e-acf8edd7445e tempest-VolumesServicesTestJSON-1560722292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:39:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bce4f28f-27bc-44a5-b47e-acf8edd7445e tempest-VolumesServicesTestJSON-1560722292 None] Flow 'volume_create_manager' (11eebec5-f4e2-44b6-9454-bdcf0cf0ab05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:39:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bce4f28f-27bc-44a5-b47e-acf8edd7445e tempest-VolumesServicesTestJSON-1560722292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24f34b7e-7fcc-4f82-ad50-52ab46e0946b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:39:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bce4f28f-27bc-44a5-b47e-acf8edd7445e tempest-VolumesServicesTestJSON-1560722292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24f34b7e-7fcc-4f82-ad50-52ab46e0946b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-885666871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b561f0c1-fa90-4fa4-83cc-c601e5d89815,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b62db195a7c4178af4fb8131cf7014c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:39:09Z,use_quota=True,user_id='82225df3e38d4d5ab192d8cb2c8cd5ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:39:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bce4f28f-27bc-44a5-b47e-acf8edd7445e tempest-VolumesServicesTestJSON-1560722292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94b2484c-f73b-4b63-93a8-74210dd92926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:39:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bce4f28f-27bc-44a5-b47e-acf8edd7445e tempest-VolumesServicesTestJSON-1560722292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94b2484c-f73b-4b63-93a8-74210dd92926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:39:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bce4f28f-27bc-44a5-b47e-acf8edd7445e tempest-VolumesServicesTestJSON-1560722292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0716fca-54b1-433d-809f-3116af60ee76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:39:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bce4f28f-27bc-44a5-b47e-acf8edd7445e tempest-VolumesServicesTestJSON-1560722292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0716fca-54b1-433d-809f-3116af60ee76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b561f0c1-fa90-4fa4-83cc-c601e5d89815', 'volume_name': 'volume-b561f0c1-fa90-4fa4-83cc-c601e5d89815', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:39:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bce4f28f-27bc-44a5-b47e-acf8edd7445e tempest-VolumesServicesTestJSON-1560722292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b15e8cac-2498-4011-b705-2553bc1e1011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:39:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bce4f28f-27bc-44a5-b47e-acf8edd7445e tempest-VolumesServicesTestJSON-1560722292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b15e8cac-2498-4011-b705-2553bc1e1011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:39:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bce4f28f-27bc-44a5-b47e-acf8edd7445e tempest-VolumesServicesTestJSON-1560722292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62312639-058e-4c22-9add-4798a0dd4b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:39:09 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-bce4f28f-27bc-44a5-b47e-acf8edd7445e tempest-VolumesServicesTestJSON-1560722292 None] Volume b561f0c1-fa90-4fa4-83cc-c601e5d89815: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b561f0c1-fa90-4fa4-83cc-c601e5d89815', 'volume_size': 1} Jul 10 06:39:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-bce4f28f-27bc-44a5-b47e-acf8edd7445e tempest-VolumesServicesTestJSON-1560722292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:39:09 devstack sudo[91194]: pam_unix(sudo:session): session closed for user root Jul 10 06:39:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5fa08768-9c34-4b1e-8bf1-4a0572f67aa5 tempest-AttachVolumeNegativeTest-501522069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-874b2f32-d55a-4c95-a29d-ebb7d0cd4a07" returned: 0 in 0.689s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:39:09 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5fa08768-9c34-4b1e-8bf1-4a0572f67aa5 tempest-AttachVolumeNegativeTest-501522069 None] <== create_volume: return (1824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:39:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5fa08768-9c34-4b1e-8bf1-4a0572f67aa5 tempest-AttachVolumeNegativeTest-501522069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.827s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:39:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-bce4f28f-27bc-44a5-b47e-acf8edd7445e tempest-VolumesServicesTestJSON-1560722292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.191s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:39:09 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-bce4f28f-27bc-44a5-b47e-acf8edd7445e tempest-VolumesServicesTestJSON-1560722292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-885666871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b561f0c1-fa90-4fa4-83cc-c601e5d89815,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b62db195a7c4178af4fb8131cf7014c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:39:09Z,use_quota=True,user_id='82225df3e38d4d5ab192d8cb2c8cd5ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:39:09 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-bce4f28f-27bc-44a5-b47e-acf8edd7445e tempest-VolumesServicesTestJSON-1560722292 None] Creating volume b561f0c1-fa90-4fa4-83cc-c601e5d89815 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:39:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-bce4f28f-27bc-44a5-b47e-acf8edd7445e tempest-VolumesServicesTestJSON-1560722292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:39:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-bce4f28f-27bc-44a5-b47e-acf8edd7445e tempest-VolumesServicesTestJSON-1560722292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:39:09 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-bce4f28f-27bc-44a5-b47e-acf8edd7445e tempest-VolumesServicesTestJSON-1560722292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:39:09 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-bce4f28f-27bc-44a5-b47e-acf8edd7445e tempest-VolumesServicesTestJSON-1560722292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:39:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-bce4f28f-27bc-44a5-b47e-acf8edd7445e tempest-VolumesServicesTestJSON-1560722292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:39:09 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-bce4f28f-27bc-44a5-b47e-acf8edd7445e tempest-VolumesServicesTestJSON-1560722292 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:39:09 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-bce4f28f-27bc-44a5-b47e-acf8edd7445e tempest-VolumesServicesTestJSON-1560722292 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:39:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bce4f28f-27bc-44a5-b47e-acf8edd7445e tempest-VolumesServicesTestJSON-1560722292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b561f0c1-fa90-4fa4-83cc-c601e5d89815 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:39:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5fa08768-9c34-4b1e-8bf1-4a0572f67aa5 tempest-AttachVolumeNegativeTest-501522069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27426ed3-e8ec-4621-a84f-d9aeceb42155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-874b2f32-d55a-4c95-a29d-ebb7d0cd4a07', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:39:09 devstack sudo[91197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b561f0c1-fa90-4fa4-83cc-c601e5d89815 1073741824 Jul 10 06:39:09 devstack sudo[91197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:39:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5fa08768-9c34-4b1e-8bf1-4a0572f67aa5 tempest-AttachVolumeNegativeTest-501522069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5409b423-5678-472b-847b-d6cd3c0f54ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:39:09 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-5fa08768-9c34-4b1e-8bf1-4a0572f67aa5 tempest-AttachVolumeNegativeTest-501522069 None] Volume volume-874b2f32-d55a-4c95-a29d-ebb7d0cd4a07 (874b2f32-d55a-4c95-a29d-ebb7d0cd4a07): created successfully Jul 10 06:39:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5fa08768-9c34-4b1e-8bf1-4a0572f67aa5 tempest-AttachVolumeNegativeTest-501522069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5409b423-5678-472b-847b-d6cd3c0f54ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:39:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5fa08768-9c34-4b1e-8bf1-4a0572f67aa5 tempest-AttachVolumeNegativeTest-501522069 None] Flow 'volume_create_manager' (8b0f532b-f100-4f56-a427-b71bcfcca465) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:39:09 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-5fa08768-9c34-4b1e-8bf1-4a0572f67aa5 tempest-AttachVolumeNegativeTest-501522069 None] Created volume successfully. Jul 10 06:39:10 devstack sudo[91197]: pam_unix(sudo:session): session closed for user root Jul 10 06:39:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bce4f28f-27bc-44a5-b47e-acf8edd7445e tempest-VolumesServicesTestJSON-1560722292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b561f0c1-fa90-4fa4-83cc-c601e5d89815 1073741824" returned: 0 in 0.893s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:39:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bce4f28f-27bc-44a5-b47e-acf8edd7445e tempest-VolumesServicesTestJSON-1560722292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b561f0c1-fa90-4fa4-83cc-c601e5d89815 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:39:10 devstack sudo[91208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b561f0c1-fa90-4fa4-83cc-c601e5d89815 Jul 10 06:39:10 devstack sudo[91208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:39:11 devstack sudo[91208]: pam_unix(sudo:session): session closed for user root Jul 10 06:39:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bce4f28f-27bc-44a5-b47e-acf8edd7445e tempest-VolumesServicesTestJSON-1560722292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b561f0c1-fa90-4fa4-83cc-c601e5d89815" returned: 0 in 0.680s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:39:11 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-bce4f28f-27bc-44a5-b47e-acf8edd7445e tempest-VolumesServicesTestJSON-1560722292 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:39:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-bce4f28f-27bc-44a5-b47e-acf8edd7445e tempest-VolumesServicesTestJSON-1560722292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:39:11 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bce4f28f-27bc-44a5-b47e-acf8edd7445e tempest-VolumesServicesTestJSON-1560722292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62312639-058e-4c22-9add-4798a0dd4b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b561f0c1-fa90-4fa4-83cc-c601e5d89815', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:39:11 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bce4f28f-27bc-44a5-b47e-acf8edd7445e tempest-VolumesServicesTestJSON-1560722292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7ab3a31-c5e3-4f8c-a61a-5868d2345c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:39:11 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-bce4f28f-27bc-44a5-b47e-acf8edd7445e tempest-VolumesServicesTestJSON-1560722292 None] Volume volume-b561f0c1-fa90-4fa4-83cc-c601e5d89815 (b561f0c1-fa90-4fa4-83cc-c601e5d89815): created successfully Jul 10 06:39:11 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bce4f28f-27bc-44a5-b47e-acf8edd7445e tempest-VolumesServicesTestJSON-1560722292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7ab3a31-c5e3-4f8c-a61a-5868d2345c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:39:11 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bce4f28f-27bc-44a5-b47e-acf8edd7445e tempest-VolumesServicesTestJSON-1560722292 None] Flow 'volume_create_manager' (11eebec5-f4e2-44b6-9454-bdcf0cf0ab05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:39:11 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-bce4f28f-27bc-44a5-b47e-acf8edd7445e tempest-VolumesServicesTestJSON-1560722292 None] Created volume successfully. Jul 10 06:39:11 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f6bfa5f7-6f90-4724-a65b-fd119e4e3b3e tempest-VolumesServicesTestJSON-1560722292 None] Acquiring lock "cinder-b561f0c1-fa90-4fa4-83cc-c601e5d89815-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:39:11 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f6bfa5f7-6f90-4724-a65b-fd119e4e3b3e tempest-VolumesServicesTestJSON-1560722292 None] Lock "cinder-b561f0c1-fa90-4fa4-83cc-c601e5d89815-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:39:11 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f6bfa5f7-6f90-4724-a65b-fd119e4e3b3e tempest-VolumesServicesTestJSON-1560722292 None] Acquiring lock "cinder-quobyte-b561f0c1-fa90-4fa4-83cc-c601e5d89815" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:39:11 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f6bfa5f7-6f90-4724-a65b-fd119e4e3b3e tempest-VolumesServicesTestJSON-1560722292 None] Lock "cinder-quobyte-b561f0c1-fa90-4fa4-83cc-c601e5d89815" acquired by "delete_volume" :: waited 0.013s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:39:11 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0010ac4-ef52-48a5-b82d-a7297a9712f3]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:39:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f6bfa5f7-6f90-4724-a65b-fd119e4e3b3e tempest-VolumesServicesTestJSON-1560722292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b561f0c1-fa90-4fa4-83cc-c601e5d89815 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:39:11 devstack sudo[91216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b561f0c1-fa90-4fa4-83cc-c601e5d89815 Jul 10 06:39:11 devstack sudo[91216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:39:12 devstack sudo[91216]: pam_unix(sudo:session): session closed for user root Jul 10 06:39:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f6bfa5f7-6f90-4724-a65b-fd119e4e3b3e tempest-VolumesServicesTestJSON-1560722292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b561f0c1-fa90-4fa4-83cc-c601e5d89815" returned: 0 in 0.826s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:39:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f6bfa5f7-6f90-4724-a65b-fd119e4e3b3e tempest-VolumesServicesTestJSON-1560722292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b561f0c1-fa90-4fa4-83cc-c601e5d89815 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:39:12 devstack sudo[91227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b561f0c1-fa90-4fa4-83cc-c601e5d89815 Jul 10 06:39:12 devstack sudo[91227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:39:13 devstack sudo[91227]: pam_unix(sudo:session): session closed for user root Jul 10 06:39:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f6bfa5f7-6f90-4724-a65b-fd119e4e3b3e tempest-VolumesServicesTestJSON-1560722292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b561f0c1-fa90-4fa4-83cc-c601e5d89815" returned: 0 in 0.869s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:39:13 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f6bfa5f7-6f90-4724-a65b-fd119e4e3b3e tempest-VolumesServicesTestJSON-1560722292 None] Lock "cinder-quobyte-b561f0c1-fa90-4fa4-83cc-c601e5d89815" released by "delete_volume" :: held 1.748s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:39:13 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-f6bfa5f7-6f90-4724-a65b-fd119e4e3b3e tempest-VolumesServicesTestJSON-1560722292 None] Created reservations ['425a270a-11ae-4530-9a41-5b23cebc7773', '481d04bf-5fae-4f5c-a064-4cf4cf2933f2', 'dd0ac919-a8ba-4b92-946c-e64fa98a9df5', '536fb3b3-942e-4e9d-9e76-36444d84aa90'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:39:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f6bfa5f7-6f90-4724-a65b-fd119e4e3b3e tempest-VolumesServicesTestJSON-1560722292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:39:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f6bfa5f7-6f90-4724-a65b-fd119e4e3b3e tempest-VolumesServicesTestJSON-1560722292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:39:13 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f6bfa5f7-6f90-4724-a65b-fd119e4e3b3e tempest-VolumesServicesTestJSON-1560722292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:39:13 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f6bfa5f7-6f90-4724-a65b-fd119e4e3b3e tempest-VolumesServicesTestJSON-1560722292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:39:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f6bfa5f7-6f90-4724-a65b-fd119e4e3b3e tempest-VolumesServicesTestJSON-1560722292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:39:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f6bfa5f7-6f90-4724-a65b-fd119e4e3b3e tempest-VolumesServicesTestJSON-1560722292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:39:13 devstack sudo[91267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:39:13 devstack sudo[91267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:39:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-f0675977-0a5c-4003-ad54-83fc7347d1b7 req-9d5d84b9-865f-44dc-aa1d-e5d5dc229cca tempest-AttachVolumeNegativeTest-501522069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:39:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-f0675977-0a5c-4003-ad54-83fc7347d1b7 req-9d5d84b9-865f-44dc-aa1d-e5d5dc229cca tempest-AttachVolumeNegativeTest-501522069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:39:14 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[659f5b35-26f9-4297-81ce-bf80850fb5f9]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:39:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-f0675977-0a5c-4003-ad54-83fc7347d1b7 req-9d5d84b9-865f-44dc-aa1d-e5d5dc229cca tempest-AttachVolumeNegativeTest-501522069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-874b2f32-d55a-4c95-a29d-ebb7d0cd4a07 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:39:14 devstack sudo[91278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-874b2f32-d55a-4c95-a29d-ebb7d0cd4a07 Jul 10 06:39:14 devstack sudo[91278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:39:14 devstack sudo[91267]: pam_unix(sudo:session): session closed for user root Jul 10 06:39:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f6bfa5f7-6f90-4724-a65b-fd119e4e3b3e tempest-VolumesServicesTestJSON-1560722292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.049s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:39:14 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-f6bfa5f7-6f90-4724-a65b-fd119e4e3b3e tempest-VolumesServicesTestJSON-1560722292 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:39:14 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-f6bfa5f7-6f90-4724-a65b-fd119e4e3b3e tempest-VolumesServicesTestJSON-1560722292 None] Deleted volume successfully. Jul 10 06:39:14 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f6bfa5f7-6f90-4724-a65b-fd119e4e3b3e tempest-VolumesServicesTestJSON-1560722292 None] Lock "cinder-b561f0c1-fa90-4fa4-83cc-c601e5d89815-delete_volume" released by "delete_volume" :: held 3.041s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:39:15 devstack sudo[91278]: pam_unix(sudo:session): session closed for user root Jul 10 06:39:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-f0675977-0a5c-4003-ad54-83fc7347d1b7 req-9d5d84b9-865f-44dc-aa1d-e5d5dc229cca tempest-AttachVolumeNegativeTest-501522069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-874b2f32-d55a-4c95-a29d-ebb7d0cd4a07" returned: 0 in 1.178s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:39:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-f0675977-0a5c-4003-ad54-83fc7347d1b7 req-9d5d84b9-865f-44dc-aa1d-e5d5dc229cca tempest-AttachVolumeNegativeTest-501522069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.219s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:39:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-f0675977-0a5c-4003-ad54-83fc7347d1b7 req-9d5d84b9-865f-44dc-aa1d-e5d5dc229cca tempest-AttachVolumeNegativeTest-501522069 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804', 'name': 'volume-874b2f32-d55a-4c95-a29d-ebb7d0cd4a07', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1be6a10d-8868-4642-888b-45a7e46f4016', 'enforce_multipath': True} {{(pid=87294) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:39:15 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-f0675977-0a5c-4003-ad54-83fc7347d1b7 req-9d5d84b9-865f-44dc-aa1d-e5d5dc229cca tempest-AttachVolumeNegativeTest-501522069 None] attachment_update completed successfully. Jul 10 06:39:18 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-65cab46a-052d-4b1d-a4b9-5f64d181db4d tempest-ServerActionsTestOtherA-1099006734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:39:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-65cab46a-052d-4b1d-a4b9-5f64d181db4d tempest-ServerActionsTestOtherA-1099006734 None] Flow 'volume_create_manager' (2063fcfc-bcaf-4987-b72b-ed171704046c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:39:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-65cab46a-052d-4b1d-a4b9-5f64d181db4d tempest-ServerActionsTestOtherA-1099006734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bb2374c-84ad-4388-a800-068b8286ec7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:39:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-65cab46a-052d-4b1d-a4b9-5f64d181db4d tempest-ServerActionsTestOtherA-1099006734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bb2374c-84ad-4388-a800-068b8286ec7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:39:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1821325923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43bc3936-47e0-40fb-b661-db6139ea5ad8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef756c653c344c7a4b964213f928f38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:39:18Z,use_quota=True,user_id='cde2120e27074662824910d8608bc9a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:39:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-65cab46a-052d-4b1d-a4b9-5f64d181db4d tempest-ServerActionsTestOtherA-1099006734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e001fc19-c07b-4dce-b348-73985c40fdfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:39:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-65cab46a-052d-4b1d-a4b9-5f64d181db4d tempest-ServerActionsTestOtherA-1099006734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e001fc19-c07b-4dce-b348-73985c40fdfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:39:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-65cab46a-052d-4b1d-a4b9-5f64d181db4d tempest-ServerActionsTestOtherA-1099006734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae417cbb-fb18-4099-b19e-bbbde005fe17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:39:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-65cab46a-052d-4b1d-a4b9-5f64d181db4d tempest-ServerActionsTestOtherA-1099006734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae417cbb-fb18-4099-b19e-bbbde005fe17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43bc3936-47e0-40fb-b661-db6139ea5ad8', 'volume_name': 'volume-43bc3936-47e0-40fb-b661-db6139ea5ad8', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:39:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-65cab46a-052d-4b1d-a4b9-5f64d181db4d tempest-ServerActionsTestOtherA-1099006734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb3b19a9-0dfa-489b-ae48-039fdcdf4478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:39:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-65cab46a-052d-4b1d-a4b9-5f64d181db4d tempest-ServerActionsTestOtherA-1099006734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb3b19a9-0dfa-489b-ae48-039fdcdf4478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:39:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-65cab46a-052d-4b1d-a4b9-5f64d181db4d tempest-ServerActionsTestOtherA-1099006734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33872e76-6a6b-43d3-8683-98ab1e38f9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:39:18 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-65cab46a-052d-4b1d-a4b9-5f64d181db4d tempest-ServerActionsTestOtherA-1099006734 None] Volume 43bc3936-47e0-40fb-b661-db6139ea5ad8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43bc3936-47e0-40fb-b661-db6139ea5ad8', 'volume_size': 1} Jul 10 06:39:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-65cab46a-052d-4b1d-a4b9-5f64d181db4d tempest-ServerActionsTestOtherA-1099006734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:39:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-65cab46a-052d-4b1d-a4b9-5f64d181db4d tempest-ServerActionsTestOtherA-1099006734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:39:18 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-65cab46a-052d-4b1d-a4b9-5f64d181db4d tempest-ServerActionsTestOtherA-1099006734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:39:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1821325923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43bc3936-47e0-40fb-b661-db6139ea5ad8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef756c653c344c7a4b964213f928f38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:39:18Z,use_quota=True,user_id='cde2120e27074662824910d8608bc9a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:39:18 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-65cab46a-052d-4b1d-a4b9-5f64d181db4d tempest-ServerActionsTestOtherA-1099006734 None] Creating volume 43bc3936-47e0-40fb-b661-db6139ea5ad8 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:39:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-65cab46a-052d-4b1d-a4b9-5f64d181db4d tempest-ServerActionsTestOtherA-1099006734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:39:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-65cab46a-052d-4b1d-a4b9-5f64d181db4d tempest-ServerActionsTestOtherA-1099006734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:39:18 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-65cab46a-052d-4b1d-a4b9-5f64d181db4d tempest-ServerActionsTestOtherA-1099006734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:39:18 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-65cab46a-052d-4b1d-a4b9-5f64d181db4d tempest-ServerActionsTestOtherA-1099006734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:39:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-65cab46a-052d-4b1d-a4b9-5f64d181db4d tempest-ServerActionsTestOtherA-1099006734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:39:18 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-65cab46a-052d-4b1d-a4b9-5f64d181db4d tempest-ServerActionsTestOtherA-1099006734 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:39:18 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-65cab46a-052d-4b1d-a4b9-5f64d181db4d tempest-ServerActionsTestOtherA-1099006734 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:39:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-65cab46a-052d-4b1d-a4b9-5f64d181db4d tempest-ServerActionsTestOtherA-1099006734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43bc3936-47e0-40fb-b661-db6139ea5ad8 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:39:18 devstack sudo[91690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43bc3936-47e0-40fb-b661-db6139ea5ad8 1073741824 Jul 10 06:39:18 devstack sudo[91690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:39:19 devstack sudo[91690]: pam_unix(sudo:session): session closed for user root Jul 10 06:39:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-65cab46a-052d-4b1d-a4b9-5f64d181db4d tempest-ServerActionsTestOtherA-1099006734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43bc3936-47e0-40fb-b661-db6139ea5ad8 1073741824" returned: 0 in 1.102s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:39:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-65cab46a-052d-4b1d-a4b9-5f64d181db4d tempest-ServerActionsTestOtherA-1099006734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43bc3936-47e0-40fb-b661-db6139ea5ad8 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:39:19 devstack sudo[91698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43bc3936-47e0-40fb-b661-db6139ea5ad8 Jul 10 06:39:19 devstack sudo[91698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:39:20 devstack sudo[91698]: pam_unix(sudo:session): session closed for user root Jul 10 06:39:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-65cab46a-052d-4b1d-a4b9-5f64d181db4d tempest-ServerActionsTestOtherA-1099006734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43bc3936-47e0-40fb-b661-db6139ea5ad8" returned: 0 in 1.051s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:39:20 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-65cab46a-052d-4b1d-a4b9-5f64d181db4d tempest-ServerActionsTestOtherA-1099006734 None] <== create_volume: return (2214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:39:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-65cab46a-052d-4b1d-a4b9-5f64d181db4d tempest-ServerActionsTestOtherA-1099006734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.222s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:39:20 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-65cab46a-052d-4b1d-a4b9-5f64d181db4d tempest-ServerActionsTestOtherA-1099006734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33872e76-6a6b-43d3-8683-98ab1e38f9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43bc3936-47e0-40fb-b661-db6139ea5ad8', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:39:20 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-65cab46a-052d-4b1d-a4b9-5f64d181db4d tempest-ServerActionsTestOtherA-1099006734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ab2ec5e-5236-4fce-aa93-4baf51d1f11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:39:20 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-65cab46a-052d-4b1d-a4b9-5f64d181db4d tempest-ServerActionsTestOtherA-1099006734 None] Volume volume-43bc3936-47e0-40fb-b661-db6139ea5ad8 (43bc3936-47e0-40fb-b661-db6139ea5ad8): created successfully Jul 10 06:39:20 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-65cab46a-052d-4b1d-a4b9-5f64d181db4d tempest-ServerActionsTestOtherA-1099006734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ab2ec5e-5236-4fce-aa93-4baf51d1f11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:39:20 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-65cab46a-052d-4b1d-a4b9-5f64d181db4d tempest-ServerActionsTestOtherA-1099006734 None] Flow 'volume_create_manager' (2063fcfc-bcaf-4987-b72b-ed171704046c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:39:20 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-65cab46a-052d-4b1d-a4b9-5f64d181db4d tempest-ServerActionsTestOtherA-1099006734 None] Created volume successfully. Jul 10 06:39:21 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:39:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:39:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:39:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:39:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:39:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:39:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:39:21 devstack sudo[91705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:39:21 devstack sudo[91705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:39:22 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-057e08ea-8fa9-472f-83e0-ec71572abe49 req-c20beb40-0b0b-433b-b51d-54cf8c5ea365 tempest-AttachVolumeNegativeTest-501522069 None] Terminate volume connection completed successfully. Jul 10 06:39:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-057e08ea-8fa9-472f-83e0-ec71572abe49 req-c20beb40-0b0b-433b-b51d-54cf8c5ea365 tempest-AttachVolumeNegativeTest-501522069 None] Deleting attachment 1be6a10d-8868-4642-888b-45a7e46f4016. {{(pid=87294) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:39:22 devstack sudo[91705]: pam_unix(sudo:session): session closed for user root Jul 10 06:39:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.073s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:39:22 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:39:22 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager._thread_info {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:39:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread count: 8 {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:39:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread info: [<_MainThread(MainThread, started 139245706264704)>, , , , , , , ] {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:39:25 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-cf4561c9-8b4f-4eb3-8c99-4ae516bba708 req-76e529ed-212e-4a51-a172-e5f0ad6cbb5c tempest-AttachVolumeShelveTestJSON-2071360101 None] No connector for attachment 190905a2-5595-4aa1-a652-52e75e265163; skipping storage backend terminate_connection call. {{(pid=87294) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 10 06:39:25 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-cf4561c9-8b4f-4eb3-8c99-4ae516bba708 req-76e529ed-212e-4a51-a172-e5f0ad6cbb5c tempest-AttachVolumeShelveTestJSON-2071360101 None] Deleting attachment 190905a2-5595-4aa1-a652-52e75e265163. {{(pid=87294) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:39:35 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:SELECT=40,cinder:UPDATE=43,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:39:35 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:UPDATE=44,cinder:SELECT=30,cinder:DELETE=6,cinder:INSERT=11 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:40:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-9a41f77c-bfc4-4e74-9f13-554dc0e873d8 req-5d609455-11e8-4d87-a95e-ce39320a5422 tempest-ServerActionsTestOtherA-1099006734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:40:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-9a41f77c-bfc4-4e74-9f13-554dc0e873d8 req-5d609455-11e8-4d87-a95e-ce39320a5422 tempest-ServerActionsTestOtherA-1099006734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:40:09 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0bacad-7228-4466-bb71-3d5aa3458f8c]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:40:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-9a41f77c-bfc4-4e74-9f13-554dc0e873d8 req-5d609455-11e8-4d87-a95e-ce39320a5422 tempest-ServerActionsTestOtherA-1099006734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43bc3936-47e0-40fb-b661-db6139ea5ad8 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:09 devstack sudo[92179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43bc3936-47e0-40fb-b661-db6139ea5ad8 Jul 10 06:40:09 devstack sudo[92179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:10 devstack sudo[92179]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-9a41f77c-bfc4-4e74-9f13-554dc0e873d8 req-5d609455-11e8-4d87-a95e-ce39320a5422 tempest-ServerActionsTestOtherA-1099006734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43bc3936-47e0-40fb-b661-db6139ea5ad8" returned: 0 in 1.083s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-9a41f77c-bfc4-4e74-9f13-554dc0e873d8 req-5d609455-11e8-4d87-a95e-ce39320a5422 tempest-ServerActionsTestOtherA-1099006734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.112s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:40:10 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-9a41f77c-bfc4-4e74-9f13-554dc0e873d8 req-5d609455-11e8-4d87-a95e-ce39320a5422 tempest-ServerActionsTestOtherA-1099006734 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804', 'name': 'volume-43bc3936-47e0-40fb-b661-db6139ea5ad8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '62f35bea-7f77-4eeb-b6c9-4eab90957f15', 'enforce_multipath': True} {{(pid=87294) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:40:10 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-9a41f77c-bfc4-4e74-9f13-554dc0e873d8 req-5d609455-11e8-4d87-a95e-ce39320a5422 tempest-ServerActionsTestOtherA-1099006734 None] attachment_update completed successfully. Jul 10 06:40:13 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c74d784-8dec-441d-9400-793b4dbc977f tempest-VolumesActionsTest-1821143126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:40:13 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2c74d784-8dec-441d-9400-793b4dbc977f tempest-VolumesActionsTest-1821143126 None] Flow 'volume_create_manager' (013b5933-e443-4e2c-b43f-12ab8a55db4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:40:13 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2c74d784-8dec-441d-9400-793b4dbc977f tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52543813-c20f-428f-9b4a-edf26ebf7aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:13 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2c74d784-8dec-441d-9400-793b4dbc977f tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52543813-c20f-428f-9b4a-edf26ebf7aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1504466119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96278796-57b8-454a-bad6-60a29ea6ab4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62e2bf0336fd45aeba43567326c45034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:40:13Z,use_quota=True,user_id='b6ecd28517cf4cd7b6edc6b576cac046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:13 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2c74d784-8dec-441d-9400-793b4dbc977f tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8587b711-de78-4130-bfc9-4facd06f89a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:13 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2c74d784-8dec-441d-9400-793b4dbc977f tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8587b711-de78-4130-bfc9-4facd06f89a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:13 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2c74d784-8dec-441d-9400-793b4dbc977f tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a31a7348-ffda-473b-9e55-be94502ae27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:13 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2c74d784-8dec-441d-9400-793b4dbc977f tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a31a7348-ffda-473b-9e55-be94502ae27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96278796-57b8-454a-bad6-60a29ea6ab4e', 'volume_name': 'volume-96278796-57b8-454a-bad6-60a29ea6ab4e', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:13 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2c74d784-8dec-441d-9400-793b4dbc977f tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f561c0-adc2-42c3-9032-71fc297f50d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:13 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2c74d784-8dec-441d-9400-793b4dbc977f tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f561c0-adc2-42c3-9032-71fc297f50d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:13 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2c74d784-8dec-441d-9400-793b4dbc977f tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7081fc12-544a-4f8b-a1c5-320f0722f87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:13 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-2c74d784-8dec-441d-9400-793b4dbc977f tempest-VolumesActionsTest-1821143126 None] Volume 96278796-57b8-454a-bad6-60a29ea6ab4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96278796-57b8-454a-bad6-60a29ea6ab4e', 'volume_size': 1} Jul 10 06:40:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2c74d784-8dec-441d-9400-793b4dbc977f tempest-VolumesActionsTest-1821143126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:40:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2c74d784-8dec-441d-9400-793b4dbc977f tempest-VolumesActionsTest-1821143126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:40:13 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-2c74d784-8dec-441d-9400-793b4dbc977f tempest-VolumesActionsTest-1821143126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1504466119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96278796-57b8-454a-bad6-60a29ea6ab4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62e2bf0336fd45aeba43567326c45034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:40:13Z,use_quota=True,user_id='b6ecd28517cf4cd7b6edc6b576cac046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:40:13 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-2c74d784-8dec-441d-9400-793b4dbc977f tempest-VolumesActionsTest-1821143126 None] Creating volume 96278796-57b8-454a-bad6-60a29ea6ab4e {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:40:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2c74d784-8dec-441d-9400-793b4dbc977f tempest-VolumesActionsTest-1821143126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:40:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2c74d784-8dec-441d-9400-793b4dbc977f tempest-VolumesActionsTest-1821143126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:40:13 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-2c74d784-8dec-441d-9400-793b4dbc977f tempest-VolumesActionsTest-1821143126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:40:13 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-2c74d784-8dec-441d-9400-793b4dbc977f tempest-VolumesActionsTest-1821143126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:40:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2c74d784-8dec-441d-9400-793b4dbc977f tempest-VolumesActionsTest-1821143126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:40:13 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-2c74d784-8dec-441d-9400-793b4dbc977f tempest-VolumesActionsTest-1821143126 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:40:13 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-2c74d784-8dec-441d-9400-793b4dbc977f tempest-VolumesActionsTest-1821143126 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:40:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2c74d784-8dec-441d-9400-793b4dbc977f tempest-VolumesActionsTest-1821143126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-96278796-57b8-454a-bad6-60a29ea6ab4e 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:13 devstack sudo[92630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-96278796-57b8-454a-bad6-60a29ea6ab4e 1073741824 Jul 10 06:40:13 devstack sudo[92630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:14 devstack sudo[92630]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2c74d784-8dec-441d-9400-793b4dbc977f tempest-VolumesActionsTest-1821143126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-96278796-57b8-454a-bad6-60a29ea6ab4e 1073741824" returned: 0 in 0.917s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2c74d784-8dec-441d-9400-793b4dbc977f tempest-VolumesActionsTest-1821143126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-96278796-57b8-454a-bad6-60a29ea6ab4e {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:14 devstack sudo[92638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-96278796-57b8-454a-bad6-60a29ea6ab4e Jul 10 06:40:14 devstack sudo[92638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:15 devstack sudo[92638]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2c74d784-8dec-441d-9400-793b4dbc977f tempest-VolumesActionsTest-1821143126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-96278796-57b8-454a-bad6-60a29ea6ab4e" returned: 0 in 0.637s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:15 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-2c74d784-8dec-441d-9400-793b4dbc977f tempest-VolumesActionsTest-1821143126 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:40:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2c74d784-8dec-441d-9400-793b4dbc977f tempest-VolumesActionsTest-1821143126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:40:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2c74d784-8dec-441d-9400-793b4dbc977f tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7081fc12-544a-4f8b-a1c5-320f0722f87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96278796-57b8-454a-bad6-60a29ea6ab4e', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2c74d784-8dec-441d-9400-793b4dbc977f tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba747018-fd7c-45a6-9216-e993309f2c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:15 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-2c74d784-8dec-441d-9400-793b4dbc977f tempest-VolumesActionsTest-1821143126 None] Volume volume-96278796-57b8-454a-bad6-60a29ea6ab4e (96278796-57b8-454a-bad6-60a29ea6ab4e): created successfully Jul 10 06:40:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2c74d784-8dec-441d-9400-793b4dbc977f tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba747018-fd7c-45a6-9216-e993309f2c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2c74d784-8dec-441d-9400-793b4dbc977f tempest-VolumesActionsTest-1821143126 None] Flow 'volume_create_manager' (013b5933-e443-4e2c-b43f-12ab8a55db4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:40:15 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-2c74d784-8dec-441d-9400-793b4dbc977f tempest-VolumesActionsTest-1821143126 None] Created volume successfully. Jul 10 06:40:15 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6ef7546e-3ceb-4f45-9c6e-9d58c79fa54a tempest-VolumesActionsTest-1821143126 None] Acquiring lock "cinder-96278796-57b8-454a-bad6-60a29ea6ab4e" by "attach_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:40:15 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6ef7546e-3ceb-4f45-9c6e-9d58c79fa54a tempest-VolumesActionsTest-1821143126 None] Lock "cinder-96278796-57b8-454a-bad6-60a29ea6ab4e" acquired by "attach_volume" :: waited 0.019s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:40:15 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-6ef7546e-3ceb-4f45-9c6e-9d58c79fa54a tempest-VolumesActionsTest-1821143126 None] Attaching volume 96278796-57b8-454a-bad6-60a29ea6ab4e to instance 2ea33aaa-6454-4967-8205-5708f3951302 at mountpoint /dev/vdb on host None. Jul 10 06:40:15 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-6ef7546e-3ceb-4f45-9c6e-9d58c79fa54a tempest-VolumesActionsTest-1821143126 None] Attach volume completed successfully. Jul 10 06:40:15 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6ef7546e-3ceb-4f45-9c6e-9d58c79fa54a tempest-VolumesActionsTest-1821143126 None] Lock "cinder-96278796-57b8-454a-bad6-60a29ea6ab4e" released by "attach_volume" :: held 0.111s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:40:16 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-9927b8a8-2831-4eb1-970b-bb02db23553d tempest-VolumesActionsTest-683082422 None] Terminate volume connection completed successfully. Jul 10 06:40:17 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-9927b8a8-2831-4eb1-970b-bb02db23553d tempest-VolumesActionsTest-683082422 None] Acquiring lock "cinder-96278796-57b8-454a-bad6-60a29ea6ab4e-detach_volume" by "detach_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:40:17 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-9927b8a8-2831-4eb1-970b-bb02db23553d tempest-VolumesActionsTest-683082422 None] Lock "cinder-96278796-57b8-454a-bad6-60a29ea6ab4e-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:40:17 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-9927b8a8-2831-4eb1-970b-bb02db23553d tempest-VolumesActionsTest-683082422 None] Detaching volume 96278796-57b8-454a-bad6-60a29ea6ab4e from instance 2ea33aaa-6454-4967-8205-5708f3951302. Jul 10 06:40:17 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-9927b8a8-2831-4eb1-970b-bb02db23553d tempest-VolumesActionsTest-683082422 None] Detach volume completed successfully. Jul 10 06:40:17 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-9927b8a8-2831-4eb1-970b-bb02db23553d tempest-VolumesActionsTest-683082422 None] Lock "cinder-96278796-57b8-454a-bad6-60a29ea6ab4e-detach_volume" released by "detach_volume" :: held 0.071s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:40:17 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e64d9e38-4400-432f-b5be-6a732d3d90a2 tempest-VolumesActionsTest-1821143126 None] Acquiring lock "cinder-96278796-57b8-454a-bad6-60a29ea6ab4e-detach_volume" by "detach_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:40:17 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e64d9e38-4400-432f-b5be-6a732d3d90a2 tempest-VolumesActionsTest-1821143126 None] Lock "cinder-96278796-57b8-454a-bad6-60a29ea6ab4e-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:40:17 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-e64d9e38-4400-432f-b5be-6a732d3d90a2 tempest-VolumesActionsTest-1821143126 None] Volume detach called, but volume not attached. Jul 10 06:40:17 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e64d9e38-4400-432f-b5be-6a732d3d90a2 tempest-VolumesActionsTest-1821143126 None] Lock "cinder-96278796-57b8-454a-bad6-60a29ea6ab4e-detach_volume" released by "detach_volume" :: held 0.028s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:40:18 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-38a585e5-66bd-425e-b588-3abd9d26581b tempest-VolumesActionsTest-1821143126 None] Acquiring lock "cinder-96278796-57b8-454a-bad6-60a29ea6ab4e-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:40:18 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-38a585e5-66bd-425e-b588-3abd9d26581b tempest-VolumesActionsTest-1821143126 None] Lock "cinder-96278796-57b8-454a-bad6-60a29ea6ab4e-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:40:18 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-38a585e5-66bd-425e-b588-3abd9d26581b tempest-VolumesActionsTest-1821143126 None] Acquiring lock "cinder-quobyte-96278796-57b8-454a-bad6-60a29ea6ab4e" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:40:18 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-38a585e5-66bd-425e-b588-3abd9d26581b tempest-VolumesActionsTest-1821143126 None] Lock "cinder-quobyte-96278796-57b8-454a-bad6-60a29ea6ab4e" acquired by "delete_volume" :: waited 0.023s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:40:18 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[da52581b-d2ce-4fa8-82d1-a2268338e93e]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:40:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-38a585e5-66bd-425e-b588-3abd9d26581b tempest-VolumesActionsTest-1821143126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-96278796-57b8-454a-bad6-60a29ea6ab4e {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:19 devstack sudo[92699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-96278796-57b8-454a-bad6-60a29ea6ab4e Jul 10 06:40:19 devstack sudo[92699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:19 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-79ac1aae-8e1c-4f49-9043-a3cb91a77225 req-732e0a0c-f502-4d84-ad5e-88d97205330c tempest-ServerActionsTestOtherA-1099006734 None] Terminate volume connection completed successfully. Jul 10 06:40:19 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-79ac1aae-8e1c-4f49-9043-a3cb91a77225 req-732e0a0c-f502-4d84-ad5e-88d97205330c tempest-ServerActionsTestOtherA-1099006734 None] Deleting attachment 62f35bea-7f77-4eeb-b6c9-4eab90957f15. {{(pid=87294) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:40:19 devstack sudo[92699]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-38a585e5-66bd-425e-b588-3abd9d26581b tempest-VolumesActionsTest-1821143126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-96278796-57b8-454a-bad6-60a29ea6ab4e" returned: 0 in 1.110s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-38a585e5-66bd-425e-b588-3abd9d26581b tempest-VolumesActionsTest-1821143126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-96278796-57b8-454a-bad6-60a29ea6ab4e {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:19 devstack sudo[92734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-96278796-57b8-454a-bad6-60a29ea6ab4e Jul 10 06:40:19 devstack sudo[92734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:20 devstack sudo[92734]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-38a585e5-66bd-425e-b588-3abd9d26581b tempest-VolumesActionsTest-1821143126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-96278796-57b8-454a-bad6-60a29ea6ab4e" returned: 0 in 0.710s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:20 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-38a585e5-66bd-425e-b588-3abd9d26581b tempest-VolumesActionsTest-1821143126 None] Lock "cinder-quobyte-96278796-57b8-454a-bad6-60a29ea6ab4e" released by "delete_volume" :: held 1.892s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:40:20 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-38a585e5-66bd-425e-b588-3abd9d26581b tempest-VolumesActionsTest-1821143126 None] Created reservations ['f69909ef-6669-4a52-ae25-bda9d0dff8eb', '3df468f5-2e7f-4fb0-aeec-74ebde8348e1', '4216fa23-5481-433f-969a-ab8cb994f22a', '38c55b34-befc-42a9-b7d5-c7c5e3e1029b'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:40:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-38a585e5-66bd-425e-b588-3abd9d26581b tempest-VolumesActionsTest-1821143126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:40:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-38a585e5-66bd-425e-b588-3abd9d26581b tempest-VolumesActionsTest-1821143126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:40:20 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-38a585e5-66bd-425e-b588-3abd9d26581b tempest-VolumesActionsTest-1821143126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:40:20 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-38a585e5-66bd-425e-b588-3abd9d26581b tempest-VolumesActionsTest-1821143126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:40:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-38a585e5-66bd-425e-b588-3abd9d26581b tempest-VolumesActionsTest-1821143126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:40:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-38a585e5-66bd-425e-b588-3abd9d26581b tempest-VolumesActionsTest-1821143126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:21 devstack sudo[92747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:40:21 devstack sudo[92747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:21 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:40:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:40:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:40:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:40:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:40:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:40:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:21 devstack sudo[92759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:40:21 devstack sudo[92759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:22 devstack sudo[92747]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-38a585e5-66bd-425e-b588-3abd9d26581b tempest-VolumesActionsTest-1821143126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.380s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:22 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-38a585e5-66bd-425e-b588-3abd9d26581b tempest-VolumesActionsTest-1821143126 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:40:22 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-38a585e5-66bd-425e-b588-3abd9d26581b tempest-VolumesActionsTest-1821143126 None] Deleted volume successfully. Jul 10 06:40:22 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-38a585e5-66bd-425e-b588-3abd9d26581b tempest-VolumesActionsTest-1821143126 None] Lock "cinder-96278796-57b8-454a-bad6-60a29ea6ab4e-delete_volume" released by "delete_volume" :: held 3.664s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:40:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-79ac1aae-8e1c-4f49-9043-a3cb91a77225 req-5f42e8f4-8bc9-44ed-b7fa-18c6c3b74da3 tempest-ServerActionsTestOtherA-1099006734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:40:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-79ac1aae-8e1c-4f49-9043-a3cb91a77225 req-5f42e8f4-8bc9-44ed-b7fa-18c6c3b74da3 tempest-ServerActionsTestOtherA-1099006734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:40:22 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3431244-ca1f-4309-95e2-de80b3a40be7]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:40:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-79ac1aae-8e1c-4f49-9043-a3cb91a77225 req-5f42e8f4-8bc9-44ed-b7fa-18c6c3b74da3 tempest-ServerActionsTestOtherA-1099006734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43bc3936-47e0-40fb-b661-db6139ea5ad8 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:22 devstack sudo[92771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43bc3936-47e0-40fb-b661-db6139ea5ad8 Jul 10 06:40:22 devstack sudo[92771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:22 devstack sudo[92759]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.952s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:22 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:40:22 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager._thread_info {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:40:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread count: 8 {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:40:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread info: [<_MainThread(MainThread, started 139245706264704)>, , , , , , , ] {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:40:23 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-eab5766e-edf9-4925-97d1-52bf7126049a tempest-AttachVolumeNegativeTest-501522069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:40:23 devstack sudo[92771]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-eab5766e-edf9-4925-97d1-52bf7126049a tempest-AttachVolumeNegativeTest-501522069 None] Flow 'volume_create_manager' (dccf2347-ddcd-4894-96af-a754c2c8fb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:40:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-eab5766e-edf9-4925-97d1-52bf7126049a tempest-AttachVolumeNegativeTest-501522069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb7309ae-209e-4fec-b341-bc10d2d0547b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-79ac1aae-8e1c-4f49-9043-a3cb91a77225 req-5f42e8f4-8bc9-44ed-b7fa-18c6c3b74da3 tempest-ServerActionsTestOtherA-1099006734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43bc3936-47e0-40fb-b661-db6139ea5ad8" returned: 0 in 1.092s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-79ac1aae-8e1c-4f49-9043-a3cb91a77225 req-5f42e8f4-8bc9-44ed-b7fa-18c6c3b74da3 tempest-ServerActionsTestOtherA-1099006734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.106s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:40:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-eab5766e-edf9-4925-97d1-52bf7126049a tempest-AttachVolumeNegativeTest-501522069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb7309ae-209e-4fec-b341-bc10d2d0547b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:40:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-973557362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8956953-15fd-4725-943e-b270ec55b75b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d67c175cc144f4dbe428efa469dea02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:40:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:40:23Z,use_quota=True,user_id='ac6666bc6cf64f2880f353064ab98213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-eab5766e-edf9-4925-97d1-52bf7126049a tempest-AttachVolumeNegativeTest-501522069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4816e0a9-619d-4dad-9165-422a07fe87d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-eab5766e-edf9-4925-97d1-52bf7126049a tempest-AttachVolumeNegativeTest-501522069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4816e0a9-619d-4dad-9165-422a07fe87d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-eab5766e-edf9-4925-97d1-52bf7126049a tempest-AttachVolumeNegativeTest-501522069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8c1d972-fc7a-4a3d-ab90-ee017c32eebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-eab5766e-edf9-4925-97d1-52bf7126049a tempest-AttachVolumeNegativeTest-501522069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8c1d972-fc7a-4a3d-ab90-ee017c32eebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8956953-15fd-4725-943e-b270ec55b75b', 'volume_name': 'volume-c8956953-15fd-4725-943e-b270ec55b75b', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-eab5766e-edf9-4925-97d1-52bf7126049a tempest-AttachVolumeNegativeTest-501522069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b6717ab-9a50-4734-b63a-d3f3a3576794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-eab5766e-edf9-4925-97d1-52bf7126049a tempest-AttachVolumeNegativeTest-501522069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b6717ab-9a50-4734-b63a-d3f3a3576794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-eab5766e-edf9-4925-97d1-52bf7126049a tempest-AttachVolumeNegativeTest-501522069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e8f4dbd-ef17-4a8a-9f76-7b98d3cd11c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:23 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-eab5766e-edf9-4925-97d1-52bf7126049a tempest-AttachVolumeNegativeTest-501522069 None] Volume c8956953-15fd-4725-943e-b270ec55b75b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8956953-15fd-4725-943e-b270ec55b75b', 'volume_size': 1} Jul 10 06:40:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-eab5766e-edf9-4925-97d1-52bf7126049a tempest-AttachVolumeNegativeTest-501522069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:40:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-eab5766e-edf9-4925-97d1-52bf7126049a tempest-AttachVolumeNegativeTest-501522069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:40:23 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-eab5766e-edf9-4925-97d1-52bf7126049a tempest-AttachVolumeNegativeTest-501522069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:40:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-973557362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8956953-15fd-4725-943e-b270ec55b75b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d67c175cc144f4dbe428efa469dea02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:40:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:40:23Z,use_quota=True,user_id='ac6666bc6cf64f2880f353064ab98213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:40:23 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-eab5766e-edf9-4925-97d1-52bf7126049a tempest-AttachVolumeNegativeTest-501522069 None] Creating volume c8956953-15fd-4725-943e-b270ec55b75b {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:40:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-eab5766e-edf9-4925-97d1-52bf7126049a tempest-AttachVolumeNegativeTest-501522069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:40:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-eab5766e-edf9-4925-97d1-52bf7126049a tempest-AttachVolumeNegativeTest-501522069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:40:23 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-eab5766e-edf9-4925-97d1-52bf7126049a tempest-AttachVolumeNegativeTest-501522069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:40:23 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-eab5766e-edf9-4925-97d1-52bf7126049a tempest-AttachVolumeNegativeTest-501522069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:40:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-eab5766e-edf9-4925-97d1-52bf7126049a tempest-AttachVolumeNegativeTest-501522069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:40:23 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-eab5766e-edf9-4925-97d1-52bf7126049a tempest-AttachVolumeNegativeTest-501522069 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:40:23 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-eab5766e-edf9-4925-97d1-52bf7126049a tempest-AttachVolumeNegativeTest-501522069 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:40:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-eab5766e-edf9-4925-97d1-52bf7126049a tempest-AttachVolumeNegativeTest-501522069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c8956953-15fd-4725-943e-b270ec55b75b 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:23 devstack sudo[92798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c8956953-15fd-4725-943e-b270ec55b75b 1073741824 Jul 10 06:40:23 devstack sudo[92798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-79ac1aae-8e1c-4f49-9043-a3cb91a77225 req-5f42e8f4-8bc9-44ed-b7fa-18c6c3b74da3 tempest-ServerActionsTestOtherA-1099006734 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804', 'name': 'volume-43bc3936-47e0-40fb-b661-db6139ea5ad8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '76d935f4-d74c-4541-ae9f-fcdca57cbb8f', 'enforce_multipath': True} {{(pid=87294) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:40:23 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-79ac1aae-8e1c-4f49-9043-a3cb91a77225 req-5f42e8f4-8bc9-44ed-b7fa-18c6c3b74da3 tempest-ServerActionsTestOtherA-1099006734 None] attachment_update completed successfully. Jul 10 06:40:24 devstack sudo[92798]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-eab5766e-edf9-4925-97d1-52bf7126049a tempest-AttachVolumeNegativeTest-501522069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c8956953-15fd-4725-943e-b270ec55b75b 1073741824" returned: 0 in 1.061s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-eab5766e-edf9-4925-97d1-52bf7126049a tempest-AttachVolumeNegativeTest-501522069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c8956953-15fd-4725-943e-b270ec55b75b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:24 devstack sudo[92807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c8956953-15fd-4725-943e-b270ec55b75b Jul 10 06:40:24 devstack sudo[92807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:25 devstack sudo[92807]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-eab5766e-edf9-4925-97d1-52bf7126049a tempest-AttachVolumeNegativeTest-501522069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c8956953-15fd-4725-943e-b270ec55b75b" returned: 0 in 0.675s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:25 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-eab5766e-edf9-4925-97d1-52bf7126049a tempest-AttachVolumeNegativeTest-501522069 None] <== create_volume: return (1776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:40:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-eab5766e-edf9-4925-97d1-52bf7126049a tempest-AttachVolumeNegativeTest-501522069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.778s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:40:25 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-eab5766e-edf9-4925-97d1-52bf7126049a tempest-AttachVolumeNegativeTest-501522069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e8f4dbd-ef17-4a8a-9f76-7b98d3cd11c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8956953-15fd-4725-943e-b270ec55b75b', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:25 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-eab5766e-edf9-4925-97d1-52bf7126049a tempest-AttachVolumeNegativeTest-501522069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8369e5f-d9c3-49bc-870f-0da7455d0181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:25 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-eab5766e-edf9-4925-97d1-52bf7126049a tempest-AttachVolumeNegativeTest-501522069 None] Volume volume-c8956953-15fd-4725-943e-b270ec55b75b (c8956953-15fd-4725-943e-b270ec55b75b): created successfully Jul 10 06:40:25 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-eab5766e-edf9-4925-97d1-52bf7126049a tempest-AttachVolumeNegativeTest-501522069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8369e5f-d9c3-49bc-870f-0da7455d0181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:25 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-eab5766e-edf9-4925-97d1-52bf7126049a tempest-AttachVolumeNegativeTest-501522069 None] Flow 'volume_create_manager' (dccf2347-ddcd-4894-96af-a754c2c8fb5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:40:25 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-eab5766e-edf9-4925-97d1-52bf7126049a tempest-AttachVolumeNegativeTest-501522069 None] Created volume successfully. Jul 10 06:40:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-0cd2cce4-8499-4fbc-b7d5-389ace9442be req-f1a3d8b3-5e43-4304-9e80-5c7fe2d87521 tempest-AttachVolumeNegativeTest-501522069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:40:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-0cd2cce4-8499-4fbc-b7d5-389ace9442be req-f1a3d8b3-5e43-4304-9e80-5c7fe2d87521 tempest-AttachVolumeNegativeTest-501522069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:40:28 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8f112db-ef7f-4526-96b2-c6378e188cc1 tempest-VolumesActionsTest-1821143126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:40:28 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a8f112db-ef7f-4526-96b2-c6378e188cc1 tempest-VolumesActionsTest-1821143126 None] Flow 'volume_create_manager' (bc5810ba-ebd4-48a5-bbb7-665ac77da00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:40:28 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a8f112db-ef7f-4526-96b2-c6378e188cc1 tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9282508e-634d-4e9f-aa2b-f681f2e73481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:28 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1dbad4-9c41-4eb7-88a6-0979d1e5d35a]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:40:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-0cd2cce4-8499-4fbc-b7d5-389ace9442be req-f1a3d8b3-5e43-4304-9e80-5c7fe2d87521 tempest-AttachVolumeNegativeTest-501522069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c8956953-15fd-4725-943e-b270ec55b75b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:28 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a8f112db-ef7f-4526-96b2-c6378e188cc1 tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9282508e-634d-4e9f-aa2b-f681f2e73481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-640899200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ef88e10-46e7-4a6d-9217-1908c9e4202d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62e2bf0336fd45aeba43567326c45034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:40:29Z,use_quota=True,user_id='b6ecd28517cf4cd7b6edc6b576cac046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:28 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a8f112db-ef7f-4526-96b2-c6378e188cc1 tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0fa1bdf-6c59-4674-9f1b-de964c5dd152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:28 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a8f112db-ef7f-4526-96b2-c6378e188cc1 tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0fa1bdf-6c59-4674-9f1b-de964c5dd152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:28 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a8f112db-ef7f-4526-96b2-c6378e188cc1 tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d7cc58f-33e8-43d6-a5cf-e35fccef3512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:28 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a8f112db-ef7f-4526-96b2-c6378e188cc1 tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d7cc58f-33e8-43d6-a5cf-e35fccef3512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ef88e10-46e7-4a6d-9217-1908c9e4202d', 'volume_name': 'volume-6ef88e10-46e7-4a6d-9217-1908c9e4202d', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:28 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a8f112db-ef7f-4526-96b2-c6378e188cc1 tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21b08469-ddf8-4934-b5d3-443e18af81a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:28 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a8f112db-ef7f-4526-96b2-c6378e188cc1 tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21b08469-ddf8-4934-b5d3-443e18af81a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:28 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a8f112db-ef7f-4526-96b2-c6378e188cc1 tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76b8008a-65bb-4ea0-9362-07a950adf5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:28 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-a8f112db-ef7f-4526-96b2-c6378e188cc1 tempest-VolumesActionsTest-1821143126 None] Volume 6ef88e10-46e7-4a6d-9217-1908c9e4202d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ef88e10-46e7-4a6d-9217-1908c9e4202d', 'volume_size': 1} Jul 10 06:40:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a8f112db-ef7f-4526-96b2-c6378e188cc1 tempest-VolumesActionsTest-1821143126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:40:28 devstack sudo[92926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c8956953-15fd-4725-943e-b270ec55b75b Jul 10 06:40:28 devstack sudo[92926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:29 devstack sudo[92926]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-0cd2cce4-8499-4fbc-b7d5-389ace9442be req-f1a3d8b3-5e43-4304-9e80-5c7fe2d87521 tempest-AttachVolumeNegativeTest-501522069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c8956953-15fd-4725-943e-b270ec55b75b" returned: 0 in 0.778s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-0cd2cce4-8499-4fbc-b7d5-389ace9442be req-f1a3d8b3-5e43-4304-9e80-5c7fe2d87521 tempest-AttachVolumeNegativeTest-501522069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.814s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:40:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a8f112db-ef7f-4526-96b2-c6378e188cc1 tempest-VolumesActionsTest-1821143126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.724s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:40:29 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-a8f112db-ef7f-4526-96b2-c6378e188cc1 tempest-VolumesActionsTest-1821143126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-640899200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ef88e10-46e7-4a6d-9217-1908c9e4202d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62e2bf0336fd45aeba43567326c45034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:40:29Z,use_quota=True,user_id='b6ecd28517cf4cd7b6edc6b576cac046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:40:29 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-a8f112db-ef7f-4526-96b2-c6378e188cc1 tempest-VolumesActionsTest-1821143126 None] Creating volume 6ef88e10-46e7-4a6d-9217-1908c9e4202d {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:40:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a8f112db-ef7f-4526-96b2-c6378e188cc1 tempest-VolumesActionsTest-1821143126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:40:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a8f112db-ef7f-4526-96b2-c6378e188cc1 tempest-VolumesActionsTest-1821143126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:40:29 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-a8f112db-ef7f-4526-96b2-c6378e188cc1 tempest-VolumesActionsTest-1821143126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:40:29 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-a8f112db-ef7f-4526-96b2-c6378e188cc1 tempest-VolumesActionsTest-1821143126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:40:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a8f112db-ef7f-4526-96b2-c6378e188cc1 tempest-VolumesActionsTest-1821143126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:40:29 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-a8f112db-ef7f-4526-96b2-c6378e188cc1 tempest-VolumesActionsTest-1821143126 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:40:29 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-a8f112db-ef7f-4526-96b2-c6378e188cc1 tempest-VolumesActionsTest-1821143126 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:40:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a8f112db-ef7f-4526-96b2-c6378e188cc1 tempest-VolumesActionsTest-1821143126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6ef88e10-46e7-4a6d-9217-1908c9e4202d 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:29 devstack sudo[93266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6ef88e10-46e7-4a6d-9217-1908c9e4202d 1073741824 Jul 10 06:40:29 devstack sudo[93266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:29 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-0cd2cce4-8499-4fbc-b7d5-389ace9442be req-f1a3d8b3-5e43-4304-9e80-5c7fe2d87521 tempest-AttachVolumeNegativeTest-501522069 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804', 'name': 'volume-c8956953-15fd-4725-943e-b270ec55b75b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '780fcf3a-d856-4394-8583-5f15e9612365', 'enforce_multipath': True} {{(pid=87294) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:40:29 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-0cd2cce4-8499-4fbc-b7d5-389ace9442be req-f1a3d8b3-5e43-4304-9e80-5c7fe2d87521 tempest-AttachVolumeNegativeTest-501522069 None] attachment_update completed successfully. Jul 10 06:40:30 devstack sudo[93266]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a8f112db-ef7f-4526-96b2-c6378e188cc1 tempest-VolumesActionsTest-1821143126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6ef88e10-46e7-4a6d-9217-1908c9e4202d 1073741824" returned: 0 in 0.978s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a8f112db-ef7f-4526-96b2-c6378e188cc1 tempest-VolumesActionsTest-1821143126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6ef88e10-46e7-4a6d-9217-1908c9e4202d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:30 devstack sudo[93282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6ef88e10-46e7-4a6d-9217-1908c9e4202d Jul 10 06:40:30 devstack sudo[93282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:31 devstack sudo[93282]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a8f112db-ef7f-4526-96b2-c6378e188cc1 tempest-VolumesActionsTest-1821143126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6ef88e10-46e7-4a6d-9217-1908c9e4202d" returned: 0 in 0.702s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:31 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-a8f112db-ef7f-4526-96b2-c6378e188cc1 tempest-VolumesActionsTest-1821143126 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:40:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a8f112db-ef7f-4526-96b2-c6378e188cc1 tempest-VolumesActionsTest-1821143126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.729s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:40:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a8f112db-ef7f-4526-96b2-c6378e188cc1 tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76b8008a-65bb-4ea0-9362-07a950adf5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ef88e10-46e7-4a6d-9217-1908c9e4202d', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a8f112db-ef7f-4526-96b2-c6378e188cc1 tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7f76d1b-d01f-42ca-859e-20463ee11d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:31 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-a8f112db-ef7f-4526-96b2-c6378e188cc1 tempest-VolumesActionsTest-1821143126 None] Volume volume-6ef88e10-46e7-4a6d-9217-1908c9e4202d (6ef88e10-46e7-4a6d-9217-1908c9e4202d): created successfully Jul 10 06:40:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a8f112db-ef7f-4526-96b2-c6378e188cc1 tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7f76d1b-d01f-42ca-859e-20463ee11d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a8f112db-ef7f-4526-96b2-c6378e188cc1 tempest-VolumesActionsTest-1821143126 None] Flow 'volume_create_manager' (bc5810ba-ebd4-48a5-bbb7-665ac77da00b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:40:31 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-a8f112db-ef7f-4526-96b2-c6378e188cc1 tempest-VolumesActionsTest-1821143126 None] Created volume successfully. Jul 10 06:40:32 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-805594e0-dea2-46c1-b960-9e7cae7bb610 tempest-VolumesActionsTest-683082422 None] Acquiring lock "cinder-6ef88e10-46e7-4a6d-9217-1908c9e4202d-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:40:32 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-805594e0-dea2-46c1-b960-9e7cae7bb610 tempest-VolumesActionsTest-683082422 None] Lock "cinder-6ef88e10-46e7-4a6d-9217-1908c9e4202d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:40:32 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-805594e0-dea2-46c1-b960-9e7cae7bb610 tempest-VolumesActionsTest-683082422 None] Acquiring lock "cinder-quobyte-6ef88e10-46e7-4a6d-9217-1908c9e4202d" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:40:32 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-805594e0-dea2-46c1-b960-9e7cae7bb610 tempest-VolumesActionsTest-683082422 None] Lock "cinder-quobyte-6ef88e10-46e7-4a6d-9217-1908c9e4202d" acquired by "delete_volume" :: waited 0.021s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:40:32 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[490cc9b6-448a-4dd6-a66d-fa5ace0a00a9]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:40:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-805594e0-dea2-46c1-b960-9e7cae7bb610 tempest-VolumesActionsTest-683082422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6ef88e10-46e7-4a6d-9217-1908c9e4202d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:32 devstack sudo[93288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6ef88e10-46e7-4a6d-9217-1908c9e4202d Jul 10 06:40:32 devstack sudo[93288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:33 devstack sudo[93288]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-805594e0-dea2-46c1-b960-9e7cae7bb610 tempest-VolumesActionsTest-683082422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6ef88e10-46e7-4a6d-9217-1908c9e4202d" returned: 0 in 0.942s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-805594e0-dea2-46c1-b960-9e7cae7bb610 tempest-VolumesActionsTest-683082422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6ef88e10-46e7-4a6d-9217-1908c9e4202d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:33 devstack sudo[93299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6ef88e10-46e7-4a6d-9217-1908c9e4202d Jul 10 06:40:33 devstack sudo[93299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:34 devstack sudo[93299]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-805594e0-dea2-46c1-b960-9e7cae7bb610 tempest-VolumesActionsTest-683082422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6ef88e10-46e7-4a6d-9217-1908c9e4202d" returned: 0 in 0.859s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:34 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-805594e0-dea2-46c1-b960-9e7cae7bb610 tempest-VolumesActionsTest-683082422 None] Lock "cinder-quobyte-6ef88e10-46e7-4a6d-9217-1908c9e4202d" released by "delete_volume" :: held 1.864s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:40:34 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-805594e0-dea2-46c1-b960-9e7cae7bb610 tempest-VolumesActionsTest-683082422 None] Created reservations ['acfd153e-48ec-4991-a574-cc0ee3f9e45b', 'eb9e2d5a-7eed-4290-8bba-10a81566c722', '1f818710-42df-4bc5-befd-4c0bba2b6d23', '616c8723-de58-49f9-989f-5ad0b2e880d2'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:40:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-805594e0-dea2-46c1-b960-9e7cae7bb610 tempest-VolumesActionsTest-683082422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:40:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-805594e0-dea2-46c1-b960-9e7cae7bb610 tempest-VolumesActionsTest-683082422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:40:34 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-805594e0-dea2-46c1-b960-9e7cae7bb610 tempest-VolumesActionsTest-683082422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:40:34 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-805594e0-dea2-46c1-b960-9e7cae7bb610 tempest-VolumesActionsTest-683082422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:40:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-805594e0-dea2-46c1-b960-9e7cae7bb610 tempest-VolumesActionsTest-683082422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:40:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-805594e0-dea2-46c1-b960-9e7cae7bb610 tempest-VolumesActionsTest-683082422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:34 devstack sudo[93317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:40:34 devstack sudo[93317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:35 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c4ed0a6-0521-4ea5-bc7f-1ec62068fb6a tempest-VolumesActionsTest-1821143126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:40:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0c4ed0a6-0521-4ea5-bc7f-1ec62068fb6a tempest-VolumesActionsTest-1821143126 None] Flow 'volume_create_manager' (2bce6f57-e83b-4281-ac82-d8286547f787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:40:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0c4ed0a6-0521-4ea5-bc7f-1ec62068fb6a tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbedd2fc-16c4-4d78-a545-aef46fd90ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0c4ed0a6-0521-4ea5-bc7f-1ec62068fb6a tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbedd2fc-16c4-4d78-a545-aef46fd90ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1888034764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9484db0b-ca1e-408b-a68d-d23872ccb638,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62e2bf0336fd45aeba43567326c45034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:40:35Z,use_quota=True,user_id='b6ecd28517cf4cd7b6edc6b576cac046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0c4ed0a6-0521-4ea5-bc7f-1ec62068fb6a tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5fc069a-765f-4949-92ca-77d02dd20432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0c4ed0a6-0521-4ea5-bc7f-1ec62068fb6a tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5fc069a-765f-4949-92ca-77d02dd20432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:35 devstack sudo[93317]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0c4ed0a6-0521-4ea5-bc7f-1ec62068fb6a tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (187b3d8c-07d6-41a5-bd51-6fe071ba1bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0c4ed0a6-0521-4ea5-bc7f-1ec62068fb6a tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (187b3d8c-07d6-41a5-bd51-6fe071ba1bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9484db0b-ca1e-408b-a68d-d23872ccb638', 'volume_name': 'volume-9484db0b-ca1e-408b-a68d-d23872ccb638', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0c4ed0a6-0521-4ea5-bc7f-1ec62068fb6a tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22ccfbc0-5cac-43fa-95e0-22dc39f9d754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0c4ed0a6-0521-4ea5-bc7f-1ec62068fb6a tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22ccfbc0-5cac-43fa-95e0-22dc39f9d754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0c4ed0a6-0521-4ea5-bc7f-1ec62068fb6a tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab854cdd-4983-49df-b6e5-681e09c9babf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:35 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-0c4ed0a6-0521-4ea5-bc7f-1ec62068fb6a tempest-VolumesActionsTest-1821143126 None] Volume 9484db0b-ca1e-408b-a68d-d23872ccb638: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9484db0b-ca1e-408b-a68d-d23872ccb638', 'volume_size': 1} Jul 10 06:40:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-0c4ed0a6-0521-4ea5-bc7f-1ec62068fb6a tempest-VolumesActionsTest-1821143126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:40:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-0c4ed0a6-0521-4ea5-bc7f-1ec62068fb6a tempest-VolumesActionsTest-1821143126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:40:35 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-0c4ed0a6-0521-4ea5-bc7f-1ec62068fb6a tempest-VolumesActionsTest-1821143126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1888034764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9484db0b-ca1e-408b-a68d-d23872ccb638,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62e2bf0336fd45aeba43567326c45034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:40:35Z,use_quota=True,user_id='b6ecd28517cf4cd7b6edc6b576cac046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:40:35 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-0c4ed0a6-0521-4ea5-bc7f-1ec62068fb6a tempest-VolumesActionsTest-1821143126 None] Creating volume 9484db0b-ca1e-408b-a68d-d23872ccb638 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:40:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-0c4ed0a6-0521-4ea5-bc7f-1ec62068fb6a tempest-VolumesActionsTest-1821143126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:40:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-0c4ed0a6-0521-4ea5-bc7f-1ec62068fb6a tempest-VolumesActionsTest-1821143126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:40:35 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-0c4ed0a6-0521-4ea5-bc7f-1ec62068fb6a tempest-VolumesActionsTest-1821143126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:40:35 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-0c4ed0a6-0521-4ea5-bc7f-1ec62068fb6a tempest-VolumesActionsTest-1821143126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:40:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-0c4ed0a6-0521-4ea5-bc7f-1ec62068fb6a tempest-VolumesActionsTest-1821143126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:40:35 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-0c4ed0a6-0521-4ea5-bc7f-1ec62068fb6a tempest-VolumesActionsTest-1821143126 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:40:35 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-0c4ed0a6-0521-4ea5-bc7f-1ec62068fb6a tempest-VolumesActionsTest-1821143126 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:40:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0c4ed0a6-0521-4ea5-bc7f-1ec62068fb6a tempest-VolumesActionsTest-1821143126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9484db0b-ca1e-408b-a68d-d23872ccb638 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-805594e0-dea2-46c1-b960-9e7cae7bb610 tempest-VolumesActionsTest-683082422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.130s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:35 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-805594e0-dea2-46c1-b960-9e7cae7bb610 tempest-VolumesActionsTest-683082422 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:40:35 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-805594e0-dea2-46c1-b960-9e7cae7bb610 tempest-VolumesActionsTest-683082422 None] Deleted volume successfully. Jul 10 06:40:35 devstack sudo[93323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9484db0b-ca1e-408b-a68d-d23872ccb638 1073741824 Jul 10 06:40:35 devstack sudo[93323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:35 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-805594e0-dea2-46c1-b960-9e7cae7bb610 tempest-VolumesActionsTest-683082422 None] Lock "cinder-6ef88e10-46e7-4a6d-9217-1908c9e4202d-delete_volume" released by "delete_volume" :: held 3.285s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:40:36 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-c8a88999-4af3-476b-a795-42a2bf42e57d req-b89b396a-fca4-410c-99db-4e44001074ce tempest-AttachVolumeNegativeTest-501522069 None] Terminate volume connection completed successfully. Jul 10 06:40:36 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-c8a88999-4af3-476b-a795-42a2bf42e57d req-b89b396a-fca4-410c-99db-4e44001074ce tempest-AttachVolumeNegativeTest-501522069 None] Deleting attachment 780fcf3a-d856-4394-8583-5f15e9612365. {{(pid=87294) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:40:36 devstack sudo[93323]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0c4ed0a6-0521-4ea5-bc7f-1ec62068fb6a tempest-VolumesActionsTest-1821143126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9484db0b-ca1e-408b-a68d-d23872ccb638 1073741824" returned: 0 in 1.150s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0c4ed0a6-0521-4ea5-bc7f-1ec62068fb6a tempest-VolumesActionsTest-1821143126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9484db0b-ca1e-408b-a68d-d23872ccb638 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:36 devstack sudo[93333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9484db0b-ca1e-408b-a68d-d23872ccb638 Jul 10 06:40:36 devstack sudo[93333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:37 devstack sudo[93333]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0c4ed0a6-0521-4ea5-bc7f-1ec62068fb6a tempest-VolumesActionsTest-1821143126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9484db0b-ca1e-408b-a68d-d23872ccb638" returned: 0 in 0.732s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:37 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-0c4ed0a6-0521-4ea5-bc7f-1ec62068fb6a tempest-VolumesActionsTest-1821143126 None] <== create_volume: return (1921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:40:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-0c4ed0a6-0521-4ea5-bc7f-1ec62068fb6a tempest-VolumesActionsTest-1821143126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.924s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:40:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0c4ed0a6-0521-4ea5-bc7f-1ec62068fb6a tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab854cdd-4983-49df-b6e5-681e09c9babf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9484db0b-ca1e-408b-a68d-d23872ccb638', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0c4ed0a6-0521-4ea5-bc7f-1ec62068fb6a tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e528f2a-6265-4695-9c58-4cfe0d0f63b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:37 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-0c4ed0a6-0521-4ea5-bc7f-1ec62068fb6a tempest-VolumesActionsTest-1821143126 None] Volume volume-9484db0b-ca1e-408b-a68d-d23872ccb638 (9484db0b-ca1e-408b-a68d-d23872ccb638): created successfully Jul 10 06:40:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0c4ed0a6-0521-4ea5-bc7f-1ec62068fb6a tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e528f2a-6265-4695-9c58-4cfe0d0f63b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0c4ed0a6-0521-4ea5-bc7f-1ec62068fb6a tempest-VolumesActionsTest-1821143126 None] Flow 'volume_create_manager' (2bce6f57-e83b-4281-ac82-d8286547f787) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:40:37 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-0c4ed0a6-0521-4ea5-bc7f-1ec62068fb6a tempest-VolumesActionsTest-1821143126 None] Created volume successfully. Jul 10 06:40:38 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-8703f2e4-aede-4d72-a3ac-17f269ce7f55 tempest-VolumesActionsTest-683082422 None] Acquiring lock "cinder-9484db0b-ca1e-408b-a68d-d23872ccb638-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:40:38 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-8703f2e4-aede-4d72-a3ac-17f269ce7f55 tempest-VolumesActionsTest-683082422 None] Lock "cinder-9484db0b-ca1e-408b-a68d-d23872ccb638-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:40:38 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-8703f2e4-aede-4d72-a3ac-17f269ce7f55 tempest-VolumesActionsTest-683082422 None] Acquiring lock "cinder-quobyte-9484db0b-ca1e-408b-a68d-d23872ccb638" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:40:38 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-8703f2e4-aede-4d72-a3ac-17f269ce7f55 tempest-VolumesActionsTest-683082422 None] Lock "cinder-quobyte-9484db0b-ca1e-408b-a68d-d23872ccb638" acquired by "delete_volume" :: waited 0.021s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:40:38 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7ed68b-5d23-454f-8b86-ed37aab42bf1]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:40:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8703f2e4-aede-4d72-a3ac-17f269ce7f55 tempest-VolumesActionsTest-683082422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9484db0b-ca1e-408b-a68d-d23872ccb638 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:39 devstack sudo[93338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9484db0b-ca1e-408b-a68d-d23872ccb638 Jul 10 06:40:39 devstack sudo[93338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:39 devstack sudo[93338]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8703f2e4-aede-4d72-a3ac-17f269ce7f55 tempest-VolumesActionsTest-683082422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9484db0b-ca1e-408b-a68d-d23872ccb638" returned: 0 in 0.888s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8703f2e4-aede-4d72-a3ac-17f269ce7f55 tempest-VolumesActionsTest-683082422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9484db0b-ca1e-408b-a68d-d23872ccb638 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:39 devstack sudo[93345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9484db0b-ca1e-408b-a68d-d23872ccb638 Jul 10 06:40:39 devstack sudo[93345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:40 devstack sudo[93345]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8703f2e4-aede-4d72-a3ac-17f269ce7f55 tempest-VolumesActionsTest-683082422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9484db0b-ca1e-408b-a68d-d23872ccb638" returned: 0 in 0.814s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:40 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-8703f2e4-aede-4d72-a3ac-17f269ce7f55 tempest-VolumesActionsTest-683082422 None] Lock "cinder-quobyte-9484db0b-ca1e-408b-a68d-d23872ccb638" released by "delete_volume" :: held 1.806s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:40:40 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-8703f2e4-aede-4d72-a3ac-17f269ce7f55 tempest-VolumesActionsTest-683082422 None] Created reservations ['b57663cc-5f3b-4323-850e-1780fbd09444', '6ebd10b1-130d-489e-8423-bfb5ba5323f0', 'a45d74c0-727d-400c-94ff-248ab3b1d775', '61828434-e0fc-41c5-8532-eb1d9b02cfff'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:40:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-8703f2e4-aede-4d72-a3ac-17f269ce7f55 tempest-VolumesActionsTest-683082422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:40:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-8703f2e4-aede-4d72-a3ac-17f269ce7f55 tempest-VolumesActionsTest-683082422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:40:40 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-8703f2e4-aede-4d72-a3ac-17f269ce7f55 tempest-VolumesActionsTest-683082422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:40:40 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-8703f2e4-aede-4d72-a3ac-17f269ce7f55 tempest-VolumesActionsTest-683082422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:40:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-8703f2e4-aede-4d72-a3ac-17f269ce7f55 tempest-VolumesActionsTest-683082422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:40:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8703f2e4-aede-4d72-a3ac-17f269ce7f55 tempest-VolumesActionsTest-683082422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:41 devstack sudo[93366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:40:41 devstack sudo[93366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:42 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-27e066fa-086b-486b-8ab0-7baba69b37e4 tempest-VolumesActionsTest-1821143126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:40:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-27e066fa-086b-486b-8ab0-7baba69b37e4 tempest-VolumesActionsTest-1821143126 None] Flow 'volume_create_manager' (1c7e6e23-aff7-46e2-9dc7-430d06a2a6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:40:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-27e066fa-086b-486b-8ab0-7baba69b37e4 tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91c56951-4284-4d61-a46f-cce00b8716c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-27e066fa-086b-486b-8ab0-7baba69b37e4 tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91c56951-4284-4d61-a46f-cce00b8716c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1947734296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1e56433-3451-44f9-84d1-fdb3c2bd4cf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62e2bf0336fd45aeba43567326c45034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:40:42Z,use_quota=True,user_id='b6ecd28517cf4cd7b6edc6b576cac046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-27e066fa-086b-486b-8ab0-7baba69b37e4 tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (241fe93b-5656-4421-bd75-abb8936514ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-27e066fa-086b-486b-8ab0-7baba69b37e4 tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (241fe93b-5656-4421-bd75-abb8936514ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:42 devstack sudo[93366]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-27e066fa-086b-486b-8ab0-7baba69b37e4 tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b81a471-3a6f-4c1e-a239-1a86c4579c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-27e066fa-086b-486b-8ab0-7baba69b37e4 tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b81a471-3a6f-4c1e-a239-1a86c4579c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1e56433-3451-44f9-84d1-fdb3c2bd4cf4', 'volume_name': 'volume-d1e56433-3451-44f9-84d1-fdb3c2bd4cf4', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-27e066fa-086b-486b-8ab0-7baba69b37e4 tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93faf8cd-3979-4482-b780-99f7ccee9724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-27e066fa-086b-486b-8ab0-7baba69b37e4 tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93faf8cd-3979-4482-b780-99f7ccee9724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-27e066fa-086b-486b-8ab0-7baba69b37e4 tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b58e5fa-01d5-4096-9c61-f3ce61db9489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:42 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-27e066fa-086b-486b-8ab0-7baba69b37e4 tempest-VolumesActionsTest-1821143126 None] Volume d1e56433-3451-44f9-84d1-fdb3c2bd4cf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1e56433-3451-44f9-84d1-fdb3c2bd4cf4', 'volume_size': 1} Jul 10 06:40:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-27e066fa-086b-486b-8ab0-7baba69b37e4 tempest-VolumesActionsTest-1821143126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:40:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-27e066fa-086b-486b-8ab0-7baba69b37e4 tempest-VolumesActionsTest-1821143126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:40:42 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-27e066fa-086b-486b-8ab0-7baba69b37e4 tempest-VolumesActionsTest-1821143126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1947734296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1e56433-3451-44f9-84d1-fdb3c2bd4cf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62e2bf0336fd45aeba43567326c45034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:40:42Z,use_quota=True,user_id='b6ecd28517cf4cd7b6edc6b576cac046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:40:42 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-27e066fa-086b-486b-8ab0-7baba69b37e4 tempest-VolumesActionsTest-1821143126 None] Creating volume d1e56433-3451-44f9-84d1-fdb3c2bd4cf4 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:40:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-27e066fa-086b-486b-8ab0-7baba69b37e4 tempest-VolumesActionsTest-1821143126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:40:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-27e066fa-086b-486b-8ab0-7baba69b37e4 tempest-VolumesActionsTest-1821143126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:40:42 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-27e066fa-086b-486b-8ab0-7baba69b37e4 tempest-VolumesActionsTest-1821143126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:40:42 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-27e066fa-086b-486b-8ab0-7baba69b37e4 tempest-VolumesActionsTest-1821143126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:40:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-27e066fa-086b-486b-8ab0-7baba69b37e4 tempest-VolumesActionsTest-1821143126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:40:42 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-27e066fa-086b-486b-8ab0-7baba69b37e4 tempest-VolumesActionsTest-1821143126 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:40:42 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-27e066fa-086b-486b-8ab0-7baba69b37e4 tempest-VolumesActionsTest-1821143126 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:40:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-27e066fa-086b-486b-8ab0-7baba69b37e4 tempest-VolumesActionsTest-1821143126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d1e56433-3451-44f9-84d1-fdb3c2bd4cf4 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8703f2e4-aede-4d72-a3ac-17f269ce7f55 tempest-VolumesActionsTest-683082422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.451s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:42 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-8703f2e4-aede-4d72-a3ac-17f269ce7f55 tempest-VolumesActionsTest-683082422 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:40:42 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-8703f2e4-aede-4d72-a3ac-17f269ce7f55 tempest-VolumesActionsTest-683082422 None] Deleted volume successfully. Jul 10 06:40:42 devstack sudo[93372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d1e56433-3451-44f9-84d1-fdb3c2bd4cf4 1073741824 Jul 10 06:40:42 devstack sudo[93372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-8703f2e4-aede-4d72-a3ac-17f269ce7f55 tempest-VolumesActionsTest-683082422 None] Lock "cinder-9484db0b-ca1e-408b-a68d-d23872ccb638-delete_volume" released by "delete_volume" :: held 3.624s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:40:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6f4a9550-b2cc-4ac9-8472-116ab6f02aa5 tempest-AttachVolumeShelveTestJSON-2071360101 None] Acquiring lock "cinder-23fed609-6fe1-498d-94a5-38540d0aa065-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:40:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6f4a9550-b2cc-4ac9-8472-116ab6f02aa5 tempest-AttachVolumeShelveTestJSON-2071360101 None] Lock "cinder-23fed609-6fe1-498d-94a5-38540d0aa065-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:40:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6f4a9550-b2cc-4ac9-8472-116ab6f02aa5 tempest-AttachVolumeShelveTestJSON-2071360101 None] Acquiring lock "cinder-quobyte-23fed609-6fe1-498d-94a5-38540d0aa065" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:40:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6f4a9550-b2cc-4ac9-8472-116ab6f02aa5 tempest-AttachVolumeShelveTestJSON-2071360101 None] Lock "cinder-quobyte-23fed609-6fe1-498d-94a5-38540d0aa065" acquired by "delete_volume" :: waited 0.038s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:40:42 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6e3985-89c8-448a-923a-258ae8d93d77]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:40:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6f4a9550-b2cc-4ac9-8472-116ab6f02aa5 tempest-AttachVolumeShelveTestJSON-2071360101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-23fed609-6fe1-498d-94a5-38540d0aa065 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:43 devstack sudo[93394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-23fed609-6fe1-498d-94a5-38540d0aa065 Jul 10 06:40:43 devstack sudo[93394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:43 devstack sudo[93372]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-27e066fa-086b-486b-8ab0-7baba69b37e4 tempest-VolumesActionsTest-1821143126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d1e56433-3451-44f9-84d1-fdb3c2bd4cf4 1073741824" returned: 0 in 1.414s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-27e066fa-086b-486b-8ab0-7baba69b37e4 tempest-VolumesActionsTest-1821143126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d1e56433-3451-44f9-84d1-fdb3c2bd4cf4 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:43 devstack sudo[93403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d1e56433-3451-44f9-84d1-fdb3c2bd4cf4 Jul 10 06:40:43 devstack sudo[93403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:43 devstack sudo[93394]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6f4a9550-b2cc-4ac9-8472-116ab6f02aa5 tempest-AttachVolumeShelveTestJSON-2071360101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-23fed609-6fe1-498d-94a5-38540d0aa065" returned: 0 in 1.016s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6f4a9550-b2cc-4ac9-8472-116ab6f02aa5 tempest-AttachVolumeShelveTestJSON-2071360101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-23fed609-6fe1-498d-94a5-38540d0aa065 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:44 devstack sudo[93408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-23fed609-6fe1-498d-94a5-38540d0aa065 Jul 10 06:40:44 devstack sudo[93408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:44 devstack sudo[93403]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-27e066fa-086b-486b-8ab0-7baba69b37e4 tempest-VolumesActionsTest-1821143126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d1e56433-3451-44f9-84d1-fdb3c2bd4cf4" returned: 0 in 0.653s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:44 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-27e066fa-086b-486b-8ab0-7baba69b37e4 tempest-VolumesActionsTest-1821143126 None] <== create_volume: return (2119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:40:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-27e066fa-086b-486b-8ab0-7baba69b37e4 tempest-VolumesActionsTest-1821143126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.123s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:40:44 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-27e066fa-086b-486b-8ab0-7baba69b37e4 tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b58e5fa-01d5-4096-9c61-f3ce61db9489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1e56433-3451-44f9-84d1-fdb3c2bd4cf4', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:44 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-27e066fa-086b-486b-8ab0-7baba69b37e4 tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6409a8f-814f-4dd7-b662-3aa27a8ab759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:44 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-27e066fa-086b-486b-8ab0-7baba69b37e4 tempest-VolumesActionsTest-1821143126 None] Volume volume-d1e56433-3451-44f9-84d1-fdb3c2bd4cf4 (d1e56433-3451-44f9-84d1-fdb3c2bd4cf4): created successfully Jul 10 06:40:44 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-27e066fa-086b-486b-8ab0-7baba69b37e4 tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6409a8f-814f-4dd7-b662-3aa27a8ab759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:44 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-27e066fa-086b-486b-8ab0-7baba69b37e4 tempest-VolumesActionsTest-1821143126 None] Flow 'volume_create_manager' (1c7e6e23-aff7-46e2-9dc7-430d06a2a6b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:40:44 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-27e066fa-086b-486b-8ab0-7baba69b37e4 tempest-VolumesActionsTest-1821143126 None] Created volume successfully. Jul 10 06:40:44 devstack sudo[93408]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6f4a9550-b2cc-4ac9-8472-116ab6f02aa5 tempest-AttachVolumeShelveTestJSON-2071360101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-23fed609-6fe1-498d-94a5-38540d0aa065" returned: 0 in 0.698s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:44 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6f4a9550-b2cc-4ac9-8472-116ab6f02aa5 tempest-AttachVolumeShelveTestJSON-2071360101 None] Lock "cinder-quobyte-23fed609-6fe1-498d-94a5-38540d0aa065" released by "delete_volume" :: held 1.822s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:40:44 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-6f4a9550-b2cc-4ac9-8472-116ab6f02aa5 tempest-AttachVolumeShelveTestJSON-2071360101 None] Created reservations ['b2b2bd06-9c5a-4d1e-b22e-9ebe8b3fc514', 'e295b5f0-20f9-430a-af02-a8336484864b', '0db859fd-71b8-46da-982b-90f706da582c', 'becd779b-e220-471f-b47d-2e8271c262cc'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:40:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-6f4a9550-b2cc-4ac9-8472-116ab6f02aa5 tempest-AttachVolumeShelveTestJSON-2071360101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:40:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-6f4a9550-b2cc-4ac9-8472-116ab6f02aa5 tempest-AttachVolumeShelveTestJSON-2071360101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:40:44 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-6f4a9550-b2cc-4ac9-8472-116ab6f02aa5 tempest-AttachVolumeShelveTestJSON-2071360101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:40:44 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-6f4a9550-b2cc-4ac9-8472-116ab6f02aa5 tempest-AttachVolumeShelveTestJSON-2071360101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:40:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-6f4a9550-b2cc-4ac9-8472-116ab6f02aa5 tempest-AttachVolumeShelveTestJSON-2071360101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:40:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6f4a9550-b2cc-4ac9-8472-116ab6f02aa5 tempest-AttachVolumeShelveTestJSON-2071360101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:44 devstack sudo[93412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:40:44 devstack sudo[93412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:45 devstack sudo[93412]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6f4a9550-b2cc-4ac9-8472-116ab6f02aa5 tempest-AttachVolumeShelveTestJSON-2071360101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.622s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:45 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-6f4a9550-b2cc-4ac9-8472-116ab6f02aa5 tempest-AttachVolumeShelveTestJSON-2071360101 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:40:45 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-6f4a9550-b2cc-4ac9-8472-116ab6f02aa5 tempest-AttachVolumeShelveTestJSON-2071360101 None] Deleted volume successfully. Jul 10 06:40:45 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6f4a9550-b2cc-4ac9-8472-116ab6f02aa5 tempest-AttachVolumeShelveTestJSON-2071360101 None] Lock "cinder-23fed609-6fe1-498d-94a5-38540d0aa065-delete_volume" released by "delete_volume" :: held 2.704s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:40:45 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7cd8b1a6-8fc4-4ab3-a96c-4b2628133cf7 tempest-VolumesActionsTest-683082422 None] Acquiring lock "cinder-d1e56433-3451-44f9-84d1-fdb3c2bd4cf4-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:40:45 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7cd8b1a6-8fc4-4ab3-a96c-4b2628133cf7 tempest-VolumesActionsTest-683082422 None] Lock "cinder-d1e56433-3451-44f9-84d1-fdb3c2bd4cf4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:40:45 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7cd8b1a6-8fc4-4ab3-a96c-4b2628133cf7 tempest-VolumesActionsTest-683082422 None] Acquiring lock "cinder-quobyte-d1e56433-3451-44f9-84d1-fdb3c2bd4cf4" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:40:45 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7cd8b1a6-8fc4-4ab3-a96c-4b2628133cf7 tempest-VolumesActionsTest-683082422 None] Lock "cinder-quobyte-d1e56433-3451-44f9-84d1-fdb3c2bd4cf4" acquired by "delete_volume" :: waited 0.021s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:40:45 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09eda41-e3f8-4c87-951d-a14d363ee4b1]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:40:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7cd8b1a6-8fc4-4ab3-a96c-4b2628133cf7 tempest-VolumesActionsTest-683082422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d1e56433-3451-44f9-84d1-fdb3c2bd4cf4 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:45 devstack sudo[93415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d1e56433-3451-44f9-84d1-fdb3c2bd4cf4 Jul 10 06:40:45 devstack sudo[93415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:46 devstack sudo[93415]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7cd8b1a6-8fc4-4ab3-a96c-4b2628133cf7 tempest-VolumesActionsTest-683082422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d1e56433-3451-44f9-84d1-fdb3c2bd4cf4" returned: 0 in 0.794s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7cd8b1a6-8fc4-4ab3-a96c-4b2628133cf7 tempest-VolumesActionsTest-683082422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d1e56433-3451-44f9-84d1-fdb3c2bd4cf4 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:46 devstack sudo[93420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d1e56433-3451-44f9-84d1-fdb3c2bd4cf4 Jul 10 06:40:46 devstack sudo[93420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:47 devstack sudo[93420]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7cd8b1a6-8fc4-4ab3-a96c-4b2628133cf7 tempest-VolumesActionsTest-683082422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d1e56433-3451-44f9-84d1-fdb3c2bd4cf4" returned: 0 in 0.689s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:47 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7cd8b1a6-8fc4-4ab3-a96c-4b2628133cf7 tempest-VolumesActionsTest-683082422 None] Lock "cinder-quobyte-d1e56433-3451-44f9-84d1-fdb3c2bd4cf4" released by "delete_volume" :: held 1.540s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:40:47 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-7cd8b1a6-8fc4-4ab3-a96c-4b2628133cf7 tempest-VolumesActionsTest-683082422 None] Created reservations ['04765150-2288-415a-975f-1586a6388484', '0a54864c-cadb-4eab-b800-650ce9e48916', '9c1469ff-a0d8-495d-bb94-bd0f71073127', '295a2cd7-4f76-4f66-9f00-cf33d9127aa4'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:40:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7cd8b1a6-8fc4-4ab3-a96c-4b2628133cf7 tempest-VolumesActionsTest-683082422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:40:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7cd8b1a6-8fc4-4ab3-a96c-4b2628133cf7 tempest-VolumesActionsTest-683082422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:40:47 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-7cd8b1a6-8fc4-4ab3-a96c-4b2628133cf7 tempest-VolumesActionsTest-683082422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:40:47 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-7cd8b1a6-8fc4-4ab3-a96c-4b2628133cf7 tempest-VolumesActionsTest-683082422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:40:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7cd8b1a6-8fc4-4ab3-a96c-4b2628133cf7 tempest-VolumesActionsTest-683082422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:40:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7cd8b1a6-8fc4-4ab3-a96c-4b2628133cf7 tempest-VolumesActionsTest-683082422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:47 devstack sudo[93448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:40:47 devstack sudo[93448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:48 devstack sudo[93448]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7cd8b1a6-8fc4-4ab3-a96c-4b2628133cf7 tempest-VolumesActionsTest-683082422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.859s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:48 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-7cd8b1a6-8fc4-4ab3-a96c-4b2628133cf7 tempest-VolumesActionsTest-683082422 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:40:48 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-7cd8b1a6-8fc4-4ab3-a96c-4b2628133cf7 tempest-VolumesActionsTest-683082422 None] Deleted volume successfully. Jul 10 06:40:48 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7cd8b1a6-8fc4-4ab3-a96c-4b2628133cf7 tempest-VolumesActionsTest-683082422 None] Lock "cinder-d1e56433-3451-44f9-84d1-fdb3c2bd4cf4-delete_volume" released by "delete_volume" :: held 2.636s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:40:48 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b1254ee-49e9-4521-8859-f99362b1313f tempest-VolumesActionsTest-1821143126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:40:48 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9b1254ee-49e9-4521-8859-f99362b1313f tempest-VolumesActionsTest-1821143126 None] Flow 'volume_create_manager' (157a78c8-d060-4f5a-9166-deb9f3867141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:40:48 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9b1254ee-49e9-4521-8859-f99362b1313f tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (059cd743-f717-47c7-ad36-ea30ccb50154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:48 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9b1254ee-49e9-4521-8859-f99362b1313f tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (059cd743-f717-47c7-ad36-ea30ccb50154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1812422663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f27da4d3-815a-42c5-98a1-0c3bc8863e6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62e2bf0336fd45aeba43567326c45034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:40:49Z,use_quota=True,user_id='b6ecd28517cf4cd7b6edc6b576cac046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:48 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9b1254ee-49e9-4521-8859-f99362b1313f tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a4bf5f-c09d-4bbb-8e41-4c157f9b07c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:48 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9b1254ee-49e9-4521-8859-f99362b1313f tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a4bf5f-c09d-4bbb-8e41-4c157f9b07c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:48 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9b1254ee-49e9-4521-8859-f99362b1313f tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae7a3e4d-daca-4cb0-850a-bbc46ae7b4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:48 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9b1254ee-49e9-4521-8859-f99362b1313f tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae7a3e4d-daca-4cb0-850a-bbc46ae7b4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f27da4d3-815a-42c5-98a1-0c3bc8863e6e', 'volume_name': 'volume-f27da4d3-815a-42c5-98a1-0c3bc8863e6e', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:48 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9b1254ee-49e9-4521-8859-f99362b1313f tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8188434f-f7f8-4624-9fc2-c2d2710ad35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:48 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9b1254ee-49e9-4521-8859-f99362b1313f tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8188434f-f7f8-4624-9fc2-c2d2710ad35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:48 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9b1254ee-49e9-4521-8859-f99362b1313f tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dff9309-0d02-4345-a442-faf2b4acbeb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:48 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-9b1254ee-49e9-4521-8859-f99362b1313f tempest-VolumesActionsTest-1821143126 None] Volume f27da4d3-815a-42c5-98a1-0c3bc8863e6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f27da4d3-815a-42c5-98a1-0c3bc8863e6e', 'volume_size': 1} Jul 10 06:40:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9b1254ee-49e9-4521-8859-f99362b1313f tempest-VolumesActionsTest-1821143126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:40:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9b1254ee-49e9-4521-8859-f99362b1313f tempest-VolumesActionsTest-1821143126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:40:48 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9b1254ee-49e9-4521-8859-f99362b1313f tempest-VolumesActionsTest-1821143126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1812422663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f27da4d3-815a-42c5-98a1-0c3bc8863e6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62e2bf0336fd45aeba43567326c45034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:40:49Z,use_quota=True,user_id='b6ecd28517cf4cd7b6edc6b576cac046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:40:48 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-9b1254ee-49e9-4521-8859-f99362b1313f tempest-VolumesActionsTest-1821143126 None] Creating volume f27da4d3-815a-42c5-98a1-0c3bc8863e6e {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:40:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9b1254ee-49e9-4521-8859-f99362b1313f tempest-VolumesActionsTest-1821143126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:40:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9b1254ee-49e9-4521-8859-f99362b1313f tempest-VolumesActionsTest-1821143126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:40:48 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9b1254ee-49e9-4521-8859-f99362b1313f tempest-VolumesActionsTest-1821143126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:40:48 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9b1254ee-49e9-4521-8859-f99362b1313f tempest-VolumesActionsTest-1821143126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:40:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9b1254ee-49e9-4521-8859-f99362b1313f tempest-VolumesActionsTest-1821143126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:40:48 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9b1254ee-49e9-4521-8859-f99362b1313f tempest-VolumesActionsTest-1821143126 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:40:48 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-9b1254ee-49e9-4521-8859-f99362b1313f tempest-VolumesActionsTest-1821143126 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:40:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9b1254ee-49e9-4521-8859-f99362b1313f tempest-VolumesActionsTest-1821143126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f27da4d3-815a-42c5-98a1-0c3bc8863e6e 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:48 devstack sudo[93452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f27da4d3-815a-42c5-98a1-0c3bc8863e6e 1073741824 Jul 10 06:40:48 devstack sudo[93452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:49 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f71ebae9-f50f-48f2-b6d6-8cb4c980d53f tempest-AttachVolumeNegativeTest-501522069 None] Acquiring lock "cinder-c8956953-15fd-4725-943e-b270ec55b75b-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:40:49 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f71ebae9-f50f-48f2-b6d6-8cb4c980d53f tempest-AttachVolumeNegativeTest-501522069 None] Lock "cinder-c8956953-15fd-4725-943e-b270ec55b75b-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:40:49 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f71ebae9-f50f-48f2-b6d6-8cb4c980d53f tempest-AttachVolumeNegativeTest-501522069 None] Acquiring lock "cinder-quobyte-c8956953-15fd-4725-943e-b270ec55b75b" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:40:49 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f71ebae9-f50f-48f2-b6d6-8cb4c980d53f tempest-AttachVolumeNegativeTest-501522069 None] Lock "cinder-quobyte-c8956953-15fd-4725-943e-b270ec55b75b" acquired by "delete_volume" :: waited 0.029s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:40:49 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a02d65f-409c-4cc9-9e1e-05d96c49d4ae]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:40:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f71ebae9-f50f-48f2-b6d6-8cb4c980d53f tempest-AttachVolumeNegativeTest-501522069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c8956953-15fd-4725-943e-b270ec55b75b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:49 devstack sudo[93459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c8956953-15fd-4725-943e-b270ec55b75b Jul 10 06:40:49 devstack sudo[93459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:50 devstack sudo[93452]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9b1254ee-49e9-4521-8859-f99362b1313f tempest-VolumesActionsTest-1821143126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f27da4d3-815a-42c5-98a1-0c3bc8863e6e 1073741824" returned: 0 in 1.258s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9b1254ee-49e9-4521-8859-f99362b1313f tempest-VolumesActionsTest-1821143126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f27da4d3-815a-42c5-98a1-0c3bc8863e6e {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:50 devstack sudo[93461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f27da4d3-815a-42c5-98a1-0c3bc8863e6e Jul 10 06:40:50 devstack sudo[93461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:50 devstack sudo[93459]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f71ebae9-f50f-48f2-b6d6-8cb4c980d53f tempest-AttachVolumeNegativeTest-501522069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c8956953-15fd-4725-943e-b270ec55b75b" returned: 0 in 1.063s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f71ebae9-f50f-48f2-b6d6-8cb4c980d53f tempest-AttachVolumeNegativeTest-501522069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c8956953-15fd-4725-943e-b270ec55b75b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:50 devstack sudo[93467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c8956953-15fd-4725-943e-b270ec55b75b Jul 10 06:40:50 devstack sudo[93467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:50 devstack sudo[93461]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9b1254ee-49e9-4521-8859-f99362b1313f tempest-VolumesActionsTest-1821143126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f27da4d3-815a-42c5-98a1-0c3bc8863e6e" returned: 0 in 0.863s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:50 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9b1254ee-49e9-4521-8859-f99362b1313f tempest-VolumesActionsTest-1821143126 None] <== create_volume: return (2184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:40:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9b1254ee-49e9-4521-8859-f99362b1313f tempest-VolumesActionsTest-1821143126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.188s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:40:50 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9b1254ee-49e9-4521-8859-f99362b1313f tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dff9309-0d02-4345-a442-faf2b4acbeb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f27da4d3-815a-42c5-98a1-0c3bc8863e6e', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:51 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9b1254ee-49e9-4521-8859-f99362b1313f tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73b617df-909a-4be9-8c81-5f63d91548c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:51 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-9b1254ee-49e9-4521-8859-f99362b1313f tempest-VolumesActionsTest-1821143126 None] Volume volume-f27da4d3-815a-42c5-98a1-0c3bc8863e6e (f27da4d3-815a-42c5-98a1-0c3bc8863e6e): created successfully Jul 10 06:40:51 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9b1254ee-49e9-4521-8859-f99362b1313f tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73b617df-909a-4be9-8c81-5f63d91548c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:51 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9b1254ee-49e9-4521-8859-f99362b1313f tempest-VolumesActionsTest-1821143126 None] Flow 'volume_create_manager' (157a78c8-d060-4f5a-9166-deb9f3867141) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:40:51 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-9b1254ee-49e9-4521-8859-f99362b1313f tempest-VolumesActionsTest-1821143126 None] Created volume successfully. Jul 10 06:40:51 devstack sudo[93467]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f71ebae9-f50f-48f2-b6d6-8cb4c980d53f tempest-AttachVolumeNegativeTest-501522069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c8956953-15fd-4725-943e-b270ec55b75b" returned: 0 in 0.785s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:51 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f71ebae9-f50f-48f2-b6d6-8cb4c980d53f tempest-AttachVolumeNegativeTest-501522069 None] Lock "cinder-quobyte-c8956953-15fd-4725-943e-b270ec55b75b" released by "delete_volume" :: held 1.900s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:40:51 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-f71ebae9-f50f-48f2-b6d6-8cb4c980d53f tempest-AttachVolumeNegativeTest-501522069 None] Created reservations ['000fac87-5b7d-4668-b3ae-8aca97a4f34a', '4ecb4a26-aff2-4db0-85ab-5baace6f19b8', '41f9252d-82f1-4a34-b15c-7bc1192672d6', 'e4a72d14-a123-47fe-9fed-cec9367c1541'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:40:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f71ebae9-f50f-48f2-b6d6-8cb4c980d53f tempest-AttachVolumeNegativeTest-501522069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:40:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f71ebae9-f50f-48f2-b6d6-8cb4c980d53f tempest-AttachVolumeNegativeTest-501522069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:40:51 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f71ebae9-f50f-48f2-b6d6-8cb4c980d53f tempest-AttachVolumeNegativeTest-501522069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:40:51 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f71ebae9-f50f-48f2-b6d6-8cb4c980d53f tempest-AttachVolumeNegativeTest-501522069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:40:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f71ebae9-f50f-48f2-b6d6-8cb4c980d53f tempest-AttachVolumeNegativeTest-501522069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:40:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f71ebae9-f50f-48f2-b6d6-8cb4c980d53f tempest-AttachVolumeNegativeTest-501522069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:51 devstack sudo[93470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:40:51 devstack sudo[93470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:52 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-385ef246-a694-4a35-a31c-cb254a1c44db tempest-AttachVolumeNegativeTest-501522069 None] Acquiring lock "cinder-874b2f32-d55a-4c95-a29d-ebb7d0cd4a07-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:40:52 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7777e27c-def3-4717-98db-329e2d817227 tempest-VolumesActionsTest-683082422 None] Acquiring lock "cinder-f27da4d3-815a-42c5-98a1-0c3bc8863e6e-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:40:52 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-385ef246-a694-4a35-a31c-cb254a1c44db tempest-AttachVolumeNegativeTest-501522069 None] Lock "cinder-874b2f32-d55a-4c95-a29d-ebb7d0cd4a07-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:40:52 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7777e27c-def3-4717-98db-329e2d817227 tempest-VolumesActionsTest-683082422 None] Lock "cinder-f27da4d3-815a-42c5-98a1-0c3bc8863e6e-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:40:52 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-385ef246-a694-4a35-a31c-cb254a1c44db tempest-AttachVolumeNegativeTest-501522069 None] Acquiring lock "cinder-quobyte-874b2f32-d55a-4c95-a29d-ebb7d0cd4a07" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:40:52 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7777e27c-def3-4717-98db-329e2d817227 tempest-VolumesActionsTest-683082422 None] Acquiring lock "cinder-quobyte-f27da4d3-815a-42c5-98a1-0c3bc8863e6e" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:40:52 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-385ef246-a694-4a35-a31c-cb254a1c44db tempest-AttachVolumeNegativeTest-501522069 None] Lock "cinder-quobyte-874b2f32-d55a-4c95-a29d-ebb7d0cd4a07" acquired by "delete_volume" :: waited 0.025s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:40:52 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7777e27c-def3-4717-98db-329e2d817227 tempest-VolumesActionsTest-683082422 None] Lock "cinder-quobyte-f27da4d3-815a-42c5-98a1-0c3bc8863e6e" acquired by "delete_volume" :: waited 0.033s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:40:52 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99b7be8-fa0f-45fe-92ae-1a4212fe7697]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:40:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-385ef246-a694-4a35-a31c-cb254a1c44db tempest-AttachVolumeNegativeTest-501522069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-874b2f32-d55a-4c95-a29d-ebb7d0cd4a07 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:52 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e938477-fa50-4fc1-9bc4-9676cb90ac4b]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:40:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7777e27c-def3-4717-98db-329e2d817227 tempest-VolumesActionsTest-683082422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f27da4d3-815a-42c5-98a1-0c3bc8863e6e {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:52 devstack sudo[93472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-874b2f32-d55a-4c95-a29d-ebb7d0cd4a07 Jul 10 06:40:52 devstack sudo[93472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:52 devstack sudo[93473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f27da4d3-815a-42c5-98a1-0c3bc8863e6e Jul 10 06:40:52 devstack sudo[93473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:52 devstack sudo[93470]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f71ebae9-f50f-48f2-b6d6-8cb4c980d53f tempest-AttachVolumeNegativeTest-501522069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.840s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:52 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-f71ebae9-f50f-48f2-b6d6-8cb4c980d53f tempest-AttachVolumeNegativeTest-501522069 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:40:52 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-f71ebae9-f50f-48f2-b6d6-8cb4c980d53f tempest-AttachVolumeNegativeTest-501522069 None] Deleted volume successfully. Jul 10 06:40:52 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f71ebae9-f50f-48f2-b6d6-8cb4c980d53f tempest-AttachVolumeNegativeTest-501522069 None] Lock "cinder-c8956953-15fd-4725-943e-b270ec55b75b-delete_volume" released by "delete_volume" :: held 3.037s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:40:53 devstack sudo[93473]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7777e27c-def3-4717-98db-329e2d817227 tempest-VolumesActionsTest-683082422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f27da4d3-815a-42c5-98a1-0c3bc8863e6e" returned: 0 in 0.996s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7777e27c-def3-4717-98db-329e2d817227 tempest-VolumesActionsTest-683082422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f27da4d3-815a-42c5-98a1-0c3bc8863e6e {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:53 devstack sudo[93486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f27da4d3-815a-42c5-98a1-0c3bc8863e6e Jul 10 06:40:53 devstack sudo[93486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:53 devstack sudo[93472]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-385ef246-a694-4a35-a31c-cb254a1c44db tempest-AttachVolumeNegativeTest-501522069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-874b2f32-d55a-4c95-a29d-ebb7d0cd4a07" returned: 0 in 1.092s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-385ef246-a694-4a35-a31c-cb254a1c44db tempest-AttachVolumeNegativeTest-501522069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-874b2f32-d55a-4c95-a29d-ebb7d0cd4a07 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:53 devstack sudo[93488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-874b2f32-d55a-4c95-a29d-ebb7d0cd4a07 Jul 10 06:40:53 devstack sudo[93488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:54 devstack sudo[93486]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7777e27c-def3-4717-98db-329e2d817227 tempest-VolumesActionsTest-683082422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f27da4d3-815a-42c5-98a1-0c3bc8863e6e" returned: 0 in 0.756s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:54 devstack sudo[93488]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:54 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7777e27c-def3-4717-98db-329e2d817227 tempest-VolumesActionsTest-683082422 None] Lock "cinder-quobyte-f27da4d3-815a-42c5-98a1-0c3bc8863e6e" released by "delete_volume" :: held 1.804s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:40:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-385ef246-a694-4a35-a31c-cb254a1c44db tempest-AttachVolumeNegativeTest-501522069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-874b2f32-d55a-4c95-a29d-ebb7d0cd4a07" returned: 0 in 0.697s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:54 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-385ef246-a694-4a35-a31c-cb254a1c44db tempest-AttachVolumeNegativeTest-501522069 None] Lock "cinder-quobyte-874b2f32-d55a-4c95-a29d-ebb7d0cd4a07" released by "delete_volume" :: held 1.845s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:40:54 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-7777e27c-def3-4717-98db-329e2d817227 tempest-VolumesActionsTest-683082422 None] Created reservations ['666ebeb8-b330-46f3-94cf-dc8f93ec7618', '71fab3bb-835e-447b-8c02-a1d97d5bd6ac', '90034289-7989-43a2-8040-4ca136d7d992', '000e6ef7-1402-4823-b8e2-3e6bd67b9c50'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:40:54 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-385ef246-a694-4a35-a31c-cb254a1c44db tempest-AttachVolumeNegativeTest-501522069 None] Created reservations ['67c8a5f4-3729-4e39-8657-50e346c266eb', 'ca251fb8-b247-4c9c-819d-7474703e009f', 'c76c915a-4096-4296-a399-7d757a071fc5', '35026866-9222-471c-a839-b33c48af7f84'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:40:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7777e27c-def3-4717-98db-329e2d817227 tempest-VolumesActionsTest-683082422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:40:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7777e27c-def3-4717-98db-329e2d817227 tempest-VolumesActionsTest-683082422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:40:54 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-7777e27c-def3-4717-98db-329e2d817227 tempest-VolumesActionsTest-683082422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:40:54 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-7777e27c-def3-4717-98db-329e2d817227 tempest-VolumesActionsTest-683082422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:40:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7777e27c-def3-4717-98db-329e2d817227 tempest-VolumesActionsTest-683082422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:40:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7777e27c-def3-4717-98db-329e2d817227 tempest-VolumesActionsTest-683082422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:54 devstack sudo[93493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:40:54 devstack sudo[93493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-385ef246-a694-4a35-a31c-cb254a1c44db tempest-AttachVolumeNegativeTest-501522069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:40:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-385ef246-a694-4a35-a31c-cb254a1c44db tempest-AttachVolumeNegativeTest-501522069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:40:54 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-385ef246-a694-4a35-a31c-cb254a1c44db tempest-AttachVolumeNegativeTest-501522069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:40:54 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-385ef246-a694-4a35-a31c-cb254a1c44db tempest-AttachVolumeNegativeTest-501522069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:40:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-385ef246-a694-4a35-a31c-cb254a1c44db tempest-AttachVolumeNegativeTest-501522069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:40:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-385ef246-a694-4a35-a31c-cb254a1c44db tempest-AttachVolumeNegativeTest-501522069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:54 devstack sudo[93495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:40:54 devstack sudo[93495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:54 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-cfaec611-f31c-4368-948f-1b0012ba767f tempest-AttachVolumeNegativeTest-501522069 None] Acquiring lock "cinder-8755029e-3182-47c0-869a-f3d229b759ba-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:40:54 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-cfaec611-f31c-4368-948f-1b0012ba767f tempest-AttachVolumeNegativeTest-501522069 None] Lock "cinder-8755029e-3182-47c0-869a-f3d229b759ba-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:40:54 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-28b0a992-3c6f-4949-ac81-3d73fb536c3c req-db8cd13a-18a0-443e-94bb-77daba27a69e tempest-ServerActionsTestOtherA-1099006734 None] Terminate volume connection completed successfully. Jul 10 06:40:54 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-28b0a992-3c6f-4949-ac81-3d73fb536c3c req-db8cd13a-18a0-443e-94bb-77daba27a69e tempest-ServerActionsTestOtherA-1099006734 None] Deleting attachment 76d935f4-d74c-4541-ae9f-fcdca57cbb8f. {{(pid=87294) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:40:54 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-cfaec611-f31c-4368-948f-1b0012ba767f tempest-AttachVolumeNegativeTest-501522069 None] Acquiring lock "cinder-quobyte-8755029e-3182-47c0-869a-f3d229b759ba" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:40:54 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-cfaec611-f31c-4368-948f-1b0012ba767f tempest-AttachVolumeNegativeTest-501522069 None] Lock "cinder-quobyte-8755029e-3182-47c0-869a-f3d229b759ba" acquired by "delete_volume" :: waited 0.035s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:40:55 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6157648-4d96-436a-86a0-b545fa9c5a62]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:40:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-cfaec611-f31c-4368-948f-1b0012ba767f tempest-AttachVolumeNegativeTest-501522069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8755029e-3182-47c0-869a-f3d229b759ba {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:55 devstack sudo[93500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8755029e-3182-47c0-869a-f3d229b759ba Jul 10 06:40:55 devstack sudo[93500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:55 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-495f1de9-16b7-4d0d-83cd-c39212df57e5 tempest-VolumesActionsTest-1821143126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:40:55 devstack sudo[93493]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-495f1de9-16b7-4d0d-83cd-c39212df57e5 tempest-VolumesActionsTest-1821143126 None] Flow 'volume_create_manager' (5b3e8ed7-9e39-4ae5-ad04-9572b1f5a40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:40:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-495f1de9-16b7-4d0d-83cd-c39212df57e5 tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19344d71-f124-439f-9079-dfd0851f6017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7777e27c-def3-4717-98db-329e2d817227 tempest-VolumesActionsTest-683082422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.232s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:55 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-7777e27c-def3-4717-98db-329e2d817227 tempest-VolumesActionsTest-683082422 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:40:55 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-7777e27c-def3-4717-98db-329e2d817227 tempest-VolumesActionsTest-683082422 None] Deleted volume successfully. Jul 10 06:40:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-495f1de9-16b7-4d0d-83cd-c39212df57e5 tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19344d71-f124-439f-9079-dfd0851f6017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1722168065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e89f91fe-51cd-48a2-a391-cc7378ea38bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62e2bf0336fd45aeba43567326c45034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:40:55Z,use_quota=True,user_id='b6ecd28517cf4cd7b6edc6b576cac046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-495f1de9-16b7-4d0d-83cd-c39212df57e5 tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1a30996-0684-4737-afb3-14df0c13d482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-495f1de9-16b7-4d0d-83cd-c39212df57e5 tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1a30996-0684-4737-afb3-14df0c13d482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-495f1de9-16b7-4d0d-83cd-c39212df57e5 tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f4d63d5-50c2-45e1-bdb3-75f138851dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-495f1de9-16b7-4d0d-83cd-c39212df57e5 tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f4d63d5-50c2-45e1-bdb3-75f138851dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e89f91fe-51cd-48a2-a391-cc7378ea38bc', 'volume_name': 'volume-e89f91fe-51cd-48a2-a391-cc7378ea38bc', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-495f1de9-16b7-4d0d-83cd-c39212df57e5 tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (218fcb8a-816b-440a-b439-c6a63158e231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-495f1de9-16b7-4d0d-83cd-c39212df57e5 tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (218fcb8a-816b-440a-b439-c6a63158e231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-495f1de9-16b7-4d0d-83cd-c39212df57e5 tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1e6c321-1cd7-474a-96fb-16a61b03210b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:55 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-495f1de9-16b7-4d0d-83cd-c39212df57e5 tempest-VolumesActionsTest-1821143126 None] Volume e89f91fe-51cd-48a2-a391-cc7378ea38bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e89f91fe-51cd-48a2-a391-cc7378ea38bc', 'volume_size': 1} Jul 10 06:40:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-495f1de9-16b7-4d0d-83cd-c39212df57e5 tempest-VolumesActionsTest-1821143126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:40:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-495f1de9-16b7-4d0d-83cd-c39212df57e5 tempest-VolumesActionsTest-1821143126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:40:55 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-495f1de9-16b7-4d0d-83cd-c39212df57e5 tempest-VolumesActionsTest-1821143126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1722168065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e89f91fe-51cd-48a2-a391-cc7378ea38bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62e2bf0336fd45aeba43567326c45034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:40:55Z,use_quota=True,user_id='b6ecd28517cf4cd7b6edc6b576cac046',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:40:55 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-495f1de9-16b7-4d0d-83cd-c39212df57e5 tempest-VolumesActionsTest-1821143126 None] Creating volume e89f91fe-51cd-48a2-a391-cc7378ea38bc {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:40:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-495f1de9-16b7-4d0d-83cd-c39212df57e5 tempest-VolumesActionsTest-1821143126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:40:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-495f1de9-16b7-4d0d-83cd-c39212df57e5 tempest-VolumesActionsTest-1821143126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:40:55 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-495f1de9-16b7-4d0d-83cd-c39212df57e5 tempest-VolumesActionsTest-1821143126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:40:55 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-495f1de9-16b7-4d0d-83cd-c39212df57e5 tempest-VolumesActionsTest-1821143126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:40:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-495f1de9-16b7-4d0d-83cd-c39212df57e5 tempest-VolumesActionsTest-1821143126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:40:55 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-495f1de9-16b7-4d0d-83cd-c39212df57e5 tempest-VolumesActionsTest-1821143126 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:40:55 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-495f1de9-16b7-4d0d-83cd-c39212df57e5 tempest-VolumesActionsTest-1821143126 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:40:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-495f1de9-16b7-4d0d-83cd-c39212df57e5 tempest-VolumesActionsTest-1821143126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e89f91fe-51cd-48a2-a391-cc7378ea38bc 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:55 devstack sudo[93504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e89f91fe-51cd-48a2-a391-cc7378ea38bc 1073741824 Jul 10 06:40:55 devstack sudo[93504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7777e27c-def3-4717-98db-329e2d817227 tempest-VolumesActionsTest-683082422 None] Lock "cinder-f27da4d3-815a-42c5-98a1-0c3bc8863e6e-delete_volume" released by "delete_volume" :: held 3.466s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:40:55 devstack sudo[93495]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-385ef246-a694-4a35-a31c-cb254a1c44db tempest-AttachVolumeNegativeTest-501522069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.342s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:55 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-385ef246-a694-4a35-a31c-cb254a1c44db tempest-AttachVolumeNegativeTest-501522069 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:40:55 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-385ef246-a694-4a35-a31c-cb254a1c44db tempest-AttachVolumeNegativeTest-501522069 None] Deleted volume successfully. Jul 10 06:40:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-385ef246-a694-4a35-a31c-cb254a1c44db tempest-AttachVolumeNegativeTest-501522069 None] Lock "cinder-874b2f32-d55a-4c95-a29d-ebb7d0cd4a07-delete_volume" released by "delete_volume" :: held 3.557s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:40:56 devstack sudo[93500]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-cfaec611-f31c-4368-948f-1b0012ba767f tempest-AttachVolumeNegativeTest-501522069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8755029e-3182-47c0-869a-f3d229b759ba" returned: 0 in 1.090s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-cfaec611-f31c-4368-948f-1b0012ba767f tempest-AttachVolumeNegativeTest-501522069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8755029e-3182-47c0-869a-f3d229b759ba {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:56 devstack sudo[93510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8755029e-3182-47c0-869a-f3d229b759ba Jul 10 06:40:56 devstack sudo[93510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:56 devstack sudo[93504]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-495f1de9-16b7-4d0d-83cd-c39212df57e5 tempest-VolumesActionsTest-1821143126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e89f91fe-51cd-48a2-a391-cc7378ea38bc 1073741824" returned: 0 in 1.006s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-495f1de9-16b7-4d0d-83cd-c39212df57e5 tempest-VolumesActionsTest-1821143126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e89f91fe-51cd-48a2-a391-cc7378ea38bc {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:56 devstack sudo[93518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e89f91fe-51cd-48a2-a391-cc7378ea38bc Jul 10 06:40:56 devstack sudo[93518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:56 devstack sudo[93510]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-cfaec611-f31c-4368-948f-1b0012ba767f tempest-AttachVolumeNegativeTest-501522069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8755029e-3182-47c0-869a-f3d229b759ba" returned: 0 in 0.793s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:56 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-cfaec611-f31c-4368-948f-1b0012ba767f tempest-AttachVolumeNegativeTest-501522069 None] Lock "cinder-quobyte-8755029e-3182-47c0-869a-f3d229b759ba" released by "delete_volume" :: held 1.958s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:40:57 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-cfaec611-f31c-4368-948f-1b0012ba767f tempest-AttachVolumeNegativeTest-501522069 None] Created reservations ['38c70331-07e4-4817-b5ba-487355842146', '849c057e-b764-4cbe-a24d-77e305ea373b', 'e5f8bcfc-1b03-45db-a45c-bc24cfe1efec', '6fcfe1ee-ac6a-46f5-afa9-9f453db46293'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:40:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-cfaec611-f31c-4368-948f-1b0012ba767f tempest-AttachVolumeNegativeTest-501522069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:40:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-cfaec611-f31c-4368-948f-1b0012ba767f tempest-AttachVolumeNegativeTest-501522069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:40:57 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-cfaec611-f31c-4368-948f-1b0012ba767f tempest-AttachVolumeNegativeTest-501522069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:40:57 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-cfaec611-f31c-4368-948f-1b0012ba767f tempest-AttachVolumeNegativeTest-501522069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:40:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-cfaec611-f31c-4368-948f-1b0012ba767f tempest-AttachVolumeNegativeTest-501522069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:40:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-cfaec611-f31c-4368-948f-1b0012ba767f tempest-AttachVolumeNegativeTest-501522069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:57 devstack sudo[93522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:40:57 devstack sudo[93522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:40:57 devstack sudo[93518]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-495f1de9-16b7-4d0d-83cd-c39212df57e5 tempest-VolumesActionsTest-1821143126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e89f91fe-51cd-48a2-a391-cc7378ea38bc" returned: 0 in 0.795s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:57 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-495f1de9-16b7-4d0d-83cd-c39212df57e5 tempest-VolumesActionsTest-1821143126 None] <== create_volume: return (1861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:40:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-495f1de9-16b7-4d0d-83cd-c39212df57e5 tempest-VolumesActionsTest-1821143126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.868s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:40:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-495f1de9-16b7-4d0d-83cd-c39212df57e5 tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1e6c321-1cd7-474a-96fb-16a61b03210b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e89f91fe-51cd-48a2-a391-cc7378ea38bc', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-495f1de9-16b7-4d0d-83cd-c39212df57e5 tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b115c4c-faf2-47eb-8c0b-2bd9dffd8673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:40:57 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-495f1de9-16b7-4d0d-83cd-c39212df57e5 tempest-VolumesActionsTest-1821143126 None] Volume volume-e89f91fe-51cd-48a2-a391-cc7378ea38bc (e89f91fe-51cd-48a2-a391-cc7378ea38bc): created successfully Jul 10 06:40:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-495f1de9-16b7-4d0d-83cd-c39212df57e5 tempest-VolumesActionsTest-1821143126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b115c4c-faf2-47eb-8c0b-2bd9dffd8673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:40:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-495f1de9-16b7-4d0d-83cd-c39212df57e5 tempest-VolumesActionsTest-1821143126 None] Flow 'volume_create_manager' (5b3e8ed7-9e39-4ae5-ad04-9572b1f5a40a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:40:57 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-495f1de9-16b7-4d0d-83cd-c39212df57e5 tempest-VolumesActionsTest-1821143126 None] Created volume successfully. Jul 10 06:40:57 devstack sudo[93522]: pam_unix(sudo:session): session closed for user root Jul 10 06:40:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-cfaec611-f31c-4368-948f-1b0012ba767f tempest-AttachVolumeNegativeTest-501522069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.823s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:40:57 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-cfaec611-f31c-4368-948f-1b0012ba767f tempest-AttachVolumeNegativeTest-501522069 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:40:58 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-cfaec611-f31c-4368-948f-1b0012ba767f tempest-AttachVolumeNegativeTest-501522069 None] Deleted volume successfully. Jul 10 06:40:58 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-cfaec611-f31c-4368-948f-1b0012ba767f tempest-AttachVolumeNegativeTest-501522069 None] Lock "cinder-8755029e-3182-47c0-869a-f3d229b759ba-delete_volume" released by "delete_volume" :: held 3.139s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:40:59 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-41c483fe-b9d9-4129-9844-f68a67c2a4c2 tempest-VolumesActionsTest-1821143126 None] Acquiring lock "cinder-e89f91fe-51cd-48a2-a391-cc7378ea38bc-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:40:59 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-41c483fe-b9d9-4129-9844-f68a67c2a4c2 tempest-VolumesActionsTest-1821143126 None] Lock "cinder-e89f91fe-51cd-48a2-a391-cc7378ea38bc-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:40:59 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-41c483fe-b9d9-4129-9844-f68a67c2a4c2 tempest-VolumesActionsTest-1821143126 None] Acquiring lock "cinder-quobyte-e89f91fe-51cd-48a2-a391-cc7378ea38bc" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:40:59 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-41c483fe-b9d9-4129-9844-f68a67c2a4c2 tempest-VolumesActionsTest-1821143126 None] Lock "cinder-quobyte-e89f91fe-51cd-48a2-a391-cc7378ea38bc" acquired by "delete_volume" :: waited 0.025s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:40:59 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c786141-e574-4214-ab7a-7428ea1977d2]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:40:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-41c483fe-b9d9-4129-9844-f68a67c2a4c2 tempest-VolumesActionsTest-1821143126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e89f91fe-51cd-48a2-a391-cc7378ea38bc {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:40:59 devstack sudo[93551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e89f91fe-51cd-48a2-a391-cc7378ea38bc Jul 10 06:40:59 devstack sudo[93551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:00 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-bdf94d45-fe02-4a75-94e4-6d59a696a060 tempest-GroupsV320Test-1067735393 None] Group tempest-GroupsV320Test-Group-1941312223: creating Jul 10 06:41:00 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-bdf94d45-fe02-4a75-94e4-6d59a696a060 tempest-GroupsV320Test-1067735393 None] Group tempest-GroupsV320Test-Group-1941312223: created successfully Jul 10 06:41:00 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-bdf94d45-fe02-4a75-94e4-6d59a696a060 tempest-GroupsV320Test-1067735393 None] Create group completed successfully. Jul 10 06:41:00 devstack sudo[93551]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-41c483fe-b9d9-4129-9844-f68a67c2a4c2 tempest-VolumesActionsTest-1821143126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e89f91fe-51cd-48a2-a391-cc7378ea38bc" returned: 0 in 1.106s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-41c483fe-b9d9-4129-9844-f68a67c2a4c2 tempest-VolumesActionsTest-1821143126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e89f91fe-51cd-48a2-a391-cc7378ea38bc {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:00 devstack sudo[93560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e89f91fe-51cd-48a2-a391-cc7378ea38bc Jul 10 06:41:00 devstack sudo[93560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:01 devstack sudo[93560]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-41c483fe-b9d9-4129-9844-f68a67c2a4c2 tempest-VolumesActionsTest-1821143126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e89f91fe-51cd-48a2-a391-cc7378ea38bc" returned: 0 in 0.729s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:01 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-41c483fe-b9d9-4129-9844-f68a67c2a4c2 tempest-VolumesActionsTest-1821143126 None] Lock "cinder-quobyte-e89f91fe-51cd-48a2-a391-cc7378ea38bc" released by "delete_volume" :: held 1.916s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:41:01 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-41c483fe-b9d9-4129-9844-f68a67c2a4c2 tempest-VolumesActionsTest-1821143126 None] Created reservations ['36c8f76b-bdf0-454b-9c64-cc3ff69fc95d', 'df4dc2d4-4a6a-463f-b2ef-0912b84dccda', 'b93eb5f4-24f8-49b4-9600-d4747dc0406b', '2d496d02-ebe2-4b6b-a717-cca42ca17543'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:41:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-41c483fe-b9d9-4129-9844-f68a67c2a4c2 tempest-VolumesActionsTest-1821143126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:41:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-41c483fe-b9d9-4129-9844-f68a67c2a4c2 tempest-VolumesActionsTest-1821143126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:41:01 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-41c483fe-b9d9-4129-9844-f68a67c2a4c2 tempest-VolumesActionsTest-1821143126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:41:01 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-41c483fe-b9d9-4129-9844-f68a67c2a4c2 tempest-VolumesActionsTest-1821143126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:41:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-41c483fe-b9d9-4129-9844-f68a67c2a4c2 tempest-VolumesActionsTest-1821143126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:41:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-41c483fe-b9d9-4129-9844-f68a67c2a4c2 tempest-VolumesActionsTest-1821143126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:01 devstack sudo[93563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:41:01 devstack sudo[93563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:02 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-ad017e51-6e74-430b-a540-50471cb6558e tempest-GroupsV320Test-1067735393 None] Created reservations ['58f49d3c-76da-4abf-81f9-97fb186a54b0'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:41:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ad017e51-6e74-430b-a540-50471cb6558e tempest-GroupsV320Test-1067735393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:41:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ad017e51-6e74-430b-a540-50471cb6558e tempest-GroupsV320Test-1067735393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:41:02 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-ad017e51-6e74-430b-a540-50471cb6558e tempest-GroupsV320Test-1067735393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:41:02 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-ad017e51-6e74-430b-a540-50471cb6558e tempest-GroupsV320Test-1067735393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:41:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ad017e51-6e74-430b-a540-50471cb6558e tempest-GroupsV320Test-1067735393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:41:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ad017e51-6e74-430b-a540-50471cb6558e tempest-GroupsV320Test-1067735393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:02 devstack sudo[93565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:41:02 devstack sudo[93565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:02 devstack sudo[93563]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-41c483fe-b9d9-4129-9844-f68a67c2a4c2 tempest-VolumesActionsTest-1821143126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.072s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:02 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-41c483fe-b9d9-4129-9844-f68a67c2a4c2 tempest-VolumesActionsTest-1821143126 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:41:02 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-41c483fe-b9d9-4129-9844-f68a67c2a4c2 tempest-VolumesActionsTest-1821143126 None] Deleted volume successfully. Jul 10 06:41:03 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-41c483fe-b9d9-4129-9844-f68a67c2a4c2 tempest-VolumesActionsTest-1821143126 None] Lock "cinder-e89f91fe-51cd-48a2-a391-cc7378ea38bc-delete_volume" released by "delete_volume" :: held 3.326s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:41:03 devstack sudo[93565]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ad017e51-6e74-430b-a540-50471cb6558e tempest-GroupsV320Test-1067735393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.899s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:03 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-ad017e51-6e74-430b-a540-50471cb6558e tempest-GroupsV320Test-1067735393 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:41:03 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-ad017e51-6e74-430b-a540-50471cb6558e tempest-GroupsV320Test-1067735393 None] Delete group completed successfully. Jul 10 06:41:07 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f6ed775b-75ee-45ee-af6b-b22655deafb6 tempest-ServerActionsTestOtherA-1099006734 None] Acquiring lock "cinder-43bc3936-47e0-40fb-b661-db6139ea5ad8-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:41:07 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f6ed775b-75ee-45ee-af6b-b22655deafb6 tempest-ServerActionsTestOtherA-1099006734 None] Lock "cinder-43bc3936-47e0-40fb-b661-db6139ea5ad8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:41:07 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:SELECT=94,cinder:UPDATE=102,cinder:INSERT=32,cinder:DELETE=8 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:41:07 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:SELECT=103,cinder:UPDATE=125,cinder:INSERT=18,cinder:DELETE=9 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:41:07 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f6ed775b-75ee-45ee-af6b-b22655deafb6 tempest-ServerActionsTestOtherA-1099006734 None] Acquiring lock "cinder-quobyte-43bc3936-47e0-40fb-b661-db6139ea5ad8" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:41:07 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f6ed775b-75ee-45ee-af6b-b22655deafb6 tempest-ServerActionsTestOtherA-1099006734 None] Lock "cinder-quobyte-43bc3936-47e0-40fb-b661-db6139ea5ad8" acquired by "delete_volume" :: waited 0.041s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:41:07 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1c410c-8f00-450d-b254-fa9036e83534]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:41:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f6ed775b-75ee-45ee-af6b-b22655deafb6 tempest-ServerActionsTestOtherA-1099006734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43bc3936-47e0-40fb-b661-db6139ea5ad8 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:07 devstack sudo[93572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43bc3936-47e0-40fb-b661-db6139ea5ad8 Jul 10 06:41:07 devstack sudo[93572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:07 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [req-2db8cff5-cd7d-4f8a-9574-6f6d3a58fed8 req-80d07c29-f5e4-4fb9-b37b-b456ea60d8a1 tempest-VolumesGetTestJSON-499648188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:41:07 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-2db8cff5-cd7d-4f8a-9574-6f6d3a58fed8 req-80d07c29-f5e4-4fb9-b37b-b456ea60d8a1 tempest-VolumesGetTestJSON-499648188 None] Flow 'volume_create_manager' (c807beea-955b-48ec-b743-713523a1589a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:41:08 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-2db8cff5-cd7d-4f8a-9574-6f6d3a58fed8 req-80d07c29-f5e4-4fb9-b37b-b456ea60d8a1 tempest-VolumesGetTestJSON-499648188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89e2c3e8-4093-4003-8e9c-6d1720255e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:08 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-2db8cff5-cd7d-4f8a-9574-6f6d3a58fed8 req-80d07c29-f5e4-4fb9-b37b-b456ea60d8a1 tempest-VolumesGetTestJSON-499648188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89e2c3e8-4093-4003-8e9c-6d1720255e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1224041495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e6e93c8-c348-4db3-a83a-3be8b291ecff,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='09d4d98f27df450c9be1b50825e6d31a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:41:08Z,use_quota=True,user_id='a94e6ea74d9d466e97d9c4199b0cfe11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:08 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-2db8cff5-cd7d-4f8a-9574-6f6d3a58fed8 req-80d07c29-f5e4-4fb9-b37b-b456ea60d8a1 tempest-VolumesGetTestJSON-499648188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df843c90-a9f3-4816-b74a-a0557e3fcae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:08 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-2db8cff5-cd7d-4f8a-9574-6f6d3a58fed8 req-80d07c29-f5e4-4fb9-b37b-b456ea60d8a1 tempest-VolumesGetTestJSON-499648188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df843c90-a9f3-4816-b74a-a0557e3fcae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:08 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-2db8cff5-cd7d-4f8a-9574-6f6d3a58fed8 req-80d07c29-f5e4-4fb9-b37b-b456ea60d8a1 tempest-VolumesGetTestJSON-499648188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1ddedc7-1171-4044-b516-c233b9a9f3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:08 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-2db8cff5-cd7d-4f8a-9574-6f6d3a58fed8 req-80d07c29-f5e4-4fb9-b37b-b456ea60d8a1 tempest-VolumesGetTestJSON-499648188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1ddedc7-1171-4044-b516-c233b9a9f3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e6e93c8-c348-4db3-a83a-3be8b291ecff', 'volume_name': 'volume-6e6e93c8-c348-4db3-a83a-3be8b291ecff', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:08 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-2db8cff5-cd7d-4f8a-9574-6f6d3a58fed8 req-80d07c29-f5e4-4fb9-b37b-b456ea60d8a1 tempest-VolumesGetTestJSON-499648188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1acfeca9-6cd0-4de0-8f73-f06911743828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:08 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-2db8cff5-cd7d-4f8a-9574-6f6d3a58fed8 req-80d07c29-f5e4-4fb9-b37b-b456ea60d8a1 tempest-VolumesGetTestJSON-499648188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1acfeca9-6cd0-4de0-8f73-f06911743828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:08 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-2db8cff5-cd7d-4f8a-9574-6f6d3a58fed8 req-80d07c29-f5e4-4fb9-b37b-b456ea60d8a1 tempest-VolumesGetTestJSON-499648188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16245fe0-89cf-43b8-b2c6-6b57c758139d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:08 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [req-2db8cff5-cd7d-4f8a-9574-6f6d3a58fed8 req-80d07c29-f5e4-4fb9-b37b-b456ea60d8a1 tempest-VolumesGetTestJSON-499648188 None] Volume 6e6e93c8-c348-4db3-a83a-3be8b291ecff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e6e93c8-c348-4db3-a83a-3be8b291ecff', 'volume_size': 1} Jul 10 06:41:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-2db8cff5-cd7d-4f8a-9574-6f6d3a58fed8 req-80d07c29-f5e4-4fb9-b37b-b456ea60d8a1 tempest-VolumesGetTestJSON-499648188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:41:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-2db8cff5-cd7d-4f8a-9574-6f6d3a58fed8 req-80d07c29-f5e4-4fb9-b37b-b456ea60d8a1 tempest-VolumesGetTestJSON-499648188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:41:08 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [req-2db8cff5-cd7d-4f8a-9574-6f6d3a58fed8 req-80d07c29-f5e4-4fb9-b37b-b456ea60d8a1 tempest-VolumesGetTestJSON-499648188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1224041495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e6e93c8-c348-4db3-a83a-3be8b291ecff,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='09d4d98f27df450c9be1b50825e6d31a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:41:08Z,use_quota=True,user_id='a94e6ea74d9d466e97d9c4199b0cfe11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:41:08 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [req-2db8cff5-cd7d-4f8a-9574-6f6d3a58fed8 req-80d07c29-f5e4-4fb9-b37b-b456ea60d8a1 tempest-VolumesGetTestJSON-499648188 None] Creating volume 6e6e93c8-c348-4db3-a83a-3be8b291ecff {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:41:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-2db8cff5-cd7d-4f8a-9574-6f6d3a58fed8 req-80d07c29-f5e4-4fb9-b37b-b456ea60d8a1 tempest-VolumesGetTestJSON-499648188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:41:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-2db8cff5-cd7d-4f8a-9574-6f6d3a58fed8 req-80d07c29-f5e4-4fb9-b37b-b456ea60d8a1 tempest-VolumesGetTestJSON-499648188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:41:08 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [req-2db8cff5-cd7d-4f8a-9574-6f6d3a58fed8 req-80d07c29-f5e4-4fb9-b37b-b456ea60d8a1 tempest-VolumesGetTestJSON-499648188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:41:08 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [req-2db8cff5-cd7d-4f8a-9574-6f6d3a58fed8 req-80d07c29-f5e4-4fb9-b37b-b456ea60d8a1 tempest-VolumesGetTestJSON-499648188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:41:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-2db8cff5-cd7d-4f8a-9574-6f6d3a58fed8 req-80d07c29-f5e4-4fb9-b37b-b456ea60d8a1 tempest-VolumesGetTestJSON-499648188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:41:08 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [req-2db8cff5-cd7d-4f8a-9574-6f6d3a58fed8 req-80d07c29-f5e4-4fb9-b37b-b456ea60d8a1 tempest-VolumesGetTestJSON-499648188 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:41:08 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [req-2db8cff5-cd7d-4f8a-9574-6f6d3a58fed8 req-80d07c29-f5e4-4fb9-b37b-b456ea60d8a1 tempest-VolumesGetTestJSON-499648188 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:41:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-2db8cff5-cd7d-4f8a-9574-6f6d3a58fed8 req-80d07c29-f5e4-4fb9-b37b-b456ea60d8a1 tempest-VolumesGetTestJSON-499648188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6e6e93c8-c348-4db3-a83a-3be8b291ecff 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:08 devstack sudo[93574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6e6e93c8-c348-4db3-a83a-3be8b291ecff 1073741824 Jul 10 06:41:08 devstack sudo[93574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:08 devstack sudo[93572]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f6ed775b-75ee-45ee-af6b-b22655deafb6 tempest-ServerActionsTestOtherA-1099006734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43bc3936-47e0-40fb-b661-db6139ea5ad8" returned: 0 in 1.155s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f6ed775b-75ee-45ee-af6b-b22655deafb6 tempest-ServerActionsTestOtherA-1099006734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43bc3936-47e0-40fb-b661-db6139ea5ad8 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:08 devstack sudo[93579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43bc3936-47e0-40fb-b661-db6139ea5ad8 Jul 10 06:41:08 devstack sudo[93579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:09 devstack sudo[93574]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-2db8cff5-cd7d-4f8a-9574-6f6d3a58fed8 req-80d07c29-f5e4-4fb9-b37b-b456ea60d8a1 tempest-VolumesGetTestJSON-499648188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6e6e93c8-c348-4db3-a83a-3be8b291ecff 1073741824" returned: 0 in 1.071s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-2db8cff5-cd7d-4f8a-9574-6f6d3a58fed8 req-80d07c29-f5e4-4fb9-b37b-b456ea60d8a1 tempest-VolumesGetTestJSON-499648188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6e6e93c8-c348-4db3-a83a-3be8b291ecff {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:09 devstack sudo[93579]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f6ed775b-75ee-45ee-af6b-b22655deafb6 tempest-ServerActionsTestOtherA-1099006734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43bc3936-47e0-40fb-b661-db6139ea5ad8" returned: 0 in 0.774s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:09 devstack sudo[93588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6e6e93c8-c348-4db3-a83a-3be8b291ecff Jul 10 06:41:09 devstack sudo[93588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:09 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f6ed775b-75ee-45ee-af6b-b22655deafb6 tempest-ServerActionsTestOtherA-1099006734 None] Lock "cinder-quobyte-43bc3936-47e0-40fb-b661-db6139ea5ad8" released by "delete_volume" :: held 1.991s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:41:09 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-f6ed775b-75ee-45ee-af6b-b22655deafb6 tempest-ServerActionsTestOtherA-1099006734 None] Created reservations ['9abeff5b-d34f-4208-a893-c6a3b6a879d2', '1aed6873-ba06-4c32-9c31-4e9bd7776462', '8ccb866e-c1c3-433a-bf57-f72cf4c43047', '7cbb4be5-8c40-45de-b088-a5cfda7fcef9'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:41:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f6ed775b-75ee-45ee-af6b-b22655deafb6 tempest-ServerActionsTestOtherA-1099006734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:41:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f6ed775b-75ee-45ee-af6b-b22655deafb6 tempest-ServerActionsTestOtherA-1099006734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:41:09 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f6ed775b-75ee-45ee-af6b-b22655deafb6 tempest-ServerActionsTestOtherA-1099006734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:41:09 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f6ed775b-75ee-45ee-af6b-b22655deafb6 tempest-ServerActionsTestOtherA-1099006734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:41:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f6ed775b-75ee-45ee-af6b-b22655deafb6 tempest-ServerActionsTestOtherA-1099006734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:41:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f6ed775b-75ee-45ee-af6b-b22655deafb6 tempest-ServerActionsTestOtherA-1099006734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:09 devstack sudo[93590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:41:09 devstack sudo[93590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:10 devstack sudo[93588]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-2db8cff5-cd7d-4f8a-9574-6f6d3a58fed8 req-80d07c29-f5e4-4fb9-b37b-b456ea60d8a1 tempest-VolumesGetTestJSON-499648188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6e6e93c8-c348-4db3-a83a-3be8b291ecff" returned: 0 in 0.831s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:10 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [req-2db8cff5-cd7d-4f8a-9574-6f6d3a58fed8 req-80d07c29-f5e4-4fb9-b37b-b456ea60d8a1 tempest-VolumesGetTestJSON-499648188 None] <== create_volume: return (1962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:41:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-2db8cff5-cd7d-4f8a-9574-6f6d3a58fed8 req-80d07c29-f5e4-4fb9-b37b-b456ea60d8a1 tempest-VolumesGetTestJSON-499648188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.965s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:41:10 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-2db8cff5-cd7d-4f8a-9574-6f6d3a58fed8 req-80d07c29-f5e4-4fb9-b37b-b456ea60d8a1 tempest-VolumesGetTestJSON-499648188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16245fe0-89cf-43b8-b2c6-6b57c758139d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e6e93c8-c348-4db3-a83a-3be8b291ecff', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:10 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-2db8cff5-cd7d-4f8a-9574-6f6d3a58fed8 req-80d07c29-f5e4-4fb9-b37b-b456ea60d8a1 tempest-VolumesGetTestJSON-499648188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d62e830-c723-4da1-be94-bbf76f767203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:10 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [req-2db8cff5-cd7d-4f8a-9574-6f6d3a58fed8 req-80d07c29-f5e4-4fb9-b37b-b456ea60d8a1 tempest-VolumesGetTestJSON-499648188 None] Volume volume-6e6e93c8-c348-4db3-a83a-3be8b291ecff (6e6e93c8-c348-4db3-a83a-3be8b291ecff): created successfully Jul 10 06:41:10 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-2db8cff5-cd7d-4f8a-9574-6f6d3a58fed8 req-80d07c29-f5e4-4fb9-b37b-b456ea60d8a1 tempest-VolumesGetTestJSON-499648188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d62e830-c723-4da1-be94-bbf76f767203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:10 devstack sudo[93590]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:10 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-2db8cff5-cd7d-4f8a-9574-6f6d3a58fed8 req-80d07c29-f5e4-4fb9-b37b-b456ea60d8a1 tempest-VolumesGetTestJSON-499648188 None] Flow 'volume_create_manager' (c807beea-955b-48ec-b743-713523a1589a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:41:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f6ed775b-75ee-45ee-af6b-b22655deafb6 tempest-ServerActionsTestOtherA-1099006734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.734s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:10 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-f6ed775b-75ee-45ee-af6b-b22655deafb6 tempest-ServerActionsTestOtherA-1099006734 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:41:10 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-f6ed775b-75ee-45ee-af6b-b22655deafb6 tempest-ServerActionsTestOtherA-1099006734 None] Deleted volume successfully. Jul 10 06:41:10 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-2db8cff5-cd7d-4f8a-9574-6f6d3a58fed8 req-80d07c29-f5e4-4fb9-b37b-b456ea60d8a1 tempest-VolumesGetTestJSON-499648188 None] Created volume successfully. Jul 10 06:41:10 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f6ed775b-75ee-45ee-af6b-b22655deafb6 tempest-ServerActionsTestOtherA-1099006734 None] Lock "cinder-43bc3936-47e0-40fb-b661-db6139ea5ad8-delete_volume" released by "delete_volume" :: held 3.076s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:41:11 devstack cinder-volume[87294]: DEBUG cinder.coordination [req-0afef4cc-711e-482a-8d6d-83511152115a req-cb916484-395d-4ce7-a266-da503624293f tempest-VolumesGetTestJSON-499648188 None] Acquiring lock "cinder-6e6e93c8-c348-4db3-a83a-3be8b291ecff-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:41:11 devstack cinder-volume[87294]: DEBUG cinder.coordination [req-0afef4cc-711e-482a-8d6d-83511152115a req-cb916484-395d-4ce7-a266-da503624293f tempest-VolumesGetTestJSON-499648188 None] Lock "cinder-6e6e93c8-c348-4db3-a83a-3be8b291ecff-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:41:11 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-46e85686-7816-4793-8d0e-fc101c3407d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:41:11 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-46e85686-7816-4793-8d0e-fc101c3407d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Flow 'volume_create_manager' (6243db6b-9c8a-4f64-8a23-fb0137533215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:41:11 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-46e85686-7816-4793-8d0e-fc101c3407d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e084c817-9e72-4933-a9d8-997fa172cccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:11 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-46e85686-7816-4793-8d0e-fc101c3407d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e084c817-9e72-4933-a9d8-997fa172cccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-684270952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4c62c52-8ee8-4c92-9a2c-24422d1d1d53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e74aa47b0e24720ad61148fc4f1a2d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:41:12Z,use_quota=True,user_id='3cd27adf8aa74628878e3b45d8938b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:11 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-46e85686-7816-4793-8d0e-fc101c3407d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cec9bf9-34af-4663-aa20-c54b6b7e12ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:11 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-46e85686-7816-4793-8d0e-fc101c3407d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cec9bf9-34af-4663-aa20-c54b6b7e12ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:11 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-46e85686-7816-4793-8d0e-fc101c3407d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (177da883-5ee0-4803-a97b-31730258fb07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:11 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-46e85686-7816-4793-8d0e-fc101c3407d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (177da883-5ee0-4803-a97b-31730258fb07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4c62c52-8ee8-4c92-9a2c-24422d1d1d53', 'volume_name': 'volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:11 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-46e85686-7816-4793-8d0e-fc101c3407d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd7b12a3-3473-4208-a6cc-7d7453a3550d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:11 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-46e85686-7816-4793-8d0e-fc101c3407d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd7b12a3-3473-4208-a6cc-7d7453a3550d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:11 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-46e85686-7816-4793-8d0e-fc101c3407d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b1c56c1-83f7-4d04-acb6-47f30ae2193a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:11 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-46e85686-7816-4793-8d0e-fc101c3407d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Volume a4c62c52-8ee8-4c92-9a2c-24422d1d1d53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53', 'volume_size': 1} Jul 10 06:41:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-46e85686-7816-4793-8d0e-fc101c3407d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:41:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-46e85686-7816-4793-8d0e-fc101c3407d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:41:11 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-46e85686-7816-4793-8d0e-fc101c3407d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-684270952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4c62c52-8ee8-4c92-9a2c-24422d1d1d53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e74aa47b0e24720ad61148fc4f1a2d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:41:12Z,use_quota=True,user_id='3cd27adf8aa74628878e3b45d8938b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:41:11 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-46e85686-7816-4793-8d0e-fc101c3407d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Creating volume a4c62c52-8ee8-4c92-9a2c-24422d1d1d53 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:41:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-46e85686-7816-4793-8d0e-fc101c3407d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:41:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-46e85686-7816-4793-8d0e-fc101c3407d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:41:11 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-46e85686-7816-4793-8d0e-fc101c3407d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:41:11 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-46e85686-7816-4793-8d0e-fc101c3407d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:41:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-46e85686-7816-4793-8d0e-fc101c3407d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:41:11 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-46e85686-7816-4793-8d0e-fc101c3407d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:41:11 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-46e85686-7816-4793-8d0e-fc101c3407d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:41:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-46e85686-7816-4793-8d0e-fc101c3407d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:11 devstack cinder-volume[87294]: DEBUG cinder.coordination [req-0afef4cc-711e-482a-8d6d-83511152115a req-cb916484-395d-4ce7-a266-da503624293f tempest-VolumesGetTestJSON-499648188 None] Acquiring lock "cinder-quobyte-6e6e93c8-c348-4db3-a83a-3be8b291ecff" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:41:11 devstack sudo[93601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53 1073741824 Jul 10 06:41:11 devstack sudo[93601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:11 devstack cinder-volume[87294]: DEBUG cinder.coordination [req-0afef4cc-711e-482a-8d6d-83511152115a req-cb916484-395d-4ce7-a266-da503624293f tempest-VolumesGetTestJSON-499648188 None] Lock "cinder-quobyte-6e6e93c8-c348-4db3-a83a-3be8b291ecff" acquired by "delete_volume" :: waited 0.032s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:41:11 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[508b6fbc-d41a-481c-a04a-38fccb31a91a]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:41:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-0afef4cc-711e-482a-8d6d-83511152115a req-cb916484-395d-4ce7-a266-da503624293f tempest-VolumesGetTestJSON-499648188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6e6e93c8-c348-4db3-a83a-3be8b291ecff {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:12 devstack sudo[93604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6e6e93c8-c348-4db3-a83a-3be8b291ecff Jul 10 06:41:12 devstack sudo[93604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:12 devstack sudo[93604]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-0afef4cc-711e-482a-8d6d-83511152115a req-cb916484-395d-4ce7-a266-da503624293f tempest-VolumesGetTestJSON-499648188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6e6e93c8-c348-4db3-a83a-3be8b291ecff" returned: 0 in 0.974s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-0afef4cc-711e-482a-8d6d-83511152115a req-cb916484-395d-4ce7-a266-da503624293f tempest-VolumesGetTestJSON-499648188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6e6e93c8-c348-4db3-a83a-3be8b291ecff {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:12 devstack sudo[93628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6e6e93c8-c348-4db3-a83a-3be8b291ecff Jul 10 06:41:12 devstack sudo[93628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:13 devstack sudo[93601]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-46e85686-7816-4793-8d0e-fc101c3407d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53 1073741824" returned: 0 in 1.239s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-46e85686-7816-4793-8d0e-fc101c3407d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:13 devstack sudo[93631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53 Jul 10 06:41:13 devstack sudo[93631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:13 devstack sudo[93628]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-0afef4cc-711e-482a-8d6d-83511152115a req-cb916484-395d-4ce7-a266-da503624293f tempest-VolumesGetTestJSON-499648188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6e6e93c8-c348-4db3-a83a-3be8b291ecff" returned: 0 in 0.926s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:13 devstack cinder-volume[87294]: DEBUG cinder.coordination [req-0afef4cc-711e-482a-8d6d-83511152115a req-cb916484-395d-4ce7-a266-da503624293f tempest-VolumesGetTestJSON-499648188 None] Lock "cinder-quobyte-6e6e93c8-c348-4db3-a83a-3be8b291ecff" released by "delete_volume" :: held 1.966s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:41:14 devstack cinder-volume[87294]: DEBUG cinder.quota [req-0afef4cc-711e-482a-8d6d-83511152115a req-cb916484-395d-4ce7-a266-da503624293f tempest-VolumesGetTestJSON-499648188 None] Created reservations ['c7a14cb1-54f4-4e0c-a9da-3723337a791e', 'f3143850-cd87-4cda-9dc7-1f23f89b6a9d', 'fae80c54-23e9-4794-9b29-b01209e45bc8', '704a9fd5-7353-43f7-bcba-0494dd78be90'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:41:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-0afef4cc-711e-482a-8d6d-83511152115a req-cb916484-395d-4ce7-a266-da503624293f tempest-VolumesGetTestJSON-499648188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:41:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-0afef4cc-711e-482a-8d6d-83511152115a req-cb916484-395d-4ce7-a266-da503624293f tempest-VolumesGetTestJSON-499648188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:41:14 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [req-0afef4cc-711e-482a-8d6d-83511152115a req-cb916484-395d-4ce7-a266-da503624293f tempest-VolumesGetTestJSON-499648188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:41:14 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [req-0afef4cc-711e-482a-8d6d-83511152115a req-cb916484-395d-4ce7-a266-da503624293f tempest-VolumesGetTestJSON-499648188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:41:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-0afef4cc-711e-482a-8d6d-83511152115a req-cb916484-395d-4ce7-a266-da503624293f tempest-VolumesGetTestJSON-499648188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:41:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-0afef4cc-711e-482a-8d6d-83511152115a req-cb916484-395d-4ce7-a266-da503624293f tempest-VolumesGetTestJSON-499648188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:14 devstack sudo[93631]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-46e85686-7816-4793-8d0e-fc101c3407d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53" returned: 0 in 1.033s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:14 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-46e85686-7816-4793-8d0e-fc101c3407d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] <== create_volume: return (2336ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:41:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-46e85686-7816-4793-8d0e-fc101c3407d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.341s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:41:14 devstack sudo[93671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:41:14 devstack sudo[93671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:14 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-46e85686-7816-4793-8d0e-fc101c3407d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b1c56c1-83f7-4d04-acb6-47f30ae2193a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:14 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-46e85686-7816-4793-8d0e-fc101c3407d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcc79306-ccb6-439a-9a26-b977fd3fb7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:14 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-46e85686-7816-4793-8d0e-fc101c3407d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Volume volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53 (a4c62c52-8ee8-4c92-9a2c-24422d1d1d53): created successfully Jul 10 06:41:14 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-46e85686-7816-4793-8d0e-fc101c3407d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcc79306-ccb6-439a-9a26-b977fd3fb7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:14 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-46e85686-7816-4793-8d0e-fc101c3407d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Flow 'volume_create_manager' (6243db6b-9c8a-4f64-8a23-fb0137533215) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:41:14 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-46e85686-7816-4793-8d0e-fc101c3407d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Created volume successfully. Jul 10 06:41:14 devstack sudo[93671]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-0afef4cc-711e-482a-8d6d-83511152115a req-cb916484-395d-4ce7-a266-da503624293f tempest-VolumesGetTestJSON-499648188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.803s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:14 devstack cinder-volume[87294]: DEBUG cinder.manager [req-0afef4cc-711e-482a-8d6d-83511152115a req-cb916484-395d-4ce7-a266-da503624293f tempest-VolumesGetTestJSON-499648188 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:41:14 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-0afef4cc-711e-482a-8d6d-83511152115a req-cb916484-395d-4ce7-a266-da503624293f tempest-VolumesGetTestJSON-499648188 None] Deleted volume successfully. Jul 10 06:41:15 devstack cinder-volume[87294]: DEBUG cinder.coordination [req-0afef4cc-711e-482a-8d6d-83511152115a req-cb916484-395d-4ce7-a266-da503624293f tempest-VolumesGetTestJSON-499648188 None] Lock "cinder-6e6e93c8-c348-4db3-a83a-3be8b291ecff-delete_volume" released by "delete_volume" :: held 3.279s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:41:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-1a4dcd67-3f84-41e9-a1fe-b17e6937fd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:41:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-1a4dcd67-3f84-41e9-a1fe-b17e6937fd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:41:15 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-1a4dcd67-3f84-41e9-a1fe-b17e6937fd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Creating offline snapshot 263d1bcc-3aaa-421e-8ee2-d54c5b251e77 of volume a4c62c52-8ee8-4c92-9a2c-24422d1d1d53 {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:41:15 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[794df982-6a8c-4084-84f2-e6dbaef23125]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:41:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1a4dcd67-3f84-41e9-a1fe-b17e6937fd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:15 devstack sudo[93677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53 Jul 10 06:41:15 devstack sudo[93677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:16 devstack sudo[93677]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1a4dcd67-3f84-41e9-a1fe-b17e6937fd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53" returned: 0 in 0.948s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1a4dcd67-3f84-41e9-a1fe-b17e6937fd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53.263d1bcc-3aaa-421e-8ee2-d54c5b251e77 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:16 devstack sudo[93684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53.263d1bcc-3aaa-421e-8ee2-d54c5b251e77 1G Jul 10 06:41:16 devstack sudo[93684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:17 devstack sudo[93684]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1a4dcd67-3f84-41e9-a1fe-b17e6937fd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53.263d1bcc-3aaa-421e-8ee2-d54c5b251e77 1G" returned: 0 in 0.935s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1a4dcd67-3f84-41e9-a1fe-b17e6937fd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53.263d1bcc-3aaa-421e-8ee2-d54c5b251e77 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:17 devstack sudo[93690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53.263d1bcc-3aaa-421e-8ee2-d54c5b251e77 Jul 10 06:41:17 devstack sudo[93690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:18 devstack sudo[93690]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1a4dcd67-3f84-41e9-a1fe-b17e6937fd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53.263d1bcc-3aaa-421e-8ee2-d54c5b251e77" returned: 0 in 0.830s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:18 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-1a4dcd67-3f84-41e9-a1fe-b17e6937fd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53.263d1bcc-3aaa-421e-8ee2-d54c5b251e77 is being set with open permissions: ugo+rw Jul 10 06:41:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1a4dcd67-3f84-41e9-a1fe-b17e6937fd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53.263d1bcc-3aaa-421e-8ee2-d54c5b251e77 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:18 devstack sudo[93695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53.263d1bcc-3aaa-421e-8ee2-d54c5b251e77 Jul 10 06:41:18 devstack sudo[93695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:18 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b7cd4a5-7170-4c7d-afca-4ebbf3eee249 tempest-VolumesListAdminTestJSON-1964715607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:41:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-8b7cd4a5-7170-4c7d-afca-4ebbf3eee249 tempest-VolumesListAdminTestJSON-1964715607 None] Flow 'volume_create_manager' (dd0cebd8-b775-4577-a755-a138f68e7466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:41:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-8b7cd4a5-7170-4c7d-afca-4ebbf3eee249 tempest-VolumesListAdminTestJSON-1964715607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57e627ed-6ef4-4f65-bde5-08fb9ca9012f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-8b7cd4a5-7170-4c7d-afca-4ebbf3eee249 tempest-VolumesListAdminTestJSON-1964715607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57e627ed-6ef4-4f65-bde5-08fb9ca9012f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1781438633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62d7450b-cc7a-4826-bad0-ae7af14a32c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='171d848e61c246baa7374130c888d674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:41:18Z,use_quota=True,user_id='eb81f97f6f5f4fbba84a4d334a295c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-8b7cd4a5-7170-4c7d-afca-4ebbf3eee249 tempest-VolumesListAdminTestJSON-1964715607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6626cf21-5fdd-4957-9c94-dc6c5a1d92b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-8b7cd4a5-7170-4c7d-afca-4ebbf3eee249 tempest-VolumesListAdminTestJSON-1964715607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6626cf21-5fdd-4957-9c94-dc6c5a1d92b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-8b7cd4a5-7170-4c7d-afca-4ebbf3eee249 tempest-VolumesListAdminTestJSON-1964715607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cad76d97-7022-4430-9024-46c0d068aae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-8b7cd4a5-7170-4c7d-afca-4ebbf3eee249 tempest-VolumesListAdminTestJSON-1964715607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cad76d97-7022-4430-9024-46c0d068aae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62d7450b-cc7a-4826-bad0-ae7af14a32c8', 'volume_name': 'volume-62d7450b-cc7a-4826-bad0-ae7af14a32c8', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-8b7cd4a5-7170-4c7d-afca-4ebbf3eee249 tempest-VolumesListAdminTestJSON-1964715607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17855831-d8f9-4528-8fc4-69411bfe16e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-8b7cd4a5-7170-4c7d-afca-4ebbf3eee249 tempest-VolumesListAdminTestJSON-1964715607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17855831-d8f9-4528-8fc4-69411bfe16e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-8b7cd4a5-7170-4c7d-afca-4ebbf3eee249 tempest-VolumesListAdminTestJSON-1964715607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64fc451f-53d3-4c30-8e57-2b5e5ca6432c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:18 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-8b7cd4a5-7170-4c7d-afca-4ebbf3eee249 tempest-VolumesListAdminTestJSON-1964715607 None] Volume 62d7450b-cc7a-4826-bad0-ae7af14a32c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62d7450b-cc7a-4826-bad0-ae7af14a32c8', 'volume_size': 1} Jul 10 06:41:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-8b7cd4a5-7170-4c7d-afca-4ebbf3eee249 tempest-VolumesListAdminTestJSON-1964715607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:41:18 devstack sudo[93695]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1a4dcd67-3f84-41e9-a1fe-b17e6937fd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53.263d1bcc-3aaa-421e-8ee2-d54c5b251e77" returned: 0 in 0.698s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1a4dcd67-3f84-41e9-a1fe-b17e6937fd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:18 devstack sudo[93698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53.info Jul 10 06:41:18 devstack sudo[93698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:19 devstack sudo[93698]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1a4dcd67-3f84-41e9-a1fe-b17e6937fd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53.info" returned: 0 in 0.729s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:19 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-1a4dcd67-3f84-41e9-a1fe-b17e6937fd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53.info is being set with open permissions: ugo+rw Jul 10 06:41:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1a4dcd67-3f84-41e9-a1fe-b17e6937fd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:19 devstack sudo[93702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53.info Jul 10 06:41:19 devstack sudo[93702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:19 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-ea2eb38a-b303-412c-9796-64c5a7183ce7 tempest-GroupSnapshotsV319Test-1313993213 None] Group tempest-GroupSnapshotsV319Test-Group-1774162362: creating Jul 10 06:41:19 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-ea2eb38a-b303-412c-9796-64c5a7183ce7 tempest-GroupSnapshotsV319Test-1313993213 None] Group tempest-GroupSnapshotsV319Test-Group-1774162362: created successfully Jul 10 06:41:19 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-ea2eb38a-b303-412c-9796-64c5a7183ce7 tempest-GroupSnapshotsV319Test-1313993213 None] Create group completed successfully. Jul 10 06:41:20 devstack sudo[93702]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1a4dcd67-3f84-41e9-a1fe-b17e6937fd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53.info" returned: 0 in 0.699s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-1a4dcd67-3f84-41e9-a1fe-b17e6937fd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.939s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:41:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-8b7cd4a5-7170-4c7d-afca-4ebbf3eee249 tempest-VolumesListAdminTestJSON-1964715607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.943s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:41:20 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-8b7cd4a5-7170-4c7d-afca-4ebbf3eee249 tempest-VolumesListAdminTestJSON-1964715607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:41:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1781438633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62d7450b-cc7a-4826-bad0-ae7af14a32c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='171d848e61c246baa7374130c888d674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:41:18Z,use_quota=True,user_id='eb81f97f6f5f4fbba84a4d334a295c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:41:20 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-8b7cd4a5-7170-4c7d-afca-4ebbf3eee249 tempest-VolumesListAdminTestJSON-1964715607 None] Creating volume 62d7450b-cc7a-4826-bad0-ae7af14a32c8 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:41:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-8b7cd4a5-7170-4c7d-afca-4ebbf3eee249 tempest-VolumesListAdminTestJSON-1964715607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:41:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-8b7cd4a5-7170-4c7d-afca-4ebbf3eee249 tempest-VolumesListAdminTestJSON-1964715607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:41:20 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-8b7cd4a5-7170-4c7d-afca-4ebbf3eee249 tempest-VolumesListAdminTestJSON-1964715607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:41:20 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-8b7cd4a5-7170-4c7d-afca-4ebbf3eee249 tempest-VolumesListAdminTestJSON-1964715607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:41:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-8b7cd4a5-7170-4c7d-afca-4ebbf3eee249 tempest-VolumesListAdminTestJSON-1964715607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:41:20 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-8b7cd4a5-7170-4c7d-afca-4ebbf3eee249 tempest-VolumesListAdminTestJSON-1964715607 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:41:20 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-8b7cd4a5-7170-4c7d-afca-4ebbf3eee249 tempest-VolumesListAdminTestJSON-1964715607 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:41:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8b7cd4a5-7170-4c7d-afca-4ebbf3eee249 tempest-VolumesListAdminTestJSON-1964715607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-62d7450b-cc7a-4826-bad0-ae7af14a32c8 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:20 devstack sudo[93705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-62d7450b-cc7a-4826-bad0-ae7af14a32c8 1073741824 Jul 10 06:41:20 devstack sudo[93705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:20 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-1a4dcd67-3f84-41e9-a1fe-b17e6937fd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Create snapshot completed successfully Jul 10 06:41:21 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-296f6586-2ca3-4979-b6f7-8a74c56fb3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Acquiring lock "cinder-263d1bcc-3aaa-421e-8ee2-d54c5b251e77-delete_snapshot" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:41:21 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-296f6586-2ca3-4979-b6f7-8a74c56fb3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Lock "cinder-263d1bcc-3aaa-421e-8ee2-d54c5b251e77-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:41:21 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-296f6586-2ca3-4979-b6f7-8a74c56fb3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Acquiring lock "cinder-quobyte-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:41:21 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-296f6586-2ca3-4979-b6f7-8a74c56fb3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Lock "cinder-quobyte-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:41:21 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-296f6586-2ca3-4979-b6f7-8a74c56fb3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Acquiring lock "cinder-quobyte-263d1bcc-3aaa-421e-8ee2-d54c5b251e77" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:41:21 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-296f6586-2ca3-4979-b6f7-8a74c56fb3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Lock "cinder-quobyte-263d1bcc-3aaa-421e-8ee2-d54c5b251e77" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:41:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-296f6586-2ca3-4979-b6f7-8a74c56fb3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Deleting offline snapshot 263d1bcc-3aaa-421e-8ee2-d54c5b251e77 of volume a4c62c52-8ee8-4c92-9a2c-24422d1d1d53 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:41:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-296f6586-2ca3-4979-b6f7-8a74c56fb3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] snapshot_file for this snap is: volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53.263d1bcc-3aaa-421e-8ee2-d54c5b251e77 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:41:21 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[2809207e-875d-46fe-8d18-6538482d4984]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:41:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-296f6586-2ca3-4979-b6f7-8a74c56fb3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53.263d1bcc-3aaa-421e-8ee2-d54c5b251e77 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:21 devstack sudo[93705]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8b7cd4a5-7170-4c7d-afca-4ebbf3eee249 tempest-VolumesListAdminTestJSON-1964715607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-62d7450b-cc7a-4826-bad0-ae7af14a32c8 1073741824" returned: 0 in 1.160s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8b7cd4a5-7170-4c7d-afca-4ebbf3eee249 tempest-VolumesListAdminTestJSON-1964715607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-62d7450b-cc7a-4826-bad0-ae7af14a32c8 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:21 devstack sudo[93713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-62d7450b-cc7a-4826-bad0-ae7af14a32c8 Jul 10 06:41:21 devstack sudo[93713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:21 devstack sudo[93712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53.263d1bcc-3aaa-421e-8ee2-d54c5b251e77 Jul 10 06:41:21 devstack sudo[93712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:21 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-146fcdd2-cc07-4f2c-89a0-7b0570576576 tempest-GroupSnapshotsV319Test-1313993213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:41:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-146fcdd2-cc07-4f2c-89a0-7b0570576576 tempest-GroupSnapshotsV319Test-1313993213 None] Flow 'volume_create_manager' (1086ce1c-ea8e-4563-9fbe-855d389b732e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:41:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-146fcdd2-cc07-4f2c-89a0-7b0570576576 tempest-GroupSnapshotsV319Test-1313993213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87063eeb-6e5b-43f9-8ab5-ce77bc8640d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-146fcdd2-cc07-4f2c-89a0-7b0570576576 tempest-GroupSnapshotsV319Test-1313993213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87063eeb-6e5b-43f9-8ab5-ce77bc8640d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-203704355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a3eca4b8-bdd9-4fa8-bb91-95bd1fe6904c,host='devstack@QuobyteHD#QuobyteHD',id=f91c4902-2a4c-4a2a-9c24-36fcc0a455f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a6df586dcb64f37b4afd38085bfdb50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:41:22Z,use_quota=True,user_id='7b5255f7fe58462c83150bdab56084e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fba98ed-c1ac-49ca-ad9e-9c73f5e1a780),volume_type_id=3fba98ed-c1ac-49ca-ad9e-9c73f5e1a780)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-146fcdd2-cc07-4f2c-89a0-7b0570576576 tempest-GroupSnapshotsV319Test-1313993213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c7c1f78-2661-487d-8e95-a0303a0473b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-146fcdd2-cc07-4f2c-89a0-7b0570576576 tempest-GroupSnapshotsV319Test-1313993213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c7c1f78-2661-487d-8e95-a0303a0473b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-146fcdd2-cc07-4f2c-89a0-7b0570576576 tempest-GroupSnapshotsV319Test-1313993213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (147caf73-c418-4568-8dff-9acf5c12a204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-146fcdd2-cc07-4f2c-89a0-7b0570576576 tempest-GroupSnapshotsV319Test-1313993213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (147caf73-c418-4568-8dff-9acf5c12a204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f91c4902-2a4c-4a2a-9c24-36fcc0a455f5', 'volume_name': 'volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-146fcdd2-cc07-4f2c-89a0-7b0570576576 tempest-GroupSnapshotsV319Test-1313993213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da67b7cb-59cb-476a-8bd6-6b63e2f4ccc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-146fcdd2-cc07-4f2c-89a0-7b0570576576 tempest-GroupSnapshotsV319Test-1313993213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da67b7cb-59cb-476a-8bd6-6b63e2f4ccc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-146fcdd2-cc07-4f2c-89a0-7b0570576576 tempest-GroupSnapshotsV319Test-1313993213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cc87a00-4542-4e5d-8ba6-99d033ca80a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:21 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-146fcdd2-cc07-4f2c-89a0-7b0570576576 tempest-GroupSnapshotsV319Test-1313993213 None] Volume f91c4902-2a4c-4a2a-9c24-36fcc0a455f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5', 'volume_size': 1} Jul 10 06:41:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-146fcdd2-cc07-4f2c-89a0-7b0570576576 tempest-GroupSnapshotsV319Test-1313993213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:41:21 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:41:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:41:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:41:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:41:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:41:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:41:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:21 devstack sudo[93716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:41:21 devstack sudo[93716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:22 devstack sudo[93713]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8b7cd4a5-7170-4c7d-afca-4ebbf3eee249 tempest-VolumesListAdminTestJSON-1964715607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-62d7450b-cc7a-4826-bad0-ae7af14a32c8" returned: 0 in 0.745s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:22 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-8b7cd4a5-7170-4c7d-afca-4ebbf3eee249 tempest-VolumesListAdminTestJSON-1964715607 None] <== create_volume: return (1980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:41:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-8b7cd4a5-7170-4c7d-afca-4ebbf3eee249 tempest-VolumesListAdminTestJSON-1964715607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.983s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:41:22 devstack sudo[93712]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-146fcdd2-cc07-4f2c-89a0-7b0570576576 tempest-GroupSnapshotsV319Test-1313993213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.600s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:41:22 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-146fcdd2-cc07-4f2c-89a0-7b0570576576 tempest-GroupSnapshotsV319Test-1313993213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a3eca4b8-bdd9-4fa8-bb91-95bd1fe6904c,created_at=2026-07-10T04:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-203704355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a3eca4b8-bdd9-4fa8-bb91-95bd1fe6904c,host='devstack@QuobyteHD#QuobyteHD',id=f91c4902-2a4c-4a2a-9c24-36fcc0a455f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a6df586dcb64f37b4afd38085bfdb50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:41:22Z,use_quota=True,user_id='7b5255f7fe58462c83150bdab56084e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3fba98ed-c1ac-49ca-ad9e-9c73f5e1a780),volume_type_id=3fba98ed-c1ac-49ca-ad9e-9c73f5e1a780)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:41:22 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-146fcdd2-cc07-4f2c-89a0-7b0570576576 tempest-GroupSnapshotsV319Test-1313993213 None] Creating volume f91c4902-2a4c-4a2a-9c24-36fcc0a455f5 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:41:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-146fcdd2-cc07-4f2c-89a0-7b0570576576 tempest-GroupSnapshotsV319Test-1313993213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:41:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-146fcdd2-cc07-4f2c-89a0-7b0570576576 tempest-GroupSnapshotsV319Test-1313993213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:41:22 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-146fcdd2-cc07-4f2c-89a0-7b0570576576 tempest-GroupSnapshotsV319Test-1313993213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:41:22 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-146fcdd2-cc07-4f2c-89a0-7b0570576576 tempest-GroupSnapshotsV319Test-1313993213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:41:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-146fcdd2-cc07-4f2c-89a0-7b0570576576 tempest-GroupSnapshotsV319Test-1313993213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:41:22 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-146fcdd2-cc07-4f2c-89a0-7b0570576576 tempest-GroupSnapshotsV319Test-1313993213 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:41:22 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-146fcdd2-cc07-4f2c-89a0-7b0570576576 tempest-GroupSnapshotsV319Test-1313993213 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:41:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-146fcdd2-cc07-4f2c-89a0-7b0570576576 tempest-GroupSnapshotsV319Test-1313993213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-296f6586-2ca3-4979-b6f7-8a74c56fb3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53.263d1bcc-3aaa-421e-8ee2-d54c5b251e77" returned: 0 in 0.905s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:22 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-296f6586-2ca3-4979-b6f7-8a74c56fb3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:41:22 devstack sudo[93723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5 1073741824 Jul 10 06:41:22 devstack sudo[93723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-8b7cd4a5-7170-4c7d-afca-4ebbf3eee249 tempest-VolumesListAdminTestJSON-1964715607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64fc451f-53d3-4c30-8e57-2b5e5ca6432c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62d7450b-cc7a-4826-bad0-ae7af14a32c8', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-8b7cd4a5-7170-4c7d-afca-4ebbf3eee249 tempest-VolumesListAdminTestJSON-1964715607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab6301ba-486f-4ab6-9c82-e30d9544f3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:22 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f320b6-e360-438d-b560-9682d489130f]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:41:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-296f6586-2ca3-4979-b6f7-8a74c56fb3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:22 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-8b7cd4a5-7170-4c7d-afca-4ebbf3eee249 tempest-VolumesListAdminTestJSON-1964715607 None] Volume volume-62d7450b-cc7a-4826-bad0-ae7af14a32c8 (62d7450b-cc7a-4826-bad0-ae7af14a32c8): created successfully Jul 10 06:41:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-8b7cd4a5-7170-4c7d-afca-4ebbf3eee249 tempest-VolumesListAdminTestJSON-1964715607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab6301ba-486f-4ab6-9c82-e30d9544f3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-8b7cd4a5-7170-4c7d-afca-4ebbf3eee249 tempest-VolumesListAdminTestJSON-1964715607 None] Flow 'volume_create_manager' (dd0cebd8-b775-4577-a755-a138f68e7466) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:41:22 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-8b7cd4a5-7170-4c7d-afca-4ebbf3eee249 tempest-VolumesListAdminTestJSON-1964715607 None] Created volume successfully. Jul 10 06:41:22 devstack sudo[93725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53 Jul 10 06:41:22 devstack sudo[93725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:22 devstack sudo[93716]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.123s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:22 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:41:23 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager._thread_info {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:41:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread count: 8 {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:41:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread info: [<_MainThread(MainThread, started 139245706264704)>, , , , , , , ] {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:41:23 devstack sudo[93725]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-296f6586-2ca3-4979-b6f7-8a74c56fb3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53" returned: 0 in 1.002s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-296f6586-2ca3-4979-b6f7-8a74c56fb3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53.263d1bcc-3aaa-421e-8ee2-d54c5b251e77 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:23 devstack sudo[93734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53.263d1bcc-3aaa-421e-8ee2-d54c5b251e77 Jul 10 06:41:23 devstack sudo[93734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:23 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9131084-ef5e-4342-b523-2b8d530faa98 tempest-VolumesListAdminTestJSON-1964715607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:41:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c9131084-ef5e-4342-b523-2b8d530faa98 tempest-VolumesListAdminTestJSON-1964715607 None] Flow 'volume_create_manager' (d96f4508-9138-498c-bfb3-67366106b20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:41:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c9131084-ef5e-4342-b523-2b8d530faa98 tempest-VolumesListAdminTestJSON-1964715607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2efaeebd-4d5a-4270-aa41-7e0d5f4f6885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c9131084-ef5e-4342-b523-2b8d530faa98 tempest-VolumesListAdminTestJSON-1964715607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2efaeebd-4d5a-4270-aa41-7e0d5f4f6885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1694341112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b04e2a-aa17-4743-b030-51f08b901f69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='171d848e61c246baa7374130c888d674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:41:24Z,use_quota=True,user_id='eb81f97f6f5f4fbba84a4d334a295c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c9131084-ef5e-4342-b523-2b8d530faa98 tempest-VolumesListAdminTestJSON-1964715607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82614084-1e61-4b6c-a878-c5fd318a374e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c9131084-ef5e-4342-b523-2b8d530faa98 tempest-VolumesListAdminTestJSON-1964715607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82614084-1e61-4b6c-a878-c5fd318a374e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c9131084-ef5e-4342-b523-2b8d530faa98 tempest-VolumesListAdminTestJSON-1964715607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14989e4d-7530-4350-b170-8ac209c75b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c9131084-ef5e-4342-b523-2b8d530faa98 tempest-VolumesListAdminTestJSON-1964715607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14989e4d-7530-4350-b170-8ac209c75b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46b04e2a-aa17-4743-b030-51f08b901f69', 'volume_name': 'volume-46b04e2a-aa17-4743-b030-51f08b901f69', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c9131084-ef5e-4342-b523-2b8d530faa98 tempest-VolumesListAdminTestJSON-1964715607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (265f1a11-aef2-4efd-af3c-f6bbfdbb7c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c9131084-ef5e-4342-b523-2b8d530faa98 tempest-VolumesListAdminTestJSON-1964715607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (265f1a11-aef2-4efd-af3c-f6bbfdbb7c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c9131084-ef5e-4342-b523-2b8d530faa98 tempest-VolumesListAdminTestJSON-1964715607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb3bf599-86f8-49b7-bf83-94cf92a10266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:23 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-c9131084-ef5e-4342-b523-2b8d530faa98 tempest-VolumesListAdminTestJSON-1964715607 None] Volume 46b04e2a-aa17-4743-b030-51f08b901f69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46b04e2a-aa17-4743-b030-51f08b901f69', 'volume_size': 1} Jul 10 06:41:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c9131084-ef5e-4342-b523-2b8d530faa98 tempest-VolumesListAdminTestJSON-1964715607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:41:23 devstack sudo[93723]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-146fcdd2-cc07-4f2c-89a0-7b0570576576 tempest-GroupSnapshotsV319Test-1313993213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5 1073741824" returned: 0 in 1.416s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-146fcdd2-cc07-4f2c-89a0-7b0570576576 tempest-GroupSnapshotsV319Test-1313993213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:23 devstack sudo[93738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5 Jul 10 06:41:23 devstack sudo[93738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:24 devstack sudo[93734]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-296f6586-2ca3-4979-b6f7-8a74c56fb3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53.263d1bcc-3aaa-421e-8ee2-d54c5b251e77" returned: 0 in 1.036s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-296f6586-2ca3-4979-b6f7-8a74c56fb3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53.263d1bcc-3aaa-421e-8ee2-d54c5b251e77 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:24 devstack sudo[93745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53.263d1bcc-3aaa-421e-8ee2-d54c5b251e77 Jul 10 06:41:24 devstack sudo[93745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:24 devstack sudo[93738]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-146fcdd2-cc07-4f2c-89a0-7b0570576576 tempest-GroupSnapshotsV319Test-1313993213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5" returned: 0 in 0.789s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:24 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-146fcdd2-cc07-4f2c-89a0-7b0570576576 tempest-GroupSnapshotsV319Test-1313993213 None] <== create_volume: return (2255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:41:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-146fcdd2-cc07-4f2c-89a0-7b0570576576 tempest-GroupSnapshotsV319Test-1313993213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.261s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:41:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c9131084-ef5e-4342-b523-2b8d530faa98 tempest-VolumesListAdminTestJSON-1964715607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.882s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:41:24 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-c9131084-ef5e-4342-b523-2b8d530faa98 tempest-VolumesListAdminTestJSON-1964715607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1694341112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b04e2a-aa17-4743-b030-51f08b901f69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='171d848e61c246baa7374130c888d674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:41:24Z,use_quota=True,user_id='eb81f97f6f5f4fbba84a4d334a295c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:41:24 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-c9131084-ef5e-4342-b523-2b8d530faa98 tempest-VolumesListAdminTestJSON-1964715607 None] Creating volume 46b04e2a-aa17-4743-b030-51f08b901f69 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:41:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c9131084-ef5e-4342-b523-2b8d530faa98 tempest-VolumesListAdminTestJSON-1964715607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:41:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c9131084-ef5e-4342-b523-2b8d530faa98 tempest-VolumesListAdminTestJSON-1964715607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:41:24 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-c9131084-ef5e-4342-b523-2b8d530faa98 tempest-VolumesListAdminTestJSON-1964715607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:41:24 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-c9131084-ef5e-4342-b523-2b8d530faa98 tempest-VolumesListAdminTestJSON-1964715607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:41:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c9131084-ef5e-4342-b523-2b8d530faa98 tempest-VolumesListAdminTestJSON-1964715607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:41:24 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-c9131084-ef5e-4342-b523-2b8d530faa98 tempest-VolumesListAdminTestJSON-1964715607 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:41:24 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-c9131084-ef5e-4342-b523-2b8d530faa98 tempest-VolumesListAdminTestJSON-1964715607 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:41:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c9131084-ef5e-4342-b523-2b8d530faa98 tempest-VolumesListAdminTestJSON-1964715607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-46b04e2a-aa17-4743-b030-51f08b901f69 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-146fcdd2-cc07-4f2c-89a0-7b0570576576 tempest-GroupSnapshotsV319Test-1313993213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cc87a00-4542-4e5d-8ba6-99d033ca80a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:24 devstack sudo[93747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-46b04e2a-aa17-4743-b030-51f08b901f69 1073741824 Jul 10 06:41:24 devstack sudo[93747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-146fcdd2-cc07-4f2c-89a0-7b0570576576 tempest-GroupSnapshotsV319Test-1313993213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75f3eb10-db2e-48c9-a65f-4439a4159152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:24 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-146fcdd2-cc07-4f2c-89a0-7b0570576576 tempest-GroupSnapshotsV319Test-1313993213 None] Volume volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5 (f91c4902-2a4c-4a2a-9c24-36fcc0a455f5): created successfully Jul 10 06:41:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-146fcdd2-cc07-4f2c-89a0-7b0570576576 tempest-GroupSnapshotsV319Test-1313993213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75f3eb10-db2e-48c9-a65f-4439a4159152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-146fcdd2-cc07-4f2c-89a0-7b0570576576 tempest-GroupSnapshotsV319Test-1313993213 None] Flow 'volume_create_manager' (1086ce1c-ea8e-4563-9fbe-855d389b732e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:41:24 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-146fcdd2-cc07-4f2c-89a0-7b0570576576 tempest-GroupSnapshotsV319Test-1313993213 None] Created volume successfully. Jul 10 06:41:25 devstack sudo[93745]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-296f6586-2ca3-4979-b6f7-8a74c56fb3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53.263d1bcc-3aaa-421e-8ee2-d54c5b251e77" returned: 0 in 0.739s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:25 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-296f6586-2ca3-4979-b6f7-8a74c56fb3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Lock "cinder-quobyte-263d1bcc-3aaa-421e-8ee2-d54c5b251e77" released by "_delete_snapshot" :: held 3.882s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:41:25 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-296f6586-2ca3-4979-b6f7-8a74c56fb3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Lock "cinder-quobyte-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53" released by "delete_snapshot" :: held 3.925s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:41:25 devstack cinder-volume[87294]: WARNING cinder.quota [None req-296f6586-2ca3-4979-b6f7-8a74c56fb3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:41:25 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-296f6586-2ca3-4979-b6f7-8a74c56fb3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Created reservations ['e039fdf9-d95c-4b81-a47f-d9d978992589', 'b2d15370-f6a4-4280-8261-8af031e48ec5', 'a9f3a6e3-ba3d-44d5-a778-47856ccf4d80', 'c45aecb1-5ed8-4bbf-920b-a95b720c2683'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:41:25 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-296f6586-2ca3-4979-b6f7-8a74c56fb3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Delete snapshot completed successfully. Jul 10 06:41:25 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-296f6586-2ca3-4979-b6f7-8a74c56fb3f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Lock "cinder-263d1bcc-3aaa-421e-8ee2-d54c5b251e77-delete_snapshot" released by "delete_snapshot" :: held 4.142s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:41:25 devstack sudo[93747]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c9131084-ef5e-4342-b523-2b8d530faa98 tempest-VolumesListAdminTestJSON-1964715607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-46b04e2a-aa17-4743-b030-51f08b901f69 1073741824" returned: 0 in 0.960s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c9131084-ef5e-4342-b523-2b8d530faa98 tempest-VolumesListAdminTestJSON-1964715607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-46b04e2a-aa17-4743-b030-51f08b901f69 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:25 devstack sudo[93756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-46b04e2a-aa17-4743-b030-51f08b901f69 Jul 10 06:41:25 devstack sudo[93756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:25 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-af7ec3cf-3d1d-4dc0-9aed-602ad3fd16a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Acquiring lock "cinder-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:41:25 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-af7ec3cf-3d1d-4dc0-9aed-602ad3fd16a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Lock "cinder-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:41:25 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-d464d8fe-38d9-4c3d-97fa-5cd425819421 tempest-GroupSnapshotsV319Test-1313993213 None] GroupSnapshot f0c09fc4-6ab1-4ee6-b7c8-29e4244a1ff5: creating. Jul 10 06:41:25 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-af7ec3cf-3d1d-4dc0-9aed-602ad3fd16a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Acquiring lock "cinder-quobyte-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:41:25 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d464d8fe-38d9-4c3d-97fa-5cd425819421 tempest-GroupSnapshotsV319Test-1313993213 None] Group snapshot f0c09fc4-6ab1-4ee6-b7c8-29e4244a1ff5: creating. {{(pid=87294) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 10 06:41:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d464d8fe-38d9-4c3d-97fa-5cd425819421 tempest-GroupSnapshotsV319Test-1313993213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:41:25 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-af7ec3cf-3d1d-4dc0-9aed-602ad3fd16a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Lock "cinder-quobyte-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53" acquired by "delete_volume" :: waited 0.036s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:41:25 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[99623d74-f741-4484-831e-b8f7d364f1e5]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:41:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-af7ec3cf-3d1d-4dc0-9aed-602ad3fd16a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:26 devstack sudo[93758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53 Jul 10 06:41:26 devstack sudo[93758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:26 devstack sudo[93756]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c9131084-ef5e-4342-b523-2b8d530faa98 tempest-VolumesListAdminTestJSON-1964715607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-46b04e2a-aa17-4743-b030-51f08b901f69" returned: 0 in 0.779s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:26 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-c9131084-ef5e-4342-b523-2b8d530faa98 tempest-VolumesListAdminTestJSON-1964715607 None] <== create_volume: return (1798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:41:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c9131084-ef5e-4342-b523-2b8d530faa98 tempest-VolumesListAdminTestJSON-1964715607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:41:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d464d8fe-38d9-4c3d-97fa-5cd425819421 tempest-GroupSnapshotsV319Test-1313993213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.500s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:41:26 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-d464d8fe-38d9-4c3d-97fa-5cd425819421 tempest-GroupSnapshotsV319Test-1313993213 None] Creating offline snapshot abc54693-bd6d-4ce4-b333-6947dce7665e of volume f91c4902-2a4c-4a2a-9c24-36fcc0a455f5 {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:41:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c9131084-ef5e-4342-b523-2b8d530faa98 tempest-VolumesListAdminTestJSON-1964715607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb3bf599-86f8-49b7-bf83-94cf92a10266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46b04e2a-aa17-4743-b030-51f08b901f69', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c9131084-ef5e-4342-b523-2b8d530faa98 tempest-VolumesListAdminTestJSON-1964715607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e265f12-6312-420f-95db-ae7d722c2be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:26 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[8171c80c-6d85-4675-af5e-c6e1f1411e8a]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:41:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d464d8fe-38d9-4c3d-97fa-5cd425819421 tempest-GroupSnapshotsV319Test-1313993213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:26 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-c9131084-ef5e-4342-b523-2b8d530faa98 tempest-VolumesListAdminTestJSON-1964715607 None] Volume volume-46b04e2a-aa17-4743-b030-51f08b901f69 (46b04e2a-aa17-4743-b030-51f08b901f69): created successfully Jul 10 06:41:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c9131084-ef5e-4342-b523-2b8d530faa98 tempest-VolumesListAdminTestJSON-1964715607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e265f12-6312-420f-95db-ae7d722c2be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c9131084-ef5e-4342-b523-2b8d530faa98 tempest-VolumesListAdminTestJSON-1964715607 None] Flow 'volume_create_manager' (d96f4508-9138-498c-bfb3-67366106b20a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:41:26 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-c9131084-ef5e-4342-b523-2b8d530faa98 tempest-VolumesListAdminTestJSON-1964715607 None] Created volume successfully. Jul 10 06:41:26 devstack sudo[93761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5 Jul 10 06:41:26 devstack sudo[93761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:26 devstack sudo[93758]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-af7ec3cf-3d1d-4dc0-9aed-602ad3fd16a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53" returned: 0 in 0.875s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-af7ec3cf-3d1d-4dc0-9aed-602ad3fd16a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:26 devstack sudo[93766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53 Jul 10 06:41:26 devstack sudo[93766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:27 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-b49e278b-a262-406e-b7df-69247445d719 tempest-VolumesListAdminTestJSON-1964715607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:41:27 devstack sudo[93761]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b49e278b-a262-406e-b7df-69247445d719 tempest-VolumesListAdminTestJSON-1964715607 None] Flow 'volume_create_manager' (2ac0c4d8-54b3-45a7-b6fc-90934b701a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:41:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b49e278b-a262-406e-b7df-69247445d719 tempest-VolumesListAdminTestJSON-1964715607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd3f0321-3b94-43a6-8c89-a1f815f9ab41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d464d8fe-38d9-4c3d-97fa-5cd425819421 tempest-GroupSnapshotsV319Test-1313993213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5" returned: 0 in 1.012s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d464d8fe-38d9-4c3d-97fa-5cd425819421 tempest-GroupSnapshotsV319Test-1313993213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5.abc54693-bd6d-4ce4-b333-6947dce7665e 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:27 devstack sudo[93771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5.abc54693-bd6d-4ce4-b333-6947dce7665e 1G Jul 10 06:41:27 devstack sudo[93771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b49e278b-a262-406e-b7df-69247445d719 tempest-VolumesListAdminTestJSON-1964715607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd3f0321-3b94-43a6-8c89-a1f815f9ab41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1574496127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae6421c0-fb8d-428d-baa2-7769e5b4e415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='171d848e61c246baa7374130c888d674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:41:27Z,use_quota=True,user_id='eb81f97f6f5f4fbba84a4d334a295c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b49e278b-a262-406e-b7df-69247445d719 tempest-VolumesListAdminTestJSON-1964715607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7f2a6b6-4fb0-44aa-b347-c41361d0fcdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b49e278b-a262-406e-b7df-69247445d719 tempest-VolumesListAdminTestJSON-1964715607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7f2a6b6-4fb0-44aa-b347-c41361d0fcdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b49e278b-a262-406e-b7df-69247445d719 tempest-VolumesListAdminTestJSON-1964715607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b310df5b-3f9e-4aa9-a6f0-6eaada3d65c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b49e278b-a262-406e-b7df-69247445d719 tempest-VolumesListAdminTestJSON-1964715607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b310df5b-3f9e-4aa9-a6f0-6eaada3d65c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae6421c0-fb8d-428d-baa2-7769e5b4e415', 'volume_name': 'volume-ae6421c0-fb8d-428d-baa2-7769e5b4e415', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b49e278b-a262-406e-b7df-69247445d719 tempest-VolumesListAdminTestJSON-1964715607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6d26cd-80a7-43db-ad03-0478e626c01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b49e278b-a262-406e-b7df-69247445d719 tempest-VolumesListAdminTestJSON-1964715607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6d26cd-80a7-43db-ad03-0478e626c01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b49e278b-a262-406e-b7df-69247445d719 tempest-VolumesListAdminTestJSON-1964715607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0b73cd4-2cc6-4638-a8ae-40f87a6b091a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:27 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-b49e278b-a262-406e-b7df-69247445d719 tempest-VolumesListAdminTestJSON-1964715607 None] Volume ae6421c0-fb8d-428d-baa2-7769e5b4e415: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae6421c0-fb8d-428d-baa2-7769e5b4e415', 'volume_size': 1} Jul 10 06:41:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b49e278b-a262-406e-b7df-69247445d719 tempest-VolumesListAdminTestJSON-1964715607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:41:27 devstack sudo[93766]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-af7ec3cf-3d1d-4dc0-9aed-602ad3fd16a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53" returned: 0 in 0.820s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:27 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-af7ec3cf-3d1d-4dc0-9aed-602ad3fd16a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Lock "cinder-quobyte-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53" released by "delete_volume" :: held 1.756s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:41:27 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-af7ec3cf-3d1d-4dc0-9aed-602ad3fd16a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Created reservations ['ed6dd0e6-3694-4158-b915-693b965c9ae6', 'dde977a2-9264-43f1-807a-a300d31d5936', 'cbf2b698-21a2-43df-ac60-bfeaa0014475', '72a42610-3e31-4c4b-9708-c30d23115262'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:41:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-af7ec3cf-3d1d-4dc0-9aed-602ad3fd16a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:41:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-af7ec3cf-3d1d-4dc0-9aed-602ad3fd16a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:41:27 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-af7ec3cf-3d1d-4dc0-9aed-602ad3fd16a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:41:27 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-af7ec3cf-3d1d-4dc0-9aed-602ad3fd16a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:41:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-af7ec3cf-3d1d-4dc0-9aed-602ad3fd16a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:41:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-af7ec3cf-3d1d-4dc0-9aed-602ad3fd16a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:27 devstack sudo[93774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:41:27 devstack sudo[93774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:28 devstack sudo[93771]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d464d8fe-38d9-4c3d-97fa-5cd425819421 tempest-GroupSnapshotsV319Test-1313993213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5.abc54693-bd6d-4ce4-b333-6947dce7665e 1G" returned: 0 in 1.008s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d464d8fe-38d9-4c3d-97fa-5cd425819421 tempest-GroupSnapshotsV319Test-1313993213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5.abc54693-bd6d-4ce4-b333-6947dce7665e {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:28 devstack sudo[93779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5.abc54693-bd6d-4ce4-b333-6947dce7665e Jul 10 06:41:28 devstack sudo[93779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:28 devstack sudo[93774]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-af7ec3cf-3d1d-4dc0-9aed-602ad3fd16a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.932s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:28 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-af7ec3cf-3d1d-4dc0-9aed-602ad3fd16a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:41:28 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-af7ec3cf-3d1d-4dc0-9aed-602ad3fd16a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Deleted volume successfully. Jul 10 06:41:28 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-af7ec3cf-3d1d-4dc0-9aed-602ad3fd16a3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1780586934 None] Lock "cinder-a4c62c52-8ee8-4c92-9a2c-24422d1d1d53-delete_volume" released by "delete_volume" :: held 2.978s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:41:29 devstack sudo[93779]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d464d8fe-38d9-4c3d-97fa-5cd425819421 tempest-GroupSnapshotsV319Test-1313993213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5.abc54693-bd6d-4ce4-b333-6947dce7665e" returned: 0 in 0.775s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:29 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-d464d8fe-38d9-4c3d-97fa-5cd425819421 tempest-GroupSnapshotsV319Test-1313993213 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5.abc54693-bd6d-4ce4-b333-6947dce7665e is being set with open permissions: ugo+rw: NotImplementedError Jul 10 06:41:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d464d8fe-38d9-4c3d-97fa-5cd425819421 tempest-GroupSnapshotsV319Test-1313993213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5.abc54693-bd6d-4ce4-b333-6947dce7665e {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:29 devstack sudo[93786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5.abc54693-bd6d-4ce4-b333-6947dce7665e Jul 10 06:41:29 devstack sudo[93786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:29 devstack sudo[93786]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d464d8fe-38d9-4c3d-97fa-5cd425819421 tempest-GroupSnapshotsV319Test-1313993213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5.abc54693-bd6d-4ce4-b333-6947dce7665e" returned: 0 in 0.711s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d464d8fe-38d9-4c3d-97fa-5cd425819421 tempest-GroupSnapshotsV319Test-1313993213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:29 devstack sudo[93789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5.info Jul 10 06:41:29 devstack sudo[93789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:30 devstack sudo[93789]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d464d8fe-38d9-4c3d-97fa-5cd425819421 tempest-GroupSnapshotsV319Test-1313993213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5.info" returned: 0 in 0.763s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:30 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-d464d8fe-38d9-4c3d-97fa-5cd425819421 tempest-GroupSnapshotsV319Test-1313993213 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 06:41:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d464d8fe-38d9-4c3d-97fa-5cd425819421 tempest-GroupSnapshotsV319Test-1313993213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:30 devstack sudo[93798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5.info Jul 10 06:41:30 devstack sudo[93798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:31 devstack sudo[93798]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d464d8fe-38d9-4c3d-97fa-5cd425819421 tempest-GroupSnapshotsV319Test-1313993213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5.info" returned: 0 in 0.709s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d464d8fe-38d9-4c3d-97fa-5cd425819421 tempest-GroupSnapshotsV319Test-1313993213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.098s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:41:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b49e278b-a262-406e-b7df-69247445d719 tempest-VolumesListAdminTestJSON-1964715607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.971s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:41:31 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b49e278b-a262-406e-b7df-69247445d719 tempest-VolumesListAdminTestJSON-1964715607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1574496127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae6421c0-fb8d-428d-baa2-7769e5b4e415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='171d848e61c246baa7374130c888d674',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:41:27Z,use_quota=True,user_id='eb81f97f6f5f4fbba84a4d334a295c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:41:31 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-b49e278b-a262-406e-b7df-69247445d719 tempest-VolumesListAdminTestJSON-1964715607 None] Creating volume ae6421c0-fb8d-428d-baa2-7769e5b4e415 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:41:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b49e278b-a262-406e-b7df-69247445d719 tempest-VolumesListAdminTestJSON-1964715607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:41:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b49e278b-a262-406e-b7df-69247445d719 tempest-VolumesListAdminTestJSON-1964715607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:41:31 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b49e278b-a262-406e-b7df-69247445d719 tempest-VolumesListAdminTestJSON-1964715607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:41:31 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b49e278b-a262-406e-b7df-69247445d719 tempest-VolumesListAdminTestJSON-1964715607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:41:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b49e278b-a262-406e-b7df-69247445d719 tempest-VolumesListAdminTestJSON-1964715607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:41:31 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b49e278b-a262-406e-b7df-69247445d719 tempest-VolumesListAdminTestJSON-1964715607 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:41:31 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-b49e278b-a262-406e-b7df-69247445d719 tempest-VolumesListAdminTestJSON-1964715607 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:41:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b49e278b-a262-406e-b7df-69247445d719 tempest-VolumesListAdminTestJSON-1964715607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ae6421c0-fb8d-428d-baa2-7769e5b4e415 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:31 devstack sudo[93801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ae6421c0-fb8d-428d-baa2-7769e5b4e415 1073741824 Jul 10 06:41:31 devstack sudo[93801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:31 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-d464d8fe-38d9-4c3d-97fa-5cd425819421 tempest-GroupSnapshotsV319Test-1313993213 None] group_snapshot f0c09fc4-6ab1-4ee6-b7c8-29e4244a1ff5: created successfully Jul 10 06:41:32 devstack sudo[93801]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b49e278b-a262-406e-b7df-69247445d719 tempest-VolumesListAdminTestJSON-1964715607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ae6421c0-fb8d-428d-baa2-7769e5b4e415 1073741824" returned: 0 in 1.154s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b49e278b-a262-406e-b7df-69247445d719 tempest-VolumesListAdminTestJSON-1964715607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ae6421c0-fb8d-428d-baa2-7769e5b4e415 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:32 devstack sudo[93807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ae6421c0-fb8d-428d-baa2-7769e5b4e415 Jul 10 06:41:32 devstack sudo[93807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:33 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-c324c398-9cd9-419e-8519-660df15bc6ee tempest-GroupSnapshotsV319Test-1313993213 None] group_snapshot f0c09fc4-6ab1-4ee6-b7c8-29e4244a1ff5: deleting Jul 10 06:41:33 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c324c398-9cd9-419e-8519-660df15bc6ee tempest-GroupSnapshotsV319Test-1313993213 None] group_snapshot f0c09fc4-6ab1-4ee6-b7c8-29e4244a1ff5: deleting {{(pid=87294) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 10 06:41:33 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c324c398-9cd9-419e-8519-660df15bc6ee tempest-GroupSnapshotsV319Test-1313993213 None] Acquiring lock "cinder-quobyte-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:41:33 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c324c398-9cd9-419e-8519-660df15bc6ee tempest-GroupSnapshotsV319Test-1313993213 None] Lock "cinder-quobyte-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:41:33 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c324c398-9cd9-419e-8519-660df15bc6ee tempest-GroupSnapshotsV319Test-1313993213 None] Acquiring lock "cinder-quobyte-abc54693-bd6d-4ce4-b333-6947dce7665e" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:41:33 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c324c398-9cd9-419e-8519-660df15bc6ee tempest-GroupSnapshotsV319Test-1313993213 None] Lock "cinder-quobyte-abc54693-bd6d-4ce4-b333-6947dce7665e" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:41:33 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-c324c398-9cd9-419e-8519-660df15bc6ee tempest-GroupSnapshotsV319Test-1313993213 None] Deleting offline snapshot abc54693-bd6d-4ce4-b333-6947dce7665e of volume f91c4902-2a4c-4a2a-9c24-36fcc0a455f5 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:41:33 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-c324c398-9cd9-419e-8519-660df15bc6ee tempest-GroupSnapshotsV319Test-1313993213 None] snapshot_file for this snap is: volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5.abc54693-bd6d-4ce4-b333-6947dce7665e {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:41:33 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6b9f09-cca1-4955-a761-fd6a109ab34e]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:41:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c324c398-9cd9-419e-8519-660df15bc6ee tempest-GroupSnapshotsV319Test-1313993213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5.abc54693-bd6d-4ce4-b333-6947dce7665e {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:33 devstack sudo[93809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5.abc54693-bd6d-4ce4-b333-6947dce7665e Jul 10 06:41:33 devstack sudo[93809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:33 devstack sudo[93807]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b49e278b-a262-406e-b7df-69247445d719 tempest-VolumesListAdminTestJSON-1964715607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ae6421c0-fb8d-428d-baa2-7769e5b4e415" returned: 0 in 0.818s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:33 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b49e278b-a262-406e-b7df-69247445d719 tempest-VolumesListAdminTestJSON-1964715607 None] <== create_volume: return (2043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:41:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b49e278b-a262-406e-b7df-69247445d719 tempest-VolumesListAdminTestJSON-1964715607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.049s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:41:33 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b49e278b-a262-406e-b7df-69247445d719 tempest-VolumesListAdminTestJSON-1964715607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0b73cd4-2cc6-4638-a8ae-40f87a6b091a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae6421c0-fb8d-428d-baa2-7769e5b4e415', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:33 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b49e278b-a262-406e-b7df-69247445d719 tempest-VolumesListAdminTestJSON-1964715607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97442180-aa04-4f34-ac20-243445a16b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:33 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-b49e278b-a262-406e-b7df-69247445d719 tempest-VolumesListAdminTestJSON-1964715607 None] Volume volume-ae6421c0-fb8d-428d-baa2-7769e5b4e415 (ae6421c0-fb8d-428d-baa2-7769e5b4e415): created successfully Jul 10 06:41:33 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b49e278b-a262-406e-b7df-69247445d719 tempest-VolumesListAdminTestJSON-1964715607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97442180-aa04-4f34-ac20-243445a16b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:33 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b49e278b-a262-406e-b7df-69247445d719 tempest-VolumesListAdminTestJSON-1964715607 None] Flow 'volume_create_manager' (2ac0c4d8-54b3-45a7-b6fc-90934b701a7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:41:33 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-b49e278b-a262-406e-b7df-69247445d719 tempest-VolumesListAdminTestJSON-1964715607 None] Created volume successfully. Jul 10 06:41:34 devstack sudo[93809]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c324c398-9cd9-419e-8519-660df15bc6ee tempest-GroupSnapshotsV319Test-1313993213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5.abc54693-bd6d-4ce4-b333-6947dce7665e" returned: 0 in 0.985s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:34 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-c324c398-9cd9-419e-8519-660df15bc6ee tempest-GroupSnapshotsV319Test-1313993213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:41:34 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd864df-fee3-4959-816f-1f01494f164e]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:41:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c324c398-9cd9-419e-8519-660df15bc6ee tempest-GroupSnapshotsV319Test-1313993213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:34 devstack sudo[93815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5 Jul 10 06:41:34 devstack sudo[93815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:35 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdce99dd-41c5-422e-b586-b2d7f62e5247 tempest-VolumesListAdminTestJSON-329557488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:41:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bdce99dd-41c5-422e-b586-b2d7f62e5247 tempest-VolumesListAdminTestJSON-329557488 None] Flow 'volume_create_manager' (73ede4b9-c405-43f6-b29f-25215183c4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:41:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bdce99dd-41c5-422e-b586-b2d7f62e5247 tempest-VolumesListAdminTestJSON-329557488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e849e66-a324-404a-a2c5-0252cc8156f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bdce99dd-41c5-422e-b586-b2d7f62e5247 tempest-VolumesListAdminTestJSON-329557488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e849e66-a324-404a-a2c5-0252cc8156f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:41:35Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38151a9c-9e98-427c-805c-a77ac84e228a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a776c952d1704952a0a9254d7b0fdf26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:41:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:41:35Z,use_quota=True,user_id='1ad8bdcb91de4b0e8eef6e56d9ac807b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bdce99dd-41c5-422e-b586-b2d7f62e5247 tempest-VolumesListAdminTestJSON-329557488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7b8d19d-8f49-439a-9873-61dd31d8e97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bdce99dd-41c5-422e-b586-b2d7f62e5247 tempest-VolumesListAdminTestJSON-329557488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7b8d19d-8f49-439a-9873-61dd31d8e97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bdce99dd-41c5-422e-b586-b2d7f62e5247 tempest-VolumesListAdminTestJSON-329557488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7f2a798-847b-43ad-8157-a2e8e27a8288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bdce99dd-41c5-422e-b586-b2d7f62e5247 tempest-VolumesListAdminTestJSON-329557488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7f2a798-847b-43ad-8157-a2e8e27a8288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38151a9c-9e98-427c-805c-a77ac84e228a', 'volume_name': 'volume-38151a9c-9e98-427c-805c-a77ac84e228a', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bdce99dd-41c5-422e-b586-b2d7f62e5247 tempest-VolumesListAdminTestJSON-329557488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b7debb-43d2-4aa8-afe3-3eae515dceb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bdce99dd-41c5-422e-b586-b2d7f62e5247 tempest-VolumesListAdminTestJSON-329557488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b7debb-43d2-4aa8-afe3-3eae515dceb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bdce99dd-41c5-422e-b586-b2d7f62e5247 tempest-VolumesListAdminTestJSON-329557488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a544317a-0ad7-47e0-926f-1374a613e262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:35 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-bdce99dd-41c5-422e-b586-b2d7f62e5247 tempest-VolumesListAdminTestJSON-329557488 None] Volume 38151a9c-9e98-427c-805c-a77ac84e228a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38151a9c-9e98-427c-805c-a77ac84e228a', 'volume_size': 1} Jul 10 06:41:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-bdce99dd-41c5-422e-b586-b2d7f62e5247 tempest-VolumesListAdminTestJSON-329557488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:41:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-bdce99dd-41c5-422e-b586-b2d7f62e5247 tempest-VolumesListAdminTestJSON-329557488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:41:35 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-bdce99dd-41c5-422e-b586-b2d7f62e5247 tempest-VolumesListAdminTestJSON-329557488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:41:35Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38151a9c-9e98-427c-805c-a77ac84e228a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a776c952d1704952a0a9254d7b0fdf26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:41:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:41:35Z,use_quota=True,user_id='1ad8bdcb91de4b0e8eef6e56d9ac807b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:41:35 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-bdce99dd-41c5-422e-b586-b2d7f62e5247 tempest-VolumesListAdminTestJSON-329557488 None] Creating volume 38151a9c-9e98-427c-805c-a77ac84e228a {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:41:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-bdce99dd-41c5-422e-b586-b2d7f62e5247 tempest-VolumesListAdminTestJSON-329557488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:41:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-bdce99dd-41c5-422e-b586-b2d7f62e5247 tempest-VolumesListAdminTestJSON-329557488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:41:35 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-bdce99dd-41c5-422e-b586-b2d7f62e5247 tempest-VolumesListAdminTestJSON-329557488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:41:35 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-bdce99dd-41c5-422e-b586-b2d7f62e5247 tempest-VolumesListAdminTestJSON-329557488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:41:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-bdce99dd-41c5-422e-b586-b2d7f62e5247 tempest-VolumesListAdminTestJSON-329557488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:41:35 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-bdce99dd-41c5-422e-b586-b2d7f62e5247 tempest-VolumesListAdminTestJSON-329557488 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:41:35 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-bdce99dd-41c5-422e-b586-b2d7f62e5247 tempest-VolumesListAdminTestJSON-329557488 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:41:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bdce99dd-41c5-422e-b586-b2d7f62e5247 tempest-VolumesListAdminTestJSON-329557488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-38151a9c-9e98-427c-805c-a77ac84e228a 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:35 devstack sudo[93817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-38151a9c-9e98-427c-805c-a77ac84e228a 1073741824 Jul 10 06:41:35 devstack sudo[93817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:35 devstack sudo[93815]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c324c398-9cd9-419e-8519-660df15bc6ee tempest-GroupSnapshotsV319Test-1313993213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5" returned: 0 in 1.215s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c324c398-9cd9-419e-8519-660df15bc6ee tempest-GroupSnapshotsV319Test-1313993213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5.abc54693-bd6d-4ce4-b333-6947dce7665e {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:35 devstack sudo[93822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5.abc54693-bd6d-4ce4-b333-6947dce7665e Jul 10 06:41:35 devstack sudo[93822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:35 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-c503a825-542a-4fbc-9488-637f97f841a2 tempest-VolumeTypesAccessTest-612395217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:41:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c503a825-542a-4fbc-9488-637f97f841a2 tempest-VolumeTypesAccessTest-612395217 None] Flow 'volume_create_manager' (0776a6cb-728c-4838-9ea4-78c208786875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:41:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c503a825-542a-4fbc-9488-637f97f841a2 tempest-VolumeTypesAccessTest-612395217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (658e2783-38f2-4773-a643-0398e30ad0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c503a825-542a-4fbc-9488-637f97f841a2 tempest-VolumeTypesAccessTest-612395217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (658e2783-38f2-4773-a643-0398e30ad0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:41:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2110461620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b09da348-d18e-4761-ae52-e08f668b84d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d384aeb16207469eabe48de7776d77fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:41:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:41:35Z,use_quota=True,user_id='49619eaee10d44f5b4f072d64e69dbe5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f2b22cb-3ad6-44bb-a70c-2ad9908e9c89),volume_type_id=0f2b22cb-3ad6-44bb-a70c-2ad9908e9c89)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c503a825-542a-4fbc-9488-637f97f841a2 tempest-VolumeTypesAccessTest-612395217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28c85073-baac-403d-bd91-6d5157e88a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c503a825-542a-4fbc-9488-637f97f841a2 tempest-VolumeTypesAccessTest-612395217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28c85073-baac-403d-bd91-6d5157e88a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c503a825-542a-4fbc-9488-637f97f841a2 tempest-VolumeTypesAccessTest-612395217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddaf9793-b9b1-41e7-bc46-b6a54a428c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c503a825-542a-4fbc-9488-637f97f841a2 tempest-VolumeTypesAccessTest-612395217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddaf9793-b9b1-41e7-bc46-b6a54a428c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b09da348-d18e-4761-ae52-e08f668b84d7', 'volume_name': 'volume-b09da348-d18e-4761-ae52-e08f668b84d7', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c503a825-542a-4fbc-9488-637f97f841a2 tempest-VolumeTypesAccessTest-612395217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6694e3b8-5d71-4670-b518-a9000fa63ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c503a825-542a-4fbc-9488-637f97f841a2 tempest-VolumeTypesAccessTest-612395217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6694e3b8-5d71-4670-b518-a9000fa63ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c503a825-542a-4fbc-9488-637f97f841a2 tempest-VolumeTypesAccessTest-612395217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3efa4d5-da04-495c-89f7-079b022fa837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:35 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-c503a825-542a-4fbc-9488-637f97f841a2 tempest-VolumeTypesAccessTest-612395217 None] Volume b09da348-d18e-4761-ae52-e08f668b84d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b09da348-d18e-4761-ae52-e08f668b84d7', 'volume_size': 1} Jul 10 06:41:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c503a825-542a-4fbc-9488-637f97f841a2 tempest-VolumeTypesAccessTest-612395217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:41:36 devstack sudo[93817]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bdce99dd-41c5-422e-b586-b2d7f62e5247 tempest-VolumesListAdminTestJSON-329557488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-38151a9c-9e98-427c-805c-a77ac84e228a 1073741824" returned: 0 in 0.861s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bdce99dd-41c5-422e-b586-b2d7f62e5247 tempest-VolumesListAdminTestJSON-329557488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-38151a9c-9e98-427c-805c-a77ac84e228a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:36 devstack sudo[93830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-38151a9c-9e98-427c-805c-a77ac84e228a Jul 10 06:41:36 devstack sudo[93830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:36 devstack sudo[93822]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c324c398-9cd9-419e-8519-660df15bc6ee tempest-GroupSnapshotsV319Test-1313993213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5.abc54693-bd6d-4ce4-b333-6947dce7665e" returned: 0 in 0.797s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c324c398-9cd9-419e-8519-660df15bc6ee tempest-GroupSnapshotsV319Test-1313993213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5.abc54693-bd6d-4ce4-b333-6947dce7665e {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:36 devstack sudo[93832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5.abc54693-bd6d-4ce4-b333-6947dce7665e Jul 10 06:41:36 devstack sudo[93832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:36 devstack sudo[93830]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bdce99dd-41c5-422e-b586-b2d7f62e5247 tempest-VolumesListAdminTestJSON-329557488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-38151a9c-9e98-427c-805c-a77ac84e228a" returned: 0 in 0.706s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:36 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-bdce99dd-41c5-422e-b586-b2d7f62e5247 tempest-VolumesListAdminTestJSON-329557488 None] <== create_volume: return (1617ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:41:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-bdce99dd-41c5-422e-b586-b2d7f62e5247 tempest-VolumesListAdminTestJSON-329557488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.620s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:41:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c503a825-542a-4fbc-9488-637f97f841a2 tempest-VolumeTypesAccessTest-612395217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.264s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:41:36 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-c503a825-542a-4fbc-9488-637f97f841a2 tempest-VolumeTypesAccessTest-612395217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:41:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2110461620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b09da348-d18e-4761-ae52-e08f668b84d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d384aeb16207469eabe48de7776d77fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:41:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:41:35Z,use_quota=True,user_id='49619eaee10d44f5b4f072d64e69dbe5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f2b22cb-3ad6-44bb-a70c-2ad9908e9c89),volume_type_id=0f2b22cb-3ad6-44bb-a70c-2ad9908e9c89)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:41:36 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-c503a825-542a-4fbc-9488-637f97f841a2 tempest-VolumeTypesAccessTest-612395217 None] Creating volume b09da348-d18e-4761-ae52-e08f668b84d7 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:41:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c503a825-542a-4fbc-9488-637f97f841a2 tempest-VolumeTypesAccessTest-612395217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:41:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c503a825-542a-4fbc-9488-637f97f841a2 tempest-VolumeTypesAccessTest-612395217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:41:36 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-c503a825-542a-4fbc-9488-637f97f841a2 tempest-VolumeTypesAccessTest-612395217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:41:36 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-c503a825-542a-4fbc-9488-637f97f841a2 tempest-VolumeTypesAccessTest-612395217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:41:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c503a825-542a-4fbc-9488-637f97f841a2 tempest-VolumeTypesAccessTest-612395217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:41:36 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-c503a825-542a-4fbc-9488-637f97f841a2 tempest-VolumeTypesAccessTest-612395217 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:41:36 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-c503a825-542a-4fbc-9488-637f97f841a2 tempest-VolumeTypesAccessTest-612395217 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:41:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c503a825-542a-4fbc-9488-637f97f841a2 tempest-VolumeTypesAccessTest-612395217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b09da348-d18e-4761-ae52-e08f668b84d7 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:36 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bdce99dd-41c5-422e-b586-b2d7f62e5247 tempest-VolumesListAdminTestJSON-329557488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a544317a-0ad7-47e0-926f-1374a613e262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38151a9c-9e98-427c-805c-a77ac84e228a', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:36 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bdce99dd-41c5-422e-b586-b2d7f62e5247 tempest-VolumesListAdminTestJSON-329557488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c44b9d67-6953-429d-8298-4b16c4d685e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:36 devstack sudo[93836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b09da348-d18e-4761-ae52-e08f668b84d7 1073741824 Jul 10 06:41:36 devstack sudo[93836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:36 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-bdce99dd-41c5-422e-b586-b2d7f62e5247 tempest-VolumesListAdminTestJSON-329557488 None] Volume volume-38151a9c-9e98-427c-805c-a77ac84e228a (38151a9c-9e98-427c-805c-a77ac84e228a): created successfully Jul 10 06:41:36 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bdce99dd-41c5-422e-b586-b2d7f62e5247 tempest-VolumesListAdminTestJSON-329557488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c44b9d67-6953-429d-8298-4b16c4d685e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:36 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bdce99dd-41c5-422e-b586-b2d7f62e5247 tempest-VolumesListAdminTestJSON-329557488 None] Flow 'volume_create_manager' (73ede4b9-c405-43f6-b29f-25215183c4b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:41:36 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-bdce99dd-41c5-422e-b586-b2d7f62e5247 tempest-VolumesListAdminTestJSON-329557488 None] Created volume successfully. Jul 10 06:41:37 devstack sudo[93832]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c324c398-9cd9-419e-8519-660df15bc6ee tempest-GroupSnapshotsV319Test-1313993213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5.abc54693-bd6d-4ce4-b333-6947dce7665e" returned: 0 in 0.779s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:37 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c324c398-9cd9-419e-8519-660df15bc6ee tempest-GroupSnapshotsV319Test-1313993213 None] Lock "cinder-quobyte-abc54693-bd6d-4ce4-b333-6947dce7665e" released by "_delete_snapshot" :: held 3.927s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:41:37 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c324c398-9cd9-419e-8519-660df15bc6ee tempest-GroupSnapshotsV319Test-1313993213 None] Lock "cinder-quobyte-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5" released by "delete_snapshot" :: held 3.963s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:41:37 devstack cinder-volume[87294]: WARNING cinder.quota [None req-c324c398-9cd9-419e-8519-660df15bc6ee tempest-GroupSnapshotsV319Test-1313993213 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-907069684 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-907069684, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:41:37 devstack cinder-volume[87294]: WARNING cinder.quota [None req-c324c398-9cd9-419e-8519-660df15bc6ee tempest-GroupSnapshotsV319Test-1313993213 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-907069684 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-907069684, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:41:37 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-c324c398-9cd9-419e-8519-660df15bc6ee tempest-GroupSnapshotsV319Test-1313993213 None] Created reservations ['e2f4f2f0-65b5-4a90-b3ec-4122b760a4b1', '75e33e8b-7a96-40c0-a496-35e268dd35c2', '3dc1d7cb-a304-4b86-9aff-a86b835d53b1', 'e3983a05-ab09-44e0-832e-091e6fb6b063'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:41:37 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-c324c398-9cd9-419e-8519-660df15bc6ee tempest-GroupSnapshotsV319Test-1313993213 None] group_snapshot f0c09fc4-6ab1-4ee6-b7c8-29e4244a1ff5: deleted successfully Jul 10 06:41:37 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f3412ae2-272a-4800-aea7-ef970a73befe tempest-VolumesListAdminTestJSON-329557488 None] Acquiring lock "cinder-38151a9c-9e98-427c-805c-a77ac84e228a-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:41:37 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f3412ae2-272a-4800-aea7-ef970a73befe tempest-VolumesListAdminTestJSON-329557488 None] Lock "cinder-38151a9c-9e98-427c-805c-a77ac84e228a-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:41:37 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f3412ae2-272a-4800-aea7-ef970a73befe tempest-VolumesListAdminTestJSON-329557488 None] Acquiring lock "cinder-quobyte-38151a9c-9e98-427c-805c-a77ac84e228a" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:41:37 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f3412ae2-272a-4800-aea7-ef970a73befe tempest-VolumesListAdminTestJSON-329557488 None] Lock "cinder-quobyte-38151a9c-9e98-427c-805c-a77ac84e228a" acquired by "delete_volume" :: waited 0.016s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:41:37 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[f114fbf5-2ce1-457c-b8f6-2b4022269aaf]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:41:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3412ae2-272a-4800-aea7-ef970a73befe tempest-VolumesListAdminTestJSON-329557488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-38151a9c-9e98-427c-805c-a77ac84e228a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:37 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b448586f-74d3-48da-b706-e5446b082292 tempest-VolumesListAdminTestJSON-1964715607 None] Acquiring lock "cinder-ae6421c0-fb8d-428d-baa2-7769e5b4e415-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:41:37 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b448586f-74d3-48da-b706-e5446b082292 tempest-VolumesListAdminTestJSON-1964715607 None] Lock "cinder-ae6421c0-fb8d-428d-baa2-7769e5b4e415-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:41:37 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b448586f-74d3-48da-b706-e5446b082292 tempest-VolumesListAdminTestJSON-1964715607 None] Acquiring lock "cinder-quobyte-ae6421c0-fb8d-428d-baa2-7769e5b4e415" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:41:37 devstack sudo[93843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-38151a9c-9e98-427c-805c-a77ac84e228a Jul 10 06:41:37 devstack sudo[93843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:37 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b448586f-74d3-48da-b706-e5446b082292 tempest-VolumesListAdminTestJSON-1964715607 None] Lock "cinder-quobyte-ae6421c0-fb8d-428d-baa2-7769e5b4e415" acquired by "delete_volume" :: waited 0.022s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:41:37 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[59aa8065-8d11-416e-a609-82e2272e3175]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:41:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b448586f-74d3-48da-b706-e5446b082292 tempest-VolumesListAdminTestJSON-1964715607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ae6421c0-fb8d-428d-baa2-7769e5b4e415 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:37 devstack sudo[93836]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c503a825-542a-4fbc-9488-637f97f841a2 tempest-VolumeTypesAccessTest-612395217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b09da348-d18e-4761-ae52-e08f668b84d7 1073741824" returned: 0 in 1.085s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c503a825-542a-4fbc-9488-637f97f841a2 tempest-VolumeTypesAccessTest-612395217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b09da348-d18e-4761-ae52-e08f668b84d7 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:38 devstack sudo[93846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b09da348-d18e-4761-ae52-e08f668b84d7 Jul 10 06:41:38 devstack sudo[93846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:38 devstack sudo[93845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ae6421c0-fb8d-428d-baa2-7769e5b4e415 Jul 10 06:41:38 devstack sudo[93845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:38 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-9f83cb06-935b-49a2-84bd-ca35fe3211e1 tempest-GroupSnapshotsV319Test-1313993213 None] Acquiring lock "cinder-quobyte-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:41:38 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-9f83cb06-935b-49a2-84bd-ca35fe3211e1 tempest-GroupSnapshotsV319Test-1313993213 None] Lock "cinder-quobyte-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5" acquired by "delete_volume" :: waited 0.032s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:41:38 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6df98b-ab83-462d-8800-ce9b291f04fa]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:41:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9f83cb06-935b-49a2-84bd-ca35fe3211e1 tempest-GroupSnapshotsV319Test-1313993213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:38 devstack sudo[93849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5 Jul 10 06:41:38 devstack sudo[93849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:38 devstack sudo[93843]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3412ae2-272a-4800-aea7-ef970a73befe tempest-VolumesListAdminTestJSON-329557488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-38151a9c-9e98-427c-805c-a77ac84e228a" returned: 0 in 1.270s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3412ae2-272a-4800-aea7-ef970a73befe tempest-VolumesListAdminTestJSON-329557488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-38151a9c-9e98-427c-805c-a77ac84e228a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:38 devstack sudo[93855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-38151a9c-9e98-427c-805c-a77ac84e228a Jul 10 06:41:38 devstack sudo[93855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:39 devstack sudo[93845]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:39 devstack sudo[93849]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9f83cb06-935b-49a2-84bd-ca35fe3211e1 tempest-GroupSnapshotsV319Test-1313993213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5" returned: 0 in 1.098s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b448586f-74d3-48da-b706-e5446b082292 tempest-VolumesListAdminTestJSON-1964715607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ae6421c0-fb8d-428d-baa2-7769e5b4e415" returned: 0 in 1.599s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9f83cb06-935b-49a2-84bd-ca35fe3211e1 tempest-GroupSnapshotsV319Test-1313993213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:39 devstack sudo[93846]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b448586f-74d3-48da-b706-e5446b082292 tempest-VolumesListAdminTestJSON-1964715607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ae6421c0-fb8d-428d-baa2-7769e5b4e415 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c503a825-542a-4fbc-9488-637f97f841a2 tempest-VolumeTypesAccessTest-612395217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b09da348-d18e-4761-ae52-e08f668b84d7" returned: 0 in 1.523s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:39 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-c503a825-542a-4fbc-9488-637f97f841a2 tempest-VolumeTypesAccessTest-612395217 None] <== create_volume: return (2679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:41:39 devstack sudo[93866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5 Jul 10 06:41:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c503a825-542a-4fbc-9488-637f97f841a2 tempest-VolumeTypesAccessTest-612395217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.685s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:41:39 devstack sudo[93866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:39 devstack sudo[93867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ae6421c0-fb8d-428d-baa2-7769e5b4e415 Jul 10 06:41:39 devstack sudo[93867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c503a825-542a-4fbc-9488-637f97f841a2 tempest-VolumeTypesAccessTest-612395217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3efa4d5-da04-495c-89f7-079b022fa837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b09da348-d18e-4761-ae52-e08f668b84d7', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c503a825-542a-4fbc-9488-637f97f841a2 tempest-VolumeTypesAccessTest-612395217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5e7ba53-5fb0-4adf-acc1-b152a1f9763f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:41:39 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-c503a825-542a-4fbc-9488-637f97f841a2 tempest-VolumeTypesAccessTest-612395217 None] Volume volume-b09da348-d18e-4761-ae52-e08f668b84d7 (b09da348-d18e-4761-ae52-e08f668b84d7): created successfully Jul 10 06:41:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c503a825-542a-4fbc-9488-637f97f841a2 tempest-VolumeTypesAccessTest-612395217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5e7ba53-5fb0-4adf-acc1-b152a1f9763f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:41:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c503a825-542a-4fbc-9488-637f97f841a2 tempest-VolumeTypesAccessTest-612395217 None] Flow 'volume_create_manager' (0776a6cb-728c-4838-9ea4-78c208786875) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:41:39 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-c503a825-542a-4fbc-9488-637f97f841a2 tempest-VolumeTypesAccessTest-612395217 None] Created volume successfully. Jul 10 06:41:39 devstack sudo[93855]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3412ae2-272a-4800-aea7-ef970a73befe tempest-VolumesListAdminTestJSON-329557488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-38151a9c-9e98-427c-805c-a77ac84e228a" returned: 0 in 0.989s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:39 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f3412ae2-272a-4800-aea7-ef970a73befe tempest-VolumesListAdminTestJSON-329557488 None] Lock "cinder-quobyte-38151a9c-9e98-427c-805c-a77ac84e228a" released by "delete_volume" :: held 2.328s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:41:40 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-f3412ae2-272a-4800-aea7-ef970a73befe tempest-VolumesListAdminTestJSON-329557488 None] Created reservations ['0c881ee6-19b8-4da2-9096-c70331b0c013', 'd8a7b775-8f94-4bdb-9ea5-b1a63d782071', 'f7e79275-f02d-43e4-82ce-19981d674ada', 'a5828ffa-7692-4232-b15b-04a8e6e4fdc6'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:41:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3412ae2-272a-4800-aea7-ef970a73befe tempest-VolumesListAdminTestJSON-329557488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:41:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3412ae2-272a-4800-aea7-ef970a73befe tempest-VolumesListAdminTestJSON-329557488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:41:40 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3412ae2-272a-4800-aea7-ef970a73befe tempest-VolumesListAdminTestJSON-329557488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:41:40 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3412ae2-272a-4800-aea7-ef970a73befe tempest-VolumesListAdminTestJSON-329557488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:41:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3412ae2-272a-4800-aea7-ef970a73befe tempest-VolumesListAdminTestJSON-329557488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:41:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3412ae2-272a-4800-aea7-ef970a73befe tempest-VolumesListAdminTestJSON-329557488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:40 devstack sudo[93871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:41:40 devstack sudo[93871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:40 devstack sudo[93866]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9f83cb06-935b-49a2-84bd-ca35fe3211e1 tempest-GroupSnapshotsV319Test-1313993213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5" returned: 0 in 1.049s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:40 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-9f83cb06-935b-49a2-84bd-ca35fe3211e1 tempest-GroupSnapshotsV319Test-1313993213 None] Lock "cinder-quobyte-f91c4902-2a4c-4a2a-9c24-36fcc0a455f5" released by "delete_volume" :: held 2.255s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:41:40 devstack sudo[93867]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b448586f-74d3-48da-b706-e5446b082292 tempest-VolumesListAdminTestJSON-1964715607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ae6421c0-fb8d-428d-baa2-7769e5b4e415" returned: 0 in 1.079s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:40 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b448586f-74d3-48da-b706-e5446b082292 tempest-VolumesListAdminTestJSON-1964715607 None] Lock "cinder-quobyte-ae6421c0-fb8d-428d-baa2-7769e5b4e415" released by "delete_volume" :: held 2.762s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:41:40 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-9f83cb06-935b-49a2-84bd-ca35fe3211e1 tempest-GroupSnapshotsV319Test-1313993213 None] Created reservations ['316d7529-e5bf-4f15-ab30-aea8a2268abe'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:41:40 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-b448586f-74d3-48da-b706-e5446b082292 tempest-VolumesListAdminTestJSON-1964715607 None] Created reservations ['7e33836a-bfc5-46f9-ab0e-50b880c790ec', '933ae8dc-ef54-4795-a0e0-67979a48b1be', 'fbba764b-b722-472d-86fa-b7015e67b3b7', '6e300e09-b714-4935-aa8e-66b9a05461aa'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:41:40 devstack cinder-volume[87294]: WARNING cinder.quota [None req-9f83cb06-935b-49a2-84bd-ca35fe3211e1 tempest-GroupSnapshotsV319Test-1313993213 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-907069684 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-907069684, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:41:40 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-9f83cb06-935b-49a2-84bd-ca35fe3211e1 tempest-GroupSnapshotsV319Test-1313993213 None] Created reservations ['1ac303b7-4e1a-4449-ace6-d38bb80ed906', '5f9c8ef6-9fbc-4d3d-87a3-048f46296840', 'fe542318-4cf5-43fb-aa47-31f7d4079988', 'de77d11b-95e1-4cd4-b908-708b9a9a7c07'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:41:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b448586f-74d3-48da-b706-e5446b082292 tempest-VolumesListAdminTestJSON-1964715607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:41:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b448586f-74d3-48da-b706-e5446b082292 tempest-VolumesListAdminTestJSON-1964715607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:41:40 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b448586f-74d3-48da-b706-e5446b082292 tempest-VolumesListAdminTestJSON-1964715607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:41:40 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b448586f-74d3-48da-b706-e5446b082292 tempest-VolumesListAdminTestJSON-1964715607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:41:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b448586f-74d3-48da-b706-e5446b082292 tempest-VolumesListAdminTestJSON-1964715607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:41:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b448586f-74d3-48da-b706-e5446b082292 tempest-VolumesListAdminTestJSON-1964715607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:40 devstack sudo[93876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:41:40 devstack sudo[93876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:40 devstack sudo[93871]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9f83cb06-935b-49a2-84bd-ca35fe3211e1 tempest-GroupSnapshotsV319Test-1313993213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:41:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9f83cb06-935b-49a2-84bd-ca35fe3211e1 tempest-GroupSnapshotsV319Test-1313993213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:41:41 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9f83cb06-935b-49a2-84bd-ca35fe3211e1 tempest-GroupSnapshotsV319Test-1313993213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:41:41 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9f83cb06-935b-49a2-84bd-ca35fe3211e1 tempest-GroupSnapshotsV319Test-1313993213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:41:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9f83cb06-935b-49a2-84bd-ca35fe3211e1 tempest-GroupSnapshotsV319Test-1313993213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:41:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9f83cb06-935b-49a2-84bd-ca35fe3211e1 tempest-GroupSnapshotsV319Test-1313993213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3412ae2-272a-4800-aea7-ef970a73befe tempest-VolumesListAdminTestJSON-329557488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.863s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:41 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-f3412ae2-272a-4800-aea7-ef970a73befe tempest-VolumesListAdminTestJSON-329557488 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:41:41 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-f3412ae2-272a-4800-aea7-ef970a73befe tempest-VolumesListAdminTestJSON-329557488 None] Deleted volume successfully. Jul 10 06:41:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e9700083-2be8-491e-a7df-e027cb5eb5ac tempest-VolumeTypesAccessTest-612395217 None] Acquiring lock "cinder-b09da348-d18e-4761-ae52-e08f668b84d7-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:41:41 devstack sudo[93878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:41:41 devstack sudo[93878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e9700083-2be8-491e-a7df-e027cb5eb5ac tempest-VolumeTypesAccessTest-612395217 None] Lock "cinder-b09da348-d18e-4761-ae52-e08f668b84d7-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:41:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f3412ae2-272a-4800-aea7-ef970a73befe tempest-VolumesListAdminTestJSON-329557488 None] Lock "cinder-38151a9c-9e98-427c-805c-a77ac84e228a-delete_volume" released by "delete_volume" :: held 3.560s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:41:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e9700083-2be8-491e-a7df-e027cb5eb5ac tempest-VolumeTypesAccessTest-612395217 None] Acquiring lock "cinder-quobyte-b09da348-d18e-4761-ae52-e08f668b84d7" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:41:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e9700083-2be8-491e-a7df-e027cb5eb5ac tempest-VolumeTypesAccessTest-612395217 None] Lock "cinder-quobyte-b09da348-d18e-4761-ae52-e08f668b84d7" acquired by "delete_volume" :: waited 0.022s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:41:41 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b3a6dc-a98d-42ff-a44c-b9ea7715a685]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:41:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e9700083-2be8-491e-a7df-e027cb5eb5ac tempest-VolumeTypesAccessTest-612395217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b09da348-d18e-4761-ae52-e08f668b84d7 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:41 devstack sudo[93880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b09da348-d18e-4761-ae52-e08f668b84d7 Jul 10 06:41:41 devstack sudo[93880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b2738e40-18cf-4551-8a2c-ddf39367d79c tempest-VolumesListAdminTestJSON-1964715607 None] Acquiring lock "cinder-46b04e2a-aa17-4743-b030-51f08b901f69-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:41:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b2738e40-18cf-4551-8a2c-ddf39367d79c tempest-VolumesListAdminTestJSON-1964715607 None] Lock "cinder-46b04e2a-aa17-4743-b030-51f08b901f69-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:41:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b2738e40-18cf-4551-8a2c-ddf39367d79c tempest-VolumesListAdminTestJSON-1964715607 None] Acquiring lock "cinder-quobyte-46b04e2a-aa17-4743-b030-51f08b901f69" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:41:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b2738e40-18cf-4551-8a2c-ddf39367d79c tempest-VolumesListAdminTestJSON-1964715607 None] Lock "cinder-quobyte-46b04e2a-aa17-4743-b030-51f08b901f69" acquired by "delete_volume" :: waited 0.031s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:41:41 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a9a248-5ee4-44c9-b7d0-d01eee04a433]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:41:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b2738e40-18cf-4551-8a2c-ddf39367d79c tempest-VolumesListAdminTestJSON-1964715607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-46b04e2a-aa17-4743-b030-51f08b901f69 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:41 devstack sudo[93882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-46b04e2a-aa17-4743-b030-51f08b901f69 Jul 10 06:41:41 devstack sudo[93882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:41 devstack sudo[93876]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b448586f-74d3-48da-b706-e5446b082292 tempest-VolumesListAdminTestJSON-1964715607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.092s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:41 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-b448586f-74d3-48da-b706-e5446b082292 tempest-VolumesListAdminTestJSON-1964715607 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:41:41 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-b448586f-74d3-48da-b706-e5446b082292 tempest-VolumesListAdminTestJSON-1964715607 None] Deleted volume successfully. Jul 10 06:41:42 devstack sudo[93878]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b448586f-74d3-48da-b706-e5446b082292 tempest-VolumesListAdminTestJSON-1964715607 None] Lock "cinder-ae6421c0-fb8d-428d-baa2-7769e5b4e415-delete_volume" released by "delete_volume" :: held 4.278s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:41:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9f83cb06-935b-49a2-84bd-ca35fe3211e1 tempest-GroupSnapshotsV319Test-1313993213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.019s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:42 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-9f83cb06-935b-49a2-84bd-ca35fe3211e1 tempest-GroupSnapshotsV319Test-1313993213 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:41:42 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-9f83cb06-935b-49a2-84bd-ca35fe3211e1 tempest-GroupSnapshotsV319Test-1313993213 None] Delete group completed successfully. Jul 10 06:41:42 devstack sudo[93880]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e9700083-2be8-491e-a7df-e027cb5eb5ac tempest-VolumeTypesAccessTest-612395217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b09da348-d18e-4761-ae52-e08f668b84d7" returned: 0 in 1.156s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e9700083-2be8-491e-a7df-e027cb5eb5ac tempest-VolumeTypesAccessTest-612395217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b09da348-d18e-4761-ae52-e08f668b84d7 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:42 devstack sudo[93889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b09da348-d18e-4761-ae52-e08f668b84d7 Jul 10 06:41:42 devstack sudo[93889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:42 devstack sudo[93882]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b2738e40-18cf-4551-8a2c-ddf39367d79c tempest-VolumesListAdminTestJSON-1964715607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-46b04e2a-aa17-4743-b030-51f08b901f69" returned: 0 in 1.227s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b2738e40-18cf-4551-8a2c-ddf39367d79c tempest-VolumesListAdminTestJSON-1964715607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-46b04e2a-aa17-4743-b030-51f08b901f69 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:42 devstack sudo[93894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-46b04e2a-aa17-4743-b030-51f08b901f69 Jul 10 06:41:42 devstack sudo[93894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:43 devstack sudo[93889]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e9700083-2be8-491e-a7df-e027cb5eb5ac tempest-VolumeTypesAccessTest-612395217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b09da348-d18e-4761-ae52-e08f668b84d7" returned: 0 in 0.824s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:43 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e9700083-2be8-491e-a7df-e027cb5eb5ac tempest-VolumeTypesAccessTest-612395217 None] Lock "cinder-quobyte-b09da348-d18e-4761-ae52-e08f668b84d7" released by "delete_volume" :: held 2.042s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:41:43 devstack cinder-volume[87294]: WARNING cinder.quota [None req-e9700083-2be8-491e-a7df-e027cb5eb5ac tempest-VolumeTypesAccessTest-612395217 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-388093510 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-388093510, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:41:43 devstack cinder-volume[87294]: WARNING cinder.quota [None req-e9700083-2be8-491e-a7df-e027cb5eb5ac tempest-VolumeTypesAccessTest-612395217 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-388093510 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-388093510, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:41:43 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-e9700083-2be8-491e-a7df-e027cb5eb5ac tempest-VolumeTypesAccessTest-612395217 None] Created reservations ['72ce28c8-0b6d-4d47-8a94-518c2d28df78', '0641f56b-015b-473f-80e5-891bfa8bf222', 'b9307c6b-9339-4d97-b322-5a2abc462738', '1bf25031-68ea-4837-9435-572c506d5de3'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:41:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e9700083-2be8-491e-a7df-e027cb5eb5ac tempest-VolumeTypesAccessTest-612395217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:41:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e9700083-2be8-491e-a7df-e027cb5eb5ac tempest-VolumeTypesAccessTest-612395217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:41:43 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-e9700083-2be8-491e-a7df-e027cb5eb5ac tempest-VolumeTypesAccessTest-612395217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:41:43 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-e9700083-2be8-491e-a7df-e027cb5eb5ac tempest-VolumeTypesAccessTest-612395217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:41:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e9700083-2be8-491e-a7df-e027cb5eb5ac tempest-VolumeTypesAccessTest-612395217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:41:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e9700083-2be8-491e-a7df-e027cb5eb5ac tempest-VolumeTypesAccessTest-612395217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:43 devstack sudo[93897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:41:43 devstack sudo[93897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:43 devstack sudo[93894]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b2738e40-18cf-4551-8a2c-ddf39367d79c tempest-VolumesListAdminTestJSON-1964715607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-46b04e2a-aa17-4743-b030-51f08b901f69" returned: 0 in 0.976s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:43 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b2738e40-18cf-4551-8a2c-ddf39367d79c tempest-VolumesListAdminTestJSON-1964715607 None] Lock "cinder-quobyte-46b04e2a-aa17-4743-b030-51f08b901f69" released by "delete_volume" :: held 2.258s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:41:43 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-b2738e40-18cf-4551-8a2c-ddf39367d79c tempest-VolumesListAdminTestJSON-1964715607 None] Created reservations ['e6e36597-edbf-4b4f-82eb-120c44d25587', 'c291309d-5e45-4176-a21c-4d8b96b4220a', '0f1d2ba0-d423-4a9f-8755-8eedb4967b5a', '99f2dc18-c6b0-4af9-9aaf-3f99069611ed'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:41:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b2738e40-18cf-4551-8a2c-ddf39367d79c tempest-VolumesListAdminTestJSON-1964715607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:41:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b2738e40-18cf-4551-8a2c-ddf39367d79c tempest-VolumesListAdminTestJSON-1964715607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:41:43 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b2738e40-18cf-4551-8a2c-ddf39367d79c tempest-VolumesListAdminTestJSON-1964715607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:41:43 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b2738e40-18cf-4551-8a2c-ddf39367d79c tempest-VolumesListAdminTestJSON-1964715607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:41:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b2738e40-18cf-4551-8a2c-ddf39367d79c tempest-VolumesListAdminTestJSON-1964715607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:41:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b2738e40-18cf-4551-8a2c-ddf39367d79c tempest-VolumesListAdminTestJSON-1964715607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:43 devstack sudo[93900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:41:43 devstack sudo[93900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:44 devstack sudo[93897]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e9700083-2be8-491e-a7df-e027cb5eb5ac tempest-VolumeTypesAccessTest-612395217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.042s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:44 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-e9700083-2be8-491e-a7df-e027cb5eb5ac tempest-VolumeTypesAccessTest-612395217 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:41:44 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-e9700083-2be8-491e-a7df-e027cb5eb5ac tempest-VolumeTypesAccessTest-612395217 None] Deleted volume successfully. Jul 10 06:41:44 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e9700083-2be8-491e-a7df-e027cb5eb5ac tempest-VolumeTypesAccessTest-612395217 None] Lock "cinder-b09da348-d18e-4761-ae52-e08f668b84d7-delete_volume" released by "delete_volume" :: held 3.423s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:41:44 devstack sudo[93900]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b2738e40-18cf-4551-8a2c-ddf39367d79c tempest-VolumesListAdminTestJSON-1964715607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.971s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:44 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-b2738e40-18cf-4551-8a2c-ddf39367d79c tempest-VolumesListAdminTestJSON-1964715607 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:41:44 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-b2738e40-18cf-4551-8a2c-ddf39367d79c tempest-VolumesListAdminTestJSON-1964715607 None] Deleted volume successfully. Jul 10 06:41:44 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b2738e40-18cf-4551-8a2c-ddf39367d79c tempest-VolumesListAdminTestJSON-1964715607 None] Lock "cinder-46b04e2a-aa17-4743-b030-51f08b901f69-delete_volume" released by "delete_volume" :: held 3.529s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:41:44 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-708b5a64-8761-449c-9582-76f844e47d41 tempest-VolumesListAdminTestJSON-1964715607 None] Acquiring lock "cinder-62d7450b-cc7a-4826-bad0-ae7af14a32c8-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:41:45 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-708b5a64-8761-449c-9582-76f844e47d41 tempest-VolumesListAdminTestJSON-1964715607 None] Lock "cinder-62d7450b-cc7a-4826-bad0-ae7af14a32c8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:41:45 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-708b5a64-8761-449c-9582-76f844e47d41 tempest-VolumesListAdminTestJSON-1964715607 None] Acquiring lock "cinder-quobyte-62d7450b-cc7a-4826-bad0-ae7af14a32c8" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:41:45 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-708b5a64-8761-449c-9582-76f844e47d41 tempest-VolumesListAdminTestJSON-1964715607 None] Lock "cinder-quobyte-62d7450b-cc7a-4826-bad0-ae7af14a32c8" acquired by "delete_volume" :: waited 0.020s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:41:45 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4afc536-89cb-49fd-b5ed-c8f19e6d8644]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:41:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-708b5a64-8761-449c-9582-76f844e47d41 tempest-VolumesListAdminTestJSON-1964715607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-62d7450b-cc7a-4826-bad0-ae7af14a32c8 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:45 devstack sudo[93904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-62d7450b-cc7a-4826-bad0-ae7af14a32c8 Jul 10 06:41:45 devstack sudo[93904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:46 devstack sudo[93904]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-708b5a64-8761-449c-9582-76f844e47d41 tempest-VolumesListAdminTestJSON-1964715607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-62d7450b-cc7a-4826-bad0-ae7af14a32c8" returned: 0 in 0.996s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-708b5a64-8761-449c-9582-76f844e47d41 tempest-VolumesListAdminTestJSON-1964715607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-62d7450b-cc7a-4826-bad0-ae7af14a32c8 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:46 devstack sudo[93909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-62d7450b-cc7a-4826-bad0-ae7af14a32c8 Jul 10 06:41:46 devstack sudo[93909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:47 devstack sudo[93909]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-708b5a64-8761-449c-9582-76f844e47d41 tempest-VolumesListAdminTestJSON-1964715607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-62d7450b-cc7a-4826-bad0-ae7af14a32c8" returned: 0 in 0.856s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:47 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-708b5a64-8761-449c-9582-76f844e47d41 tempest-VolumesListAdminTestJSON-1964715607 None] Lock "cinder-quobyte-62d7450b-cc7a-4826-bad0-ae7af14a32c8" released by "delete_volume" :: held 1.928s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:41:47 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-708b5a64-8761-449c-9582-76f844e47d41 tempest-VolumesListAdminTestJSON-1964715607 None] Created reservations ['9816950c-0670-435c-9515-c9dda33006b7', 'cc380420-603a-4df8-872b-c324c128abb5', '69a53299-813d-4eb4-b3b4-2b373d66fcf1', '92fa5694-7d5d-430d-b540-d96382785b58'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:41:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-708b5a64-8761-449c-9582-76f844e47d41 tempest-VolumesListAdminTestJSON-1964715607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:41:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-708b5a64-8761-449c-9582-76f844e47d41 tempest-VolumesListAdminTestJSON-1964715607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:41:47 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-708b5a64-8761-449c-9582-76f844e47d41 tempest-VolumesListAdminTestJSON-1964715607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:41:47 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-708b5a64-8761-449c-9582-76f844e47d41 tempest-VolumesListAdminTestJSON-1964715607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:41:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-708b5a64-8761-449c-9582-76f844e47d41 tempest-VolumesListAdminTestJSON-1964715607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:41:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-708b5a64-8761-449c-9582-76f844e47d41 tempest-VolumesListAdminTestJSON-1964715607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:41:47 devstack sudo[93915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:41:47 devstack sudo[93915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:41:48 devstack sudo[93915]: pam_unix(sudo:session): session closed for user root Jul 10 06:41:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-708b5a64-8761-449c-9582-76f844e47d41 tempest-VolumesListAdminTestJSON-1964715607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.935s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:41:48 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-708b5a64-8761-449c-9582-76f844e47d41 tempest-VolumesListAdminTestJSON-1964715607 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:41:48 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-708b5a64-8761-449c-9582-76f844e47d41 tempest-VolumesListAdminTestJSON-1964715607 None] Deleted volume successfully. Jul 10 06:41:48 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-708b5a64-8761-449c-9582-76f844e47d41 tempest-VolumesListAdminTestJSON-1964715607 None] Lock "cinder-62d7450b-cc7a-4826-bad0-ae7af14a32c8-delete_volume" released by "delete_volume" :: held 3.220s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:41:57 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:SELECT=92,cinder:INSERT=27,cinder:UPDATE=116,cinder:DELETE=6 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:41:58 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-42ed1229-f80b-4769-9a4b-db83dd5c7962 tempest-GroupsTest-348137327 None] Group tempest-Group1-968492664: creating Jul 10 06:41:58 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-42ed1229-f80b-4769-9a4b-db83dd5c7962 tempest-GroupsTest-348137327 None] Group tempest-Group1-968492664: created successfully Jul 10 06:41:58 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-42ed1229-f80b-4769-9a4b-db83dd5c7962 tempest-GroupsTest-348137327 None] Create group completed successfully. Jul 10 06:41:59 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-81a1c404-0765-4b42-a56b-d0fc6fbfbaee tempest-GroupsTest-348137327 None] Group tempest-Group2-419596752: creating Jul 10 06:41:59 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-81a1c404-0765-4b42-a56b-d0fc6fbfbaee tempest-GroupsTest-348137327 None] Group tempest-Group2-419596752: created successfully Jul 10 06:41:59 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-81a1c404-0765-4b42-a56b-d0fc6fbfbaee tempest-GroupsTest-348137327 None] Create group completed successfully. Jul 10 06:42:00 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:42:00 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Flow 'volume_create_manager' (93cdb8cc-565b-45a5-8f44-a84a17213fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:42:00 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19935ae8-a085-41b6-aaac-57e7444df247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:00 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19935ae8-a085-41b6-aaac-57e7444df247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:42:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-452142769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d4d4a7e-1691-4c7e-a621-83a65b241167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12c8b36a11594d15b1683e5bb9864296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:42:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:42:00Z,use_quota=True,user_id='aa77e096fee744699269570286caaf84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:00 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3d4fd05-53dd-4ea1-a4ad-343f6311d0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:00 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3d4fd05-53dd-4ea1-a4ad-343f6311d0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:00 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56d78ae2-8f25-40d3-bb3b-55a35a549d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:00 devstack cinder-volume[87294]: DEBUG cinder.image.glance [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Creating Keystone auth plugin from conf {{(pid=87294) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 06:42:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56d78ae2-8f25-40d3-bb3b-55a35a549d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1d4d4a7e-1691-4c7e-a621-83a65b241167', 'volume_name': 'volume-1d4d4a7e-1691-4c7e-a621-83a65b241167', 'volume_size': 1, 'image_id': 'fce564e0-408f-448f-b73c-5fae94549898', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fce564e0-408f-448f-b73c-5fae94549898', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '62db6635aac548658dfcc55ac904ccde', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fce564e0-408f-448f-b73c-5fae94549898', 'created_at': datetime.datetime(2026, 7, 10, 4, 29, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 29, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fce564e0-408f-448f-b73c-5fae94549898/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b489787-0289-4c2b-9939-e529745a25b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b489787-0289-4c2b-9939-e529745a25b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3690c9bc-cd80-46c7-b717-df7669affbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:01 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Volume 1d4d4a7e-1691-4c7e-a621-83a65b241167: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1d4d4a7e-1691-4c7e-a621-83a65b241167', 'volume_size': 1, 'image_id': 'fce564e0-408f-448f-b73c-5fae94549898', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fce564e0-408f-448f-b73c-5fae94549898', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '62db6635aac548658dfcc55ac904ccde', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fce564e0-408f-448f-b73c-5fae94549898', 'created_at': datetime.datetime(2026, 7, 10, 4, 29, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 29, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fce564e0-408f-448f-b73c-5fae94549898/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 06:42:01 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Trying to clone 1d4d4a7e-1691-4c7e-a621-83a65b241167 from image fce564e0-408f-448f-b73c-5fae94549898 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fce564e0-408f-448f-b73c-5fae94549898', 'metadata': {}}]). {{(pid=87294) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 06:42:01 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-67db9b83-5c01-425e-8ad0-dc61de813932 tempest-GroupsTest-348137327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:42:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-67db9b83-5c01-425e-8ad0-dc61de813932 tempest-GroupsTest-348137327 None] Flow 'volume_create_manager' (7bf9645f-5c82-4519-89d8-9b4d870442b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:42:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-67db9b83-5c01-425e-8ad0-dc61de813932 tempest-GroupsTest-348137327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (699adef7-b985-4eb4-a2a3-cda8ce0a836d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-67db9b83-5c01-425e-8ad0-dc61de813932 tempest-GroupsTest-348137327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (699adef7-b985-4eb4-a2a3-cda8ce0a836d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-662345906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d6bef9f4-b381-4b3b-8799-249f72ca1a30,host='devstack@QuobyteHD#QuobyteHD',id=ad620411-c655-4f48-bba3-619d54f25ab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31eabcf2da754ca483349336da7d45fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:42:01Z,use_quota=True,user_id='7a04818c7ea1467ea69ea0ab7c78589d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70946240-30a9-42ba-8880-23376b0308db),volume_type_id=70946240-30a9-42ba-8880-23376b0308db)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-67db9b83-5c01-425e-8ad0-dc61de813932 tempest-GroupsTest-348137327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (944094bd-f0f1-4c66-9afe-614cb342b021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-67db9b83-5c01-425e-8ad0-dc61de813932 tempest-GroupsTest-348137327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (944094bd-f0f1-4c66-9afe-614cb342b021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-67db9b83-5c01-425e-8ad0-dc61de813932 tempest-GroupsTest-348137327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7378dd03-e64c-4a38-be96-9dd7145e69a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-67db9b83-5c01-425e-8ad0-dc61de813932 tempest-GroupsTest-348137327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7378dd03-e64c-4a38-be96-9dd7145e69a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad620411-c655-4f48-bba3-619d54f25ab0', 'volume_name': 'volume-ad620411-c655-4f48-bba3-619d54f25ab0', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-67db9b83-5c01-425e-8ad0-dc61de813932 tempest-GroupsTest-348137327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6a030da-1a05-492e-a793-f97b42d7c0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-67db9b83-5c01-425e-8ad0-dc61de813932 tempest-GroupsTest-348137327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6a030da-1a05-492e-a793-f97b42d7c0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-67db9b83-5c01-425e-8ad0-dc61de813932 tempest-GroupsTest-348137327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f2ef299-b870-4a85-8522-bd4d0b708318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:01 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-67db9b83-5c01-425e-8ad0-dc61de813932 tempest-GroupsTest-348137327 None] Volume ad620411-c655-4f48-bba3-619d54f25ab0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad620411-c655-4f48-bba3-619d54f25ab0', 'volume_size': 1} Jul 10 06:42:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-67db9b83-5c01-425e-8ad0-dc61de813932 tempest-GroupsTest-348137327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-67db9b83-5c01-425e-8ad0-dc61de813932 tempest-GroupsTest-348137327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:01 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-67db9b83-5c01-425e-8ad0-dc61de813932 tempest-GroupsTest-348137327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d6bef9f4-b381-4b3b-8799-249f72ca1a30,created_at=2026-07-10T04:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-662345906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d6bef9f4-b381-4b3b-8799-249f72ca1a30,host='devstack@QuobyteHD#QuobyteHD',id=ad620411-c655-4f48-bba3-619d54f25ab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31eabcf2da754ca483349336da7d45fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:42:01Z,use_quota=True,user_id='7a04818c7ea1467ea69ea0ab7c78589d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70946240-30a9-42ba-8880-23376b0308db),volume_type_id=70946240-30a9-42ba-8880-23376b0308db)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:42:01 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-67db9b83-5c01-425e-8ad0-dc61de813932 tempest-GroupsTest-348137327 None] Creating volume ad620411-c655-4f48-bba3-619d54f25ab0 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:42:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-67db9b83-5c01-425e-8ad0-dc61de813932 tempest-GroupsTest-348137327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-67db9b83-5c01-425e-8ad0-dc61de813932 tempest-GroupsTest-348137327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:01 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-67db9b83-5c01-425e-8ad0-dc61de813932 tempest-GroupsTest-348137327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:42:01 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-67db9b83-5c01-425e-8ad0-dc61de813932 tempest-GroupsTest-348137327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:42:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-67db9b83-5c01-425e-8ad0-dc61de813932 tempest-GroupsTest-348137327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:01 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-67db9b83-5c01-425e-8ad0-dc61de813932 tempest-GroupsTest-348137327 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:42:01 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-67db9b83-5c01-425e-8ad0-dc61de813932 tempest-GroupsTest-348137327 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:42:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-67db9b83-5c01-425e-8ad0-dc61de813932 tempest-GroupsTest-348137327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ad620411-c655-4f48-bba3-619d54f25ab0 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:01 devstack sudo[94012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ad620411-c655-4f48-bba3-619d54f25ab0 1073741824 Jul 10 06:42:01 devstack sudo[94012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:01 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-bea06aa7-fae3-4317-9f02-51d1a5b6735d tempest-VolumesDeleteCascade-747554758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:42:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bea06aa7-fae3-4317-9f02-51d1a5b6735d tempest-VolumesDeleteCascade-747554758 None] Flow 'volume_create_manager' (1345c24f-ae31-4be1-9df5-8027a110073b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:42:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bea06aa7-fae3-4317-9f02-51d1a5b6735d tempest-VolumesDeleteCascade-747554758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47a5bee6-0d88-4367-a95d-0658d64b90d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:02 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bea06aa7-fae3-4317-9f02-51d1a5b6735d tempest-VolumesDeleteCascade-747554758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47a5bee6-0d88-4367-a95d-0658d64b90d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1429752741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea95490f-2979-4071-8f07-135cddd0a35f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edc0dece380f4ae78fe0514a5474e3f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:42:02Z,use_quota=True,user_id='e885507eb88547068275d84b848318a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:02 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bea06aa7-fae3-4317-9f02-51d1a5b6735d tempest-VolumesDeleteCascade-747554758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (913325d5-2700-4a02-b580-2d45f335d6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:02 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bea06aa7-fae3-4317-9f02-51d1a5b6735d tempest-VolumesDeleteCascade-747554758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (913325d5-2700-4a02-b580-2d45f335d6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:02 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bea06aa7-fae3-4317-9f02-51d1a5b6735d tempest-VolumesDeleteCascade-747554758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d442828-ce6a-4eb9-b79c-73f8fbe34a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:02 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bea06aa7-fae3-4317-9f02-51d1a5b6735d tempest-VolumesDeleteCascade-747554758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d442828-ce6a-4eb9-b79c-73f8fbe34a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea95490f-2979-4071-8f07-135cddd0a35f', 'volume_name': 'volume-ea95490f-2979-4071-8f07-135cddd0a35f', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:02 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bea06aa7-fae3-4317-9f02-51d1a5b6735d tempest-VolumesDeleteCascade-747554758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d973ada-59b2-4dd5-ba8d-c74b62436fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:02 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bea06aa7-fae3-4317-9f02-51d1a5b6735d tempest-VolumesDeleteCascade-747554758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d973ada-59b2-4dd5-ba8d-c74b62436fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:02 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bea06aa7-fae3-4317-9f02-51d1a5b6735d tempest-VolumesDeleteCascade-747554758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc64c0f-fbb8-40b0-8dbf-9e4420640b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:02 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-bea06aa7-fae3-4317-9f02-51d1a5b6735d tempest-VolumesDeleteCascade-747554758 None] Volume ea95490f-2979-4071-8f07-135cddd0a35f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea95490f-2979-4071-8f07-135cddd0a35f', 'volume_size': 1} Jul 10 06:42:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-bea06aa7-fae3-4317-9f02-51d1a5b6735d tempest-VolumesDeleteCascade-747554758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:02 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_ce5j3zjadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87294) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 06:42:02 devstack cinder-volume[87294]: INFO cinder.image.image_utils [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Image download 20.69 MB at 20.69 MB/s Jul 10 06:42:02 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd6c9f9-2161-4844-b737-ef8e4acdf688]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:42:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_ce5j3zjadevstack@QuobyteHD {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:02 devstack sudo[94035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_ce5j3zjadevstack@QuobyteHD Jul 10 06:42:02 devstack sudo[94035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:02 devstack sudo[94012]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-67db9b83-5c01-425e-8ad0-dc61de813932 tempest-GroupsTest-348137327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ad620411-c655-4f48-bba3-619d54f25ab0 1073741824" returned: 0 in 1.131s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-67db9b83-5c01-425e-8ad0-dc61de813932 tempest-GroupsTest-348137327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ad620411-c655-4f48-bba3-619d54f25ab0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:02 devstack sudo[94040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ad620411-c655-4f48-bba3-619d54f25ab0 Jul 10 06:42:02 devstack sudo[94040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:03 devstack sudo[94035]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_ce5j3zjadevstack@QuobyteHD" returned: 0 in 1.081s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:03 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Temporary image fce564e0-408f-448f-b73c-5fae94549898 is fetched for user aa77e096fee744699269570286caaf84. {{(pid=87294) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 06:42:03 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d515dc-9a88-4092-8222-b57df1c835a1]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:42:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_ce5j3zjadevstack@QuobyteHD {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:03 devstack sudo[94045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_ce5j3zjadevstack@QuobyteHD Jul 10 06:42:03 devstack sudo[94045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:03 devstack sudo[94040]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-67db9b83-5c01-425e-8ad0-dc61de813932 tempest-GroupsTest-348137327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ad620411-c655-4f48-bba3-619d54f25ab0" returned: 0 in 0.710s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:03 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-67db9b83-5c01-425e-8ad0-dc61de813932 tempest-GroupsTest-348137327 None] <== create_volume: return (1938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:42:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-67db9b83-5c01-425e-8ad0-dc61de813932 tempest-GroupsTest-348137327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.941s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-bea06aa7-fae3-4317-9f02-51d1a5b6735d tempest-VolumesDeleteCascade-747554758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.539s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:03 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-bea06aa7-fae3-4317-9f02-51d1a5b6735d tempest-VolumesDeleteCascade-747554758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1429752741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea95490f-2979-4071-8f07-135cddd0a35f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edc0dece380f4ae78fe0514a5474e3f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:42:02Z,use_quota=True,user_id='e885507eb88547068275d84b848318a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:42:03 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-bea06aa7-fae3-4317-9f02-51d1a5b6735d tempest-VolumesDeleteCascade-747554758 None] Creating volume ea95490f-2979-4071-8f07-135cddd0a35f {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:42:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-bea06aa7-fae3-4317-9f02-51d1a5b6735d tempest-VolumesDeleteCascade-747554758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-bea06aa7-fae3-4317-9f02-51d1a5b6735d tempest-VolumesDeleteCascade-747554758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:03 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-bea06aa7-fae3-4317-9f02-51d1a5b6735d tempest-VolumesDeleteCascade-747554758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:42:03 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-bea06aa7-fae3-4317-9f02-51d1a5b6735d tempest-VolumesDeleteCascade-747554758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:42:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-bea06aa7-fae3-4317-9f02-51d1a5b6735d tempest-VolumesDeleteCascade-747554758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:03 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-bea06aa7-fae3-4317-9f02-51d1a5b6735d tempest-VolumesDeleteCascade-747554758 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:42:03 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-bea06aa7-fae3-4317-9f02-51d1a5b6735d tempest-VolumesDeleteCascade-747554758 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:42:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bea06aa7-fae3-4317-9f02-51d1a5b6735d tempest-VolumesDeleteCascade-747554758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:03 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-67db9b83-5c01-425e-8ad0-dc61de813932 tempest-GroupsTest-348137327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f2ef299-b870-4a85-8522-bd4d0b708318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad620411-c655-4f48-bba3-619d54f25ab0', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:03 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-67db9b83-5c01-425e-8ad0-dc61de813932 tempest-GroupsTest-348137327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd654595-ce41-445f-a68b-86340b3ab1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:03 devstack sudo[94048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f 1073741824 Jul 10 06:42:03 devstack sudo[94048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:03 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-67db9b83-5c01-425e-8ad0-dc61de813932 tempest-GroupsTest-348137327 None] Volume volume-ad620411-c655-4f48-bba3-619d54f25ab0 (ad620411-c655-4f48-bba3-619d54f25ab0): created successfully Jul 10 06:42:03 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-67db9b83-5c01-425e-8ad0-dc61de813932 tempest-GroupsTest-348137327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd654595-ce41-445f-a68b-86340b3ab1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:03 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-67db9b83-5c01-425e-8ad0-dc61de813932 tempest-GroupsTest-348137327 None] Flow 'volume_create_manager' (7bf9645f-5c82-4519-89d8-9b4d870442b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:42:03 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-67db9b83-5c01-425e-8ad0-dc61de813932 tempest-GroupsTest-348137327 None] Created volume successfully. Jul 10 06:42:04 devstack sudo[94045]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_ce5j3zjadevstack@QuobyteHD" returned: 0 in 0.832s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:04 devstack sudo[94048]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bea06aa7-fae3-4317-9f02-51d1a5b6735d tempest-VolumesDeleteCascade-747554758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f 1073741824" returned: 0 in 1.175s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bea06aa7-fae3-4317-9f02-51d1a5b6735d tempest-VolumesDeleteCascade-747554758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:04 devstack sudo[94058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f Jul 10 06:42:04 devstack sudo[94058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:04 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-4def1e52-7506-4d84-88ea-8a0929e2f850 tempest-GroupsTest-348137327 None] Acquiring lock "cinder-quobyte-ad620411-c655-4f48-bba3-619d54f25ab0" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:42:04 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-4def1e52-7506-4d84-88ea-8a0929e2f850 tempest-GroupsTest-348137327 None] Lock "cinder-quobyte-ad620411-c655-4f48-bba3-619d54f25ab0" acquired by "delete_volume" :: waited 0.028s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:42:05 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[705672f7-e82d-40dd-bd86-b56cedf4bb7b]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:42:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-4def1e52-7506-4d84-88ea-8a0929e2f850 tempest-GroupsTest-348137327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ad620411-c655-4f48-bba3-619d54f25ab0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:05 devstack sudo[94060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ad620411-c655-4f48-bba3-619d54f25ab0 Jul 10 06:42:05 devstack sudo[94060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:05 devstack sudo[94058]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bea06aa7-fae3-4317-9f02-51d1a5b6735d tempest-VolumesDeleteCascade-747554758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f" returned: 0 in 0.925s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:05 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-bea06aa7-fae3-4317-9f02-51d1a5b6735d tempest-VolumesDeleteCascade-747554758 None] <== create_volume: return (2160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:42:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-bea06aa7-fae3-4317-9f02-51d1a5b6735d tempest-VolumesDeleteCascade-747554758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.163s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.560s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:05 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:42:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-452142769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d4d4a7e-1691-4c7e-a621-83a65b241167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12c8b36a11594d15b1683e5bb9864296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:42:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:42:00Z,use_quota=True,user_id='aa77e096fee744699269570286caaf84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:42:05 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Creating volume 1d4d4a7e-1691-4c7e-a621-83a65b241167 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:42:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:05 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:42:05 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:42:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:05 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:42:05 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:42:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1d4d4a7e-1691-4c7e-a621-83a65b241167 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:05 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bea06aa7-fae3-4317-9f02-51d1a5b6735d tempest-VolumesDeleteCascade-747554758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc64c0f-fbb8-40b0-8dbf-9e4420640b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea95490f-2979-4071-8f07-135cddd0a35f', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:05 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bea06aa7-fae3-4317-9f02-51d1a5b6735d tempest-VolumesDeleteCascade-747554758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd1a8371-eb13-44ce-b5ee-0d86c6e5786f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:05 devstack sudo[94064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1d4d4a7e-1691-4c7e-a621-83a65b241167 1073741824 Jul 10 06:42:05 devstack sudo[94064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:05 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-bea06aa7-fae3-4317-9f02-51d1a5b6735d tempest-VolumesDeleteCascade-747554758 None] Volume volume-ea95490f-2979-4071-8f07-135cddd0a35f (ea95490f-2979-4071-8f07-135cddd0a35f): created successfully Jul 10 06:42:05 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bea06aa7-fae3-4317-9f02-51d1a5b6735d tempest-VolumesDeleteCascade-747554758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd1a8371-eb13-44ce-b5ee-0d86c6e5786f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:05 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bea06aa7-fae3-4317-9f02-51d1a5b6735d tempest-VolumesDeleteCascade-747554758 None] Flow 'volume_create_manager' (1345c24f-ae31-4be1-9df5-8027a110073b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:42:05 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-bea06aa7-fae3-4317-9f02-51d1a5b6735d tempest-VolumesDeleteCascade-747554758 None] Created volume successfully. Jul 10 06:42:06 devstack sudo[94060]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-4def1e52-7506-4d84-88ea-8a0929e2f850 tempest-GroupsTest-348137327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ad620411-c655-4f48-bba3-619d54f25ab0" returned: 0 in 1.049s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-4def1e52-7506-4d84-88ea-8a0929e2f850 tempest-GroupsTest-348137327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ad620411-c655-4f48-bba3-619d54f25ab0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:06 devstack sudo[94069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ad620411-c655-4f48-bba3-619d54f25ab0 Jul 10 06:42:06 devstack sudo[94069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9e1fd6c8-e6b9-4d04-9713-3e7d6f05f4a0 tempest-VolumesDeleteCascade-747554758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:07 devstack sudo[94064]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1d4d4a7e-1691-4c7e-a621-83a65b241167 1073741824" returned: 0 in 1.262s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:07 devstack sudo[94069]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-4def1e52-7506-4d84-88ea-8a0929e2f850 tempest-GroupsTest-348137327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ad620411-c655-4f48-bba3-619d54f25ab0" returned: 0 in 0.995s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:07 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-4def1e52-7506-4d84-88ea-8a0929e2f850 tempest-GroupsTest-348137327 None] Lock "cinder-quobyte-ad620411-c655-4f48-bba3-619d54f25ab0" released by "delete_volume" :: held 2.123s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:42:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1d4d4a7e-1691-4c7e-a621-83a65b241167 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:07 devstack sudo[94077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1d4d4a7e-1691-4c7e-a621-83a65b241167 Jul 10 06:42:07 devstack sudo[94077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:07 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-4def1e52-7506-4d84-88ea-8a0929e2f850 tempest-GroupsTest-348137327 None] Created reservations ['e83a6583-a63f-44da-9583-119f99b267b5'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:42:07 devstack cinder-volume[87294]: WARNING cinder.quota [None req-4def1e52-7506-4d84-88ea-8a0929e2f850 tempest-GroupsTest-348137327 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-694431495 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-694431495, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:42:07 devstack cinder-volume[87294]: WARNING cinder.quota [None req-4def1e52-7506-4d84-88ea-8a0929e2f850 tempest-GroupsTest-348137327 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-694431495 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-694431495, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:42:07 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-4def1e52-7506-4d84-88ea-8a0929e2f850 tempest-GroupsTest-348137327 None] Created reservations ['6d14af92-e90a-4413-9b77-7c8c98be9c48', 'ba22350e-e6d8-4ad1-bd75-d6e5f291485f', '2fc8705a-602c-484e-973a-ec0bd388330c', 'f4659dfd-d37f-4169-b8d0-b53ef673a4a7'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:42:07 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:SELECT=100,cinder:UPDATE=129,cinder:INSERT=31,cinder:DELETE=13 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:42:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-4def1e52-7506-4d84-88ea-8a0929e2f850 tempest-GroupsTest-348137327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-4def1e52-7506-4d84-88ea-8a0929e2f850 tempest-GroupsTest-348137327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:07 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-4def1e52-7506-4d84-88ea-8a0929e2f850 tempest-GroupsTest-348137327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:42:07 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-4def1e52-7506-4d84-88ea-8a0929e2f850 tempest-GroupsTest-348137327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:42:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-4def1e52-7506-4d84-88ea-8a0929e2f850 tempest-GroupsTest-348137327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-4def1e52-7506-4d84-88ea-8a0929e2f850 tempest-GroupsTest-348137327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:07 devstack sudo[94079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:42:07 devstack sudo[94079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:07 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-f8318a93-765a-43aa-a240-82b7d0cfa124 tempest-GroupsTest-348137327 None] Created reservations ['4355704d-3df5-48dd-896e-35424cdc99a5'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:42:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f8318a93-765a-43aa-a240-82b7d0cfa124 tempest-GroupsTest-348137327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f8318a93-765a-43aa-a240-82b7d0cfa124 tempest-GroupsTest-348137327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:07 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f8318a93-765a-43aa-a240-82b7d0cfa124 tempest-GroupsTest-348137327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:42:07 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f8318a93-765a-43aa-a240-82b7d0cfa124 tempest-GroupsTest-348137327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:42:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f8318a93-765a-43aa-a240-82b7d0cfa124 tempest-GroupsTest-348137327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f8318a93-765a-43aa-a240-82b7d0cfa124 tempest-GroupsTest-348137327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:07 devstack sudo[94081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:42:07 devstack sudo[94081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:08 devstack sudo[94077]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1d4d4a7e-1691-4c7e-a621-83a65b241167" returned: 0 in 0.988s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:08 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] <== create_volume: return (2326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:42:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.329s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9e1fd6c8-e6b9-4d04-9713-3e7d6f05f4a0 tempest-VolumesDeleteCascade-747554758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.340s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:08 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-9e1fd6c8-e6b9-4d04-9713-3e7d6f05f4a0 tempest-VolumesDeleteCascade-747554758 None] Creating offline snapshot ff71f6f6-c16b-42a0-be2d-55edadd5f252 of volume ea95490f-2979-4071-8f07-135cddd0a35f {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:42:08 devstack cinder-volume[87294]: DEBUG cinder.volume.volume_utils [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Attempting download of fce564e0-408f-448f-b73c-5fae94549898 ((None, [{'url': 'file:///opt/stack/data/glance/images/fce564e0-408f-448f-b73c-5fae94549898', 'metadata': {}}])) to volume 1d4d4a7e-1691-4c7e-a621-83a65b241167. {{(pid=87294) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 06:42:08 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6cfdad-a9fe-4ba4-a0c4-9c4dda684288]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:42:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9e1fd6c8-e6b9-4d04-9713-3e7d6f05f4a0 tempest-VolumesDeleteCascade-747554758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:08 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b037aa-833e-4875-92bc-6871f86e817a]: (4, 'raw') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:42:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fce564e0-408f-448f-b73c-5fae94549898_929dhz6j {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:08 devstack sudo[94085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fce564e0-408f-448f-b73c-5fae94549898_929dhz6j Jul 10 06:42:08 devstack sudo[94085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:08 devstack sudo[94084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f Jul 10 06:42:08 devstack sudo[94084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:08 devstack sudo[94079]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-4def1e52-7506-4d84-88ea-8a0929e2f850 tempest-GroupsTest-348137327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.096s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:08 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-4def1e52-7506-4d84-88ea-8a0929e2f850 tempest-GroupsTest-348137327 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:42:08 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-4def1e52-7506-4d84-88ea-8a0929e2f850 tempest-GroupsTest-348137327 None] Delete group completed successfully. Jul 10 06:42:08 devstack sudo[94081]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f8318a93-765a-43aa-a240-82b7d0cfa124 tempest-GroupsTest-348137327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.911s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:08 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-f8318a93-765a-43aa-a240-82b7d0cfa124 tempest-GroupsTest-348137327 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:42:08 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-f8318a93-765a-43aa-a240-82b7d0cfa124 tempest-GroupsTest-348137327 None] Delete group completed successfully. Jul 10 06:42:09 devstack sudo[94085]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fce564e0-408f-448f-b73c-5fae94549898_929dhz6j" returned: 0 in 0.994s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fce564e0-408f-448f-b73c-5fae94549898_929dhz6j {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:09 devstack sudo[94084]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9e1fd6c8-e6b9-4d04-9713-3e7d6f05f4a0 tempest-VolumesDeleteCascade-747554758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f" returned: 0 in 1.158s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9e1fd6c8-e6b9-4d04-9713-3e7d6f05f4a0 tempest-VolumesDeleteCascade-747554758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.ff71f6f6-c16b-42a0-be2d-55edadd5f252 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:09 devstack sudo[94098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fce564e0-408f-448f-b73c-5fae94549898_929dhz6j Jul 10 06:42:09 devstack sudo[94098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:09 devstack sudo[94099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.ff71f6f6-c16b-42a0-be2d-55edadd5f252 1G Jul 10 06:42:09 devstack sudo[94099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:09 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-5dd95f4a-a029-4433-a922-299b95fc0ce3 tempest-GroupsTest-348137327 None] Group tempest-GroupsTest-Group-758144865: creating Jul 10 06:42:09 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-5dd95f4a-a029-4433-a922-299b95fc0ce3 tempest-GroupsTest-348137327 None] Group tempest-GroupsTest-Group-758144865: created successfully Jul 10 06:42:09 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-5dd95f4a-a029-4433-a922-299b95fc0ce3 tempest-GroupsTest-348137327 None] Create group completed successfully. Jul 10 06:42:10 devstack sudo[94098]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fce564e0-408f-448f-b73c-5fae94549898_929dhz6j" returned: 1 in 0.854s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fce564e0-408f-448f-b73c-5fae94549898_929dhz6j' failed. Not Retrying. {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:42:10 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1f66a9-466e-43a9-8eb0-a3a1752fb935]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:42:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_ce5j3zjadevstack@QuobyteHD {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:10 devstack sudo[94107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_ce5j3zjadevstack@QuobyteHD Jul 10 06:42:10 devstack sudo[94107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:10 devstack sudo[94099]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9e1fd6c8-e6b9-4d04-9713-3e7d6f05f4a0 tempest-VolumesDeleteCascade-747554758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.ff71f6f6-c16b-42a0-be2d-55edadd5f252 1G" returned: 0 in 0.945s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9e1fd6c8-e6b9-4d04-9713-3e7d6f05f4a0 tempest-VolumesDeleteCascade-747554758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea95490f-2979-4071-8f07-135cddd0a35f -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.ff71f6f6-c16b-42a0-be2d-55edadd5f252 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:10 devstack sudo[94109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea95490f-2979-4071-8f07-135cddd0a35f -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.ff71f6f6-c16b-42a0-be2d-55edadd5f252 Jul 10 06:42:10 devstack sudo[94109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:10 devstack sudo[94107]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_ce5j3zjadevstack@QuobyteHD" returned: 0 in 0.789s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:10 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] fce564e0-408f-448f-b73c-5fae94549898 was qcow2, converting to raw {{(pid=87294) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 06:42:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_ce5j3zjadevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1d4d4a7e-1691-4c7e-a621-83a65b241167 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:10 devstack sudo[94117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_ce5j3zjadevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1d4d4a7e-1691-4c7e-a621-83a65b241167 Jul 10 06:42:10 devstack sudo[94117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:11 devstack sudo[94109]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9e1fd6c8-e6b9-4d04-9713-3e7d6f05f4a0 tempest-VolumesDeleteCascade-747554758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea95490f-2979-4071-8f07-135cddd0a35f -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.ff71f6f6-c16b-42a0-be2d-55edadd5f252" returned: 0 in 0.811s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:11 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-9e1fd6c8-e6b9-4d04-9713-3e7d6f05f4a0 tempest-VolumesDeleteCascade-747554758 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.ff71f6f6-c16b-42a0-be2d-55edadd5f252 is being set with open permissions: ugo+rw Jul 10 06:42:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9e1fd6c8-e6b9-4d04-9713-3e7d6f05f4a0 tempest-VolumesDeleteCascade-747554758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.ff71f6f6-c16b-42a0-be2d-55edadd5f252 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:11 devstack sudo[94120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.ff71f6f6-c16b-42a0-be2d-55edadd5f252 Jul 10 06:42:11 devstack sudo[94120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:11 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-f90d12fd-80cf-451f-9432-a35d109e0d96 tempest-GroupsTest-348137327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:42:11 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f90d12fd-80cf-451f-9432-a35d109e0d96 tempest-GroupsTest-348137327 None] Flow 'volume_create_manager' (4b0f1ba5-6662-4ffe-a950-ea0cc412bf0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:42:11 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f90d12fd-80cf-451f-9432-a35d109e0d96 tempest-GroupsTest-348137327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f64bfeca-f246-40d0-a6a7-532aa2788a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:11 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f90d12fd-80cf-451f-9432-a35d109e0d96 tempest-GroupsTest-348137327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f64bfeca-f246-40d0-a6a7-532aa2788a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1312724341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f52cc9df-c857-4165-bd67-e238b58a24ae,host='devstack@QuobyteHD#QuobyteHD',id=558138a0-15eb-4510-89f6-5e0572de7c7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31eabcf2da754ca483349336da7d45fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:42:11Z,use_quota=True,user_id='7a04818c7ea1467ea69ea0ab7c78589d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06611a34-34bd-40dc-a6e9-414df18a6d9b),volume_type_id=06611a34-34bd-40dc-a6e9-414df18a6d9b)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:11 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f90d12fd-80cf-451f-9432-a35d109e0d96 tempest-GroupsTest-348137327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea34bdc8-0508-4317-ab64-3809f308e67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:11 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f90d12fd-80cf-451f-9432-a35d109e0d96 tempest-GroupsTest-348137327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea34bdc8-0508-4317-ab64-3809f308e67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:11 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f90d12fd-80cf-451f-9432-a35d109e0d96 tempest-GroupsTest-348137327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e2b541b-2570-4b03-8f4c-44382f8fb7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:11 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f90d12fd-80cf-451f-9432-a35d109e0d96 tempest-GroupsTest-348137327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e2b541b-2570-4b03-8f4c-44382f8fb7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '558138a0-15eb-4510-89f6-5e0572de7c7e', 'volume_name': 'volume-558138a0-15eb-4510-89f6-5e0572de7c7e', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:11 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f90d12fd-80cf-451f-9432-a35d109e0d96 tempest-GroupsTest-348137327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5542b57e-385c-45ba-b534-9a26875ad7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:11 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f90d12fd-80cf-451f-9432-a35d109e0d96 tempest-GroupsTest-348137327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5542b57e-385c-45ba-b534-9a26875ad7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:11 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f90d12fd-80cf-451f-9432-a35d109e0d96 tempest-GroupsTest-348137327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6003aefe-6a89-4387-bfd1-12751d7349b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:11 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-f90d12fd-80cf-451f-9432-a35d109e0d96 tempest-GroupsTest-348137327 None] Volume 558138a0-15eb-4510-89f6-5e0572de7c7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-558138a0-15eb-4510-89f6-5e0572de7c7e', 'volume_size': 1} Jul 10 06:42:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f90d12fd-80cf-451f-9432-a35d109e0d96 tempest-GroupsTest-348137327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:12 devstack sudo[94120]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9e1fd6c8-e6b9-4d04-9713-3e7d6f05f4a0 tempest-VolumesDeleteCascade-747554758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.ff71f6f6-c16b-42a0-be2d-55edadd5f252" returned: 0 in 0.990s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9e1fd6c8-e6b9-4d04-9713-3e7d6f05f4a0 tempest-VolumesDeleteCascade-747554758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:12 devstack sudo[94131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.info Jul 10 06:42:12 devstack sudo[94131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:12 devstack sudo[94131]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9e1fd6c8-e6b9-4d04-9713-3e7d6f05f4a0 tempest-VolumesDeleteCascade-747554758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.info" returned: 0 in 0.731s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:12 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-9e1fd6c8-e6b9-4d04-9713-3e7d6f05f4a0 tempest-VolumesDeleteCascade-747554758 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.info is being set with open permissions: ugo+rw Jul 10 06:42:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9e1fd6c8-e6b9-4d04-9713-3e7d6f05f4a0 tempest-VolumesDeleteCascade-747554758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:12 devstack sudo[94134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.info Jul 10 06:42:12 devstack sudo[94134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:13 devstack sudo[94117]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_ce5j3zjadevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1d4d4a7e-1691-4c7e-a621-83a65b241167" returned: 0 in 2.200s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:13 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_ce5j3zjadevstack@QuobyteHD, size 112.00 MB, duration 2.20 sec, destination /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1d4d4a7e-1691-4c7e-a621-83a65b241167 {{(pid=87294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 06:42:13 devstack cinder-volume[87294]: INFO cinder.image.image_utils [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Converted 112.00 MB image at 50.89 MB/s Jul 10 06:42:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1d4d4a7e-1691-4c7e-a621-83a65b241167 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:13 devstack sudo[94136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1d4d4a7e-1691-4c7e-a621-83a65b241167 1G Jul 10 06:42:13 devstack sudo[94136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:13 devstack sudo[94134]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9e1fd6c8-e6b9-4d04-9713-3e7d6f05f4a0 tempest-VolumesDeleteCascade-747554758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.info" returned: 0 in 0.721s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9e1fd6c8-e6b9-4d04-9713-3e7d6f05f4a0 tempest-VolumesDeleteCascade-747554758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.513s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f90d12fd-80cf-451f-9432-a35d109e0d96 tempest-GroupsTest-348137327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.925s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:13 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f90d12fd-80cf-451f-9432-a35d109e0d96 tempest-GroupsTest-348137327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f52cc9df-c857-4165-bd67-e238b58a24ae,created_at=2026-07-10T04:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1312724341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f52cc9df-c857-4165-bd67-e238b58a24ae,host='devstack@QuobyteHD#QuobyteHD',id=558138a0-15eb-4510-89f6-5e0572de7c7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31eabcf2da754ca483349336da7d45fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:42:11Z,use_quota=True,user_id='7a04818c7ea1467ea69ea0ab7c78589d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06611a34-34bd-40dc-a6e9-414df18a6d9b),volume_type_id=06611a34-34bd-40dc-a6e9-414df18a6d9b)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:42:13 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-f90d12fd-80cf-451f-9432-a35d109e0d96 tempest-GroupsTest-348137327 None] Creating volume 558138a0-15eb-4510-89f6-5e0572de7c7e {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:42:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f90d12fd-80cf-451f-9432-a35d109e0d96 tempest-GroupsTest-348137327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f90d12fd-80cf-451f-9432-a35d109e0d96 tempest-GroupsTest-348137327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:13 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f90d12fd-80cf-451f-9432-a35d109e0d96 tempest-GroupsTest-348137327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:42:13 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f90d12fd-80cf-451f-9432-a35d109e0d96 tempest-GroupsTest-348137327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:42:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f90d12fd-80cf-451f-9432-a35d109e0d96 tempest-GroupsTest-348137327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:13 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f90d12fd-80cf-451f-9432-a35d109e0d96 tempest-GroupsTest-348137327 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:42:13 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-f90d12fd-80cf-451f-9432-a35d109e0d96 tempest-GroupsTest-348137327 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:42:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f90d12fd-80cf-451f-9432-a35d109e0d96 tempest-GroupsTest-348137327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-558138a0-15eb-4510-89f6-5e0572de7c7e 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:13 devstack sudo[94172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-558138a0-15eb-4510-89f6-5e0572de7c7e 1073741824 Jul 10 06:42:13 devstack sudo[94172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:13 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-9e1fd6c8-e6b9-4d04-9713-3e7d6f05f4a0 tempest-VolumesDeleteCascade-747554758 None] Create snapshot completed successfully Jul 10 06:42:13 devstack sudo[94136]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1d4d4a7e-1691-4c7e-a621-83a65b241167 1G" returned: 0 in 0.857s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:13 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b51dfb-213d-45ae-b366-2e2e8d5c552d]: (4, 'raw') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:42:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1d4d4a7e-1691-4c7e-a621-83a65b241167 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:14 devstack sudo[94177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1d4d4a7e-1691-4c7e-a621-83a65b241167 Jul 10 06:42:14 devstack sudo[94177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-accee9ae-3ddc-437a-8a9c-7b3c52511653 tempest-VolumesDeleteCascade-747554758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:14 devstack sudo[94172]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f90d12fd-80cf-451f-9432-a35d109e0d96 tempest-GroupsTest-348137327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-558138a0-15eb-4510-89f6-5e0572de7c7e 1073741824" returned: 0 in 0.995s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f90d12fd-80cf-451f-9432-a35d109e0d96 tempest-GroupsTest-348137327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-558138a0-15eb-4510-89f6-5e0572de7c7e {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:14 devstack sudo[94216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-558138a0-15eb-4510-89f6-5e0572de7c7e Jul 10 06:42:14 devstack sudo[94216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:14 devstack sudo[94177]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1d4d4a7e-1691-4c7e-a621-83a65b241167" returned: 0 in 0.817s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1d4d4a7e-1691-4c7e-a621-83a65b241167 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:14 devstack sudo[94220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1d4d4a7e-1691-4c7e-a621-83a65b241167 Jul 10 06:42:14 devstack sudo[94220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:15 devstack sudo[94216]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f90d12fd-80cf-451f-9432-a35d109e0d96 tempest-GroupsTest-348137327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-558138a0-15eb-4510-89f6-5e0572de7c7e" returned: 0 in 0.702s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:15 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f90d12fd-80cf-451f-9432-a35d109e0d96 tempest-GroupsTest-348137327 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:42:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f90d12fd-80cf-451f-9432-a35d109e0d96 tempest-GroupsTest-348137327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.746s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-accee9ae-3ddc-437a-8a9c-7b3c52511653 tempest-VolumesDeleteCascade-747554758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.095s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f90d12fd-80cf-451f-9432-a35d109e0d96 tempest-GroupsTest-348137327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6003aefe-6a89-4387-bfd1-12751d7349b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-558138a0-15eb-4510-89f6-5e0572de7c7e', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f90d12fd-80cf-451f-9432-a35d109e0d96 tempest-GroupsTest-348137327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc3255cd-edee-451f-8916-2a3e760f69df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:15 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-accee9ae-3ddc-437a-8a9c-7b3c52511653 tempest-VolumesDeleteCascade-747554758 None] Creating offline snapshot 026c0ad1-328b-48cd-9a8d-f6ebd6b22df4 of volume ea95490f-2979-4071-8f07-135cddd0a35f {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:42:15 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-f90d12fd-80cf-451f-9432-a35d109e0d96 tempest-GroupsTest-348137327 None] Volume volume-558138a0-15eb-4510-89f6-5e0572de7c7e (558138a0-15eb-4510-89f6-5e0572de7c7e): created successfully Jul 10 06:42:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f90d12fd-80cf-451f-9432-a35d109e0d96 tempest-GroupsTest-348137327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc3255cd-edee-451f-8916-2a3e760f69df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f90d12fd-80cf-451f-9432-a35d109e0d96 tempest-GroupsTest-348137327 None] Flow 'volume_create_manager' (4b0f1ba5-6662-4ffe-a950-ea0cc412bf0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:42:15 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[5951d3aa-91f8-49e0-b10d-6ac67a774efa]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:42:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-accee9ae-3ddc-437a-8a9c-7b3c52511653 tempest-VolumesDeleteCascade-747554758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.ff71f6f6-c16b-42a0-be2d-55edadd5f252 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:15 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-f90d12fd-80cf-451f-9432-a35d109e0d96 tempest-GroupsTest-348137327 None] Created volume successfully. Jul 10 06:42:15 devstack sudo[94226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.ff71f6f6-c16b-42a0-be2d-55edadd5f252 Jul 10 06:42:15 devstack sudo[94226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:15 devstack sudo[94220]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1d4d4a7e-1691-4c7e-a621-83a65b241167" returned: 1 in 0.818s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1d4d4a7e-1691-4c7e-a621-83a65b241167' failed. Not Retrying. {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:42:15 devstack cinder-volume[87294]: DEBUG cinder.volume.volume_utils [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Downloaded image fce564e0-408f-448f-b73c-5fae94549898 ((None, [{'url': 'file:///opt/stack/data/glance/images/fce564e0-408f-448f-b73c-5fae94549898', 'metadata': {}}])) to volume 1d4d4a7e-1691-4c7e-a621-83a65b241167 successfully. {{(pid=87294) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 06:42:15 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Temporary image fce564e0-408f-448f-b73c-5fae94549898 for user aa77e096fee744699269570286caaf84 is deleted. {{(pid=87294) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 06:42:15 devstack cinder-volume[87294]: DEBUG cinder.volume.volume_utils [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Marking volume 1d4d4a7e-1691-4c7e-a621-83a65b241167 as bootable. {{(pid=87294) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 06:42:15 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Copying metadata from image fce564e0-408f-448f-b73c-5fae94549898 to 1d4d4a7e-1691-4c7e-a621-83a65b241167. {{(pid=87294) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 06:42:15 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Creating volume glance metadata for volume 1d4d4a7e-1691-4c7e-a621-83a65b241167 backed by image fce564e0-408f-448f-b73c-5fae94549898 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fce564e0-408f-448f-b73c-5fae94549898', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87294) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 06:42:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3690c9bc-cd80-46c7-b717-df7669affbd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d4d4a7e-1691-4c7e-a621-83a65b241167', 'volume_size': 1, 'image_id': 'fce564e0-408f-448f-b73c-5fae94549898', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fce564e0-408f-448f-b73c-5fae94549898', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '62db6635aac548658dfcc55ac904ccde', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fce564e0-408f-448f-b73c-5fae94549898', 'created_at': datetime.datetime(2026, 7, 10, 4, 29, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 29, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fce564e0-408f-448f-b73c-5fae94549898/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3b016c8-1e7c-4457-b27c-f3afa39e5a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:15 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Volume volume-1d4d4a7e-1691-4c7e-a621-83a65b241167 (1d4d4a7e-1691-4c7e-a621-83a65b241167): created successfully Jul 10 06:42:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3b016c8-1e7c-4457-b27c-f3afa39e5a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Flow 'volume_create_manager' (93cdb8cc-565b-45a5-8f44-a84a17213fa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:42:15 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-b813c52e-46f3-4801-9b30-57788cdfee6c tempest-VolumesImageMetadata-1535860094 None] Created volume successfully. Jul 10 06:42:16 devstack sudo[94226]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-accee9ae-3ddc-437a-8a9c-7b3c52511653 tempest-VolumesDeleteCascade-747554758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.ff71f6f6-c16b-42a0-be2d-55edadd5f252" returned: 0 in 0.794s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:16 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-accee9ae-3ddc-437a-8a9c-7b3c52511653 tempest-VolumesDeleteCascade-747554758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea95490f-2979-4071-8f07-135cddd0a35f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:42:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-accee9ae-3ddc-437a-8a9c-7b3c52511653 tempest-VolumesDeleteCascade-747554758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.ff71f6f6-c16b-42a0-be2d-55edadd5f252,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.026c0ad1-328b-48cd-9a8d-f6ebd6b22df4 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:16 devstack sudo[94233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.ff71f6f6-c16b-42a0-be2d-55edadd5f252,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.026c0ad1-328b-48cd-9a8d-f6ebd6b22df4 1G Jul 10 06:42:16 devstack sudo[94233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:16 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-94131be0-4882-4035-9f01-3afc1cd6d2bb tempest-VolumesImageMetadata-1535860094 None] Acquiring lock "cinder-1d4d4a7e-1691-4c7e-a621-83a65b241167-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:42:16 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-94131be0-4882-4035-9f01-3afc1cd6d2bb tempest-VolumesImageMetadata-1535860094 None] Lock "cinder-1d4d4a7e-1691-4c7e-a621-83a65b241167-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:42:16 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-94131be0-4882-4035-9f01-3afc1cd6d2bb tempest-VolumesImageMetadata-1535860094 None] Acquiring lock "cinder-quobyte-1d4d4a7e-1691-4c7e-a621-83a65b241167" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:42:16 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-94131be0-4882-4035-9f01-3afc1cd6d2bb tempest-VolumesImageMetadata-1535860094 None] Lock "cinder-quobyte-1d4d4a7e-1691-4c7e-a621-83a65b241167" acquired by "delete_volume" :: waited 0.023s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:42:16 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[f477f71c-388f-456b-b835-0b39a671d167]: (4, 'raw') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:42:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-94131be0-4882-4035-9f01-3afc1cd6d2bb tempest-VolumesImageMetadata-1535860094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1d4d4a7e-1691-4c7e-a621-83a65b241167 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:16 devstack sudo[94235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1d4d4a7e-1691-4c7e-a621-83a65b241167 Jul 10 06:42:16 devstack sudo[94235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:17 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-63b116a5-b745-464c-a20d-2d81f4f9f7b9 tempest-GroupsTest-348137327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:42:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-63b116a5-b745-464c-a20d-2d81f4f9f7b9 tempest-GroupsTest-348137327 None] Flow 'volume_create_manager' (d7f1f9e6-3321-41de-856b-a8996741358b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:42:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-63b116a5-b745-464c-a20d-2d81f4f9f7b9 tempest-GroupsTest-348137327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75939a89-0d81-4a3c-8f8c-489e51c9c1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:17 devstack sudo[94233]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-accee9ae-3ddc-437a-8a9c-7b3c52511653 tempest-VolumesDeleteCascade-747554758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.ff71f6f6-c16b-42a0-be2d-55edadd5f252,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.026c0ad1-328b-48cd-9a8d-f6ebd6b22df4 1G" returned: 0 in 0.935s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-accee9ae-3ddc-437a-8a9c-7b3c52511653 tempest-VolumesDeleteCascade-747554758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea95490f-2979-4071-8f07-135cddd0a35f.ff71f6f6-c16b-42a0-be2d-55edadd5f252 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.026c0ad1-328b-48cd-9a8d-f6ebd6b22df4 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-63b116a5-b745-464c-a20d-2d81f4f9f7b9 tempest-GroupsTest-348137327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75939a89-0d81-4a3c-8f8c-489e51c9c1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2000137765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f52cc9df-c857-4165-bd67-e238b58a24ae,host='devstack@QuobyteHD#QuobyteHD',id=2845d16b-92d6-4dfc-a9f7-d5b300d56354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31eabcf2da754ca483349336da7d45fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:42:17Z,use_quota=True,user_id='7a04818c7ea1467ea69ea0ab7c78589d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06611a34-34bd-40dc-a6e9-414df18a6d9b),volume_type_id=06611a34-34bd-40dc-a6e9-414df18a6d9b)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:17 devstack sudo[94241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea95490f-2979-4071-8f07-135cddd0a35f.ff71f6f6-c16b-42a0-be2d-55edadd5f252 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.026c0ad1-328b-48cd-9a8d-f6ebd6b22df4 Jul 10 06:42:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-63b116a5-b745-464c-a20d-2d81f4f9f7b9 tempest-GroupsTest-348137327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9efd4f0-57f6-4a63-9bee-4eb55d433e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:17 devstack sudo[94241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-63b116a5-b745-464c-a20d-2d81f4f9f7b9 tempest-GroupsTest-348137327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9efd4f0-57f6-4a63-9bee-4eb55d433e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-63b116a5-b745-464c-a20d-2d81f4f9f7b9 tempest-GroupsTest-348137327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (585fd254-fb98-44bb-b05a-44c38aa50616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-63b116a5-b745-464c-a20d-2d81f4f9f7b9 tempest-GroupsTest-348137327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (585fd254-fb98-44bb-b05a-44c38aa50616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2845d16b-92d6-4dfc-a9f7-d5b300d56354', 'volume_name': 'volume-2845d16b-92d6-4dfc-a9f7-d5b300d56354', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-63b116a5-b745-464c-a20d-2d81f4f9f7b9 tempest-GroupsTest-348137327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3a20b32-4078-4f1c-b633-8e9af8993153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-63b116a5-b745-464c-a20d-2d81f4f9f7b9 tempest-GroupsTest-348137327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3a20b32-4078-4f1c-b633-8e9af8993153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-63b116a5-b745-464c-a20d-2d81f4f9f7b9 tempest-GroupsTest-348137327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2db116ec-60be-401b-a63e-bb59f9b03386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:17 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-63b116a5-b745-464c-a20d-2d81f4f9f7b9 tempest-GroupsTest-348137327 None] Volume 2845d16b-92d6-4dfc-a9f7-d5b300d56354: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2845d16b-92d6-4dfc-a9f7-d5b300d56354', 'volume_size': 1} Jul 10 06:42:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-63b116a5-b745-464c-a20d-2d81f4f9f7b9 tempest-GroupsTest-348137327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:17 devstack sudo[94235]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-94131be0-4882-4035-9f01-3afc1cd6d2bb tempest-VolumesImageMetadata-1535860094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1d4d4a7e-1691-4c7e-a621-83a65b241167" returned: 0 in 0.877s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-94131be0-4882-4035-9f01-3afc1cd6d2bb tempest-VolumesImageMetadata-1535860094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1d4d4a7e-1691-4c7e-a621-83a65b241167 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:17 devstack sudo[94245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1d4d4a7e-1691-4c7e-a621-83a65b241167 Jul 10 06:42:17 devstack sudo[94245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:17 devstack sudo[94241]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-accee9ae-3ddc-437a-8a9c-7b3c52511653 tempest-VolumesDeleteCascade-747554758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea95490f-2979-4071-8f07-135cddd0a35f.ff71f6f6-c16b-42a0-be2d-55edadd5f252 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.026c0ad1-328b-48cd-9a8d-f6ebd6b22df4" returned: 0 in 0.716s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:17 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-accee9ae-3ddc-437a-8a9c-7b3c52511653 tempest-VolumesDeleteCascade-747554758 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.026c0ad1-328b-48cd-9a8d-f6ebd6b22df4 is being set with open permissions: ugo+rw Jul 10 06:42:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-accee9ae-3ddc-437a-8a9c-7b3c52511653 tempest-VolumesDeleteCascade-747554758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.026c0ad1-328b-48cd-9a8d-f6ebd6b22df4 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:17 devstack sudo[94251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.026c0ad1-328b-48cd-9a8d-f6ebd6b22df4 Jul 10 06:42:17 devstack sudo[94251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:18 devstack sudo[94245]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-94131be0-4882-4035-9f01-3afc1cd6d2bb tempest-VolumesImageMetadata-1535860094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1d4d4a7e-1691-4c7e-a621-83a65b241167" returned: 1 in 0.763s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-94131be0-4882-4035-9f01-3afc1cd6d2bb tempest-VolumesImageMetadata-1535860094 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1d4d4a7e-1691-4c7e-a621-83a65b241167' failed. Not Retrying. {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:42:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-94131be0-4882-4035-9f01-3afc1cd6d2bb tempest-VolumesImageMetadata-1535860094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1d4d4a7e-1691-4c7e-a621-83a65b241167 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:18 devstack sudo[94256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1d4d4a7e-1691-4c7e-a621-83a65b241167 Jul 10 06:42:18 devstack sudo[94256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:18 devstack sudo[94251]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-accee9ae-3ddc-437a-8a9c-7b3c52511653 tempest-VolumesDeleteCascade-747554758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.026c0ad1-328b-48cd-9a8d-f6ebd6b22df4" returned: 0 in 0.673s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-accee9ae-3ddc-437a-8a9c-7b3c52511653 tempest-VolumesDeleteCascade-747554758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.266s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-63b116a5-b745-464c-a20d-2d81f4f9f7b9 tempest-GroupsTest-348137327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.362s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:18 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-63b116a5-b745-464c-a20d-2d81f4f9f7b9 tempest-GroupsTest-348137327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f52cc9df-c857-4165-bd67-e238b58a24ae,created_at=2026-07-10T04:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2000137765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f52cc9df-c857-4165-bd67-e238b58a24ae,host='devstack@QuobyteHD#QuobyteHD',id=2845d16b-92d6-4dfc-a9f7-d5b300d56354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31eabcf2da754ca483349336da7d45fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:42:17Z,use_quota=True,user_id='7a04818c7ea1467ea69ea0ab7c78589d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06611a34-34bd-40dc-a6e9-414df18a6d9b),volume_type_id=06611a34-34bd-40dc-a6e9-414df18a6d9b)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:42:18 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-63b116a5-b745-464c-a20d-2d81f4f9f7b9 tempest-GroupsTest-348137327 None] Creating volume 2845d16b-92d6-4dfc-a9f7-d5b300d56354 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:42:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-63b116a5-b745-464c-a20d-2d81f4f9f7b9 tempest-GroupsTest-348137327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-63b116a5-b745-464c-a20d-2d81f4f9f7b9 tempest-GroupsTest-348137327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:18 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-63b116a5-b745-464c-a20d-2d81f4f9f7b9 tempest-GroupsTest-348137327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:42:18 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-63b116a5-b745-464c-a20d-2d81f4f9f7b9 tempest-GroupsTest-348137327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:42:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-63b116a5-b745-464c-a20d-2d81f4f9f7b9 tempest-GroupsTest-348137327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:18 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-63b116a5-b745-464c-a20d-2d81f4f9f7b9 tempest-GroupsTest-348137327 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:42:18 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-63b116a5-b745-464c-a20d-2d81f4f9f7b9 tempest-GroupsTest-348137327 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:42:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-63b116a5-b745-464c-a20d-2d81f4f9f7b9 tempest-GroupsTest-348137327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2845d16b-92d6-4dfc-a9f7-d5b300d56354 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:18 devstack sudo[94259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2845d16b-92d6-4dfc-a9f7-d5b300d56354 1073741824 Jul 10 06:42:18 devstack sudo[94259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:18 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-accee9ae-3ddc-437a-8a9c-7b3c52511653 tempest-VolumesDeleteCascade-747554758 None] Create snapshot completed successfully Jul 10 06:42:18 devstack sudo[94256]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-94131be0-4882-4035-9f01-3afc1cd6d2bb tempest-VolumesImageMetadata-1535860094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1d4d4a7e-1691-4c7e-a621-83a65b241167" returned: 0 in 0.665s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:18 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-94131be0-4882-4035-9f01-3afc1cd6d2bb tempest-VolumesImageMetadata-1535860094 None] Lock "cinder-quobyte-1d4d4a7e-1691-4c7e-a621-83a65b241167" released by "delete_volume" :: held 2.378s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:42:18 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-94131be0-4882-4035-9f01-3afc1cd6d2bb tempest-VolumesImageMetadata-1535860094 None] Created reservations ['c7083f61-a1ff-4ab7-99f4-4e720324cefc', 'b1cdf9e8-256d-44b9-94a8-79750ae81dab', '16893c05-b7e1-4502-a74b-09086af421f6', '11eb6d88-f7c2-483d-a419-599b19aea294'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:42:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-94131be0-4882-4035-9f01-3afc1cd6d2bb tempest-VolumesImageMetadata-1535860094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-94131be0-4882-4035-9f01-3afc1cd6d2bb tempest-VolumesImageMetadata-1535860094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:18 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-94131be0-4882-4035-9f01-3afc1cd6d2bb tempest-VolumesImageMetadata-1535860094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:42:19 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-94131be0-4882-4035-9f01-3afc1cd6d2bb tempest-VolumesImageMetadata-1535860094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:42:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-94131be0-4882-4035-9f01-3afc1cd6d2bb tempest-VolumesImageMetadata-1535860094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-94131be0-4882-4035-9f01-3afc1cd6d2bb tempest-VolumesImageMetadata-1535860094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:19 devstack sudo[94269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:42:19 devstack sudo[94269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:19 devstack sudo[94259]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-63b116a5-b745-464c-a20d-2d81f4f9f7b9 tempest-GroupsTest-348137327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2845d16b-92d6-4dfc-a9f7-d5b300d56354 1073741824" returned: 0 in 0.907s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:19 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Acquiring lock "cinder-ea95490f-2979-4071-8f07-135cddd0a35f-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:42:19 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Lock "cinder-ea95490f-2979-4071-8f07-135cddd0a35f-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:42:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-63b116a5-b745-464c-a20d-2d81f4f9f7b9 tempest-GroupsTest-348137327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2845d16b-92d6-4dfc-a9f7-d5b300d56354 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:19 devstack sudo[94276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2845d16b-92d6-4dfc-a9f7-d5b300d56354 Jul 10 06:42:19 devstack sudo[94276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:19 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Performing cascade delete. {{(pid=87294) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 10 06:42:19 devstack sudo[94269]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-94131be0-4882-4035-9f01-3afc1cd6d2bb tempest-VolumesImageMetadata-1535860094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.706s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:19 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-94131be0-4882-4035-9f01-3afc1cd6d2bb tempest-VolumesImageMetadata-1535860094 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:42:19 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-94131be0-4882-4035-9f01-3afc1cd6d2bb tempest-VolumesImageMetadata-1535860094 None] Deleted volume successfully. Jul 10 06:42:19 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Acquiring lock "cinder-026c0ad1-328b-48cd-9a8d-f6ebd6b22df4-delete_snapshot" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:42:19 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Lock "cinder-026c0ad1-328b-48cd-9a8d-f6ebd6b22df4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:42:19 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-94131be0-4882-4035-9f01-3afc1cd6d2bb tempest-VolumesImageMetadata-1535860094 None] Lock "cinder-1d4d4a7e-1691-4c7e-a621-83a65b241167-delete_volume" released by "delete_volume" :: held 3.339s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:42:19 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Acquiring lock "cinder-quobyte-ea95490f-2979-4071-8f07-135cddd0a35f" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:42:19 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Lock "cinder-quobyte-ea95490f-2979-4071-8f07-135cddd0a35f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:42:19 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Acquiring lock "cinder-quobyte-026c0ad1-328b-48cd-9a8d-f6ebd6b22df4" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:42:19 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Lock "cinder-quobyte-026c0ad1-328b-48cd-9a8d-f6ebd6b22df4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:42:19 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Deleting offline snapshot 026c0ad1-328b-48cd-9a8d-f6ebd6b22df4 of volume ea95490f-2979-4071-8f07-135cddd0a35f {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:42:19 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] snapshot_file for this snap is: volume-ea95490f-2979-4071-8f07-135cddd0a35f.026c0ad1-328b-48cd-9a8d-f6ebd6b22df4 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:42:19 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03679f4-fa63-48c5-abf2-bc2ef9b40800]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:42:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.026c0ad1-328b-48cd-9a8d-f6ebd6b22df4 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:19 devstack sudo[94278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.026c0ad1-328b-48cd-9a8d-f6ebd6b22df4 Jul 10 06:42:19 devstack sudo[94278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:20 devstack sudo[94276]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-63b116a5-b745-464c-a20d-2d81f4f9f7b9 tempest-GroupsTest-348137327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2845d16b-92d6-4dfc-a9f7-d5b300d56354" returned: 0 in 0.714s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:20 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-63b116a5-b745-464c-a20d-2d81f4f9f7b9 tempest-GroupsTest-348137327 None] <== create_volume: return (1712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:42:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-63b116a5-b745-464c-a20d-2d81f4f9f7b9 tempest-GroupsTest-348137327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.716s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:20 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-63b116a5-b745-464c-a20d-2d81f4f9f7b9 tempest-GroupsTest-348137327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2db116ec-60be-401b-a63e-bb59f9b03386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2845d16b-92d6-4dfc-a9f7-d5b300d56354', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:20 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-63b116a5-b745-464c-a20d-2d81f4f9f7b9 tempest-GroupsTest-348137327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (541d9277-aed0-44c0-99a6-97ada50a20f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:20 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-63b116a5-b745-464c-a20d-2d81f4f9f7b9 tempest-GroupsTest-348137327 None] Volume volume-2845d16b-92d6-4dfc-a9f7-d5b300d56354 (2845d16b-92d6-4dfc-a9f7-d5b300d56354): created successfully Jul 10 06:42:20 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-63b116a5-b745-464c-a20d-2d81f4f9f7b9 tempest-GroupsTest-348137327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (541d9277-aed0-44c0-99a6-97ada50a20f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:20 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-63b116a5-b745-464c-a20d-2d81f4f9f7b9 tempest-GroupsTest-348137327 None] Flow 'volume_create_manager' (d7f1f9e6-3321-41de-856b-a8996741358b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:42:20 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-63b116a5-b745-464c-a20d-2d81f4f9f7b9 tempest-GroupsTest-348137327 None] Created volume successfully. Jul 10 06:42:20 devstack sudo[94278]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.026c0ad1-328b-48cd-9a8d-f6ebd6b22df4" returned: 0 in 0.878s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:20 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea95490f-2979-4071-8f07-135cddd0a35f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:42:20 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c0e2ef-b947-43d3-8013-6704447b320f]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:42:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.ff71f6f6-c16b-42a0-be2d-55edadd5f252 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:20 devstack sudo[94284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.ff71f6f6-c16b-42a0-be2d-55edadd5f252 Jul 10 06:42:20 devstack sudo[94284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:21 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-6134684c-93da-4909-8ea9-159a8c086e1d tempest-GroupsTest-348137327 None] Update group completed successfully. Jul 10 06:42:21 devstack sudo[94284]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.ff71f6f6-c16b-42a0-be2d-55edadd5f252" returned: 0 in 0.901s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea95490f-2979-4071-8f07-135cddd0a35f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:42:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.026c0ad1-328b-48cd-9a8d-f6ebd6b22df4 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:21 devstack sudo[94289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.026c0ad1-328b-48cd-9a8d-f6ebd6b22df4 Jul 10 06:42:21 devstack sudo[94289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:21 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager._thread_info {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:42:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread count: 28 {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:42:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread info: [<_MainThread(MainThread, started 139245706264704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:42:22 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-f3f43bdb-7da6-4333-9a7c-0093437fafac tempest-GroupsTest-348137327 None] Update group completed successfully. Jul 10 06:42:22 devstack sudo[94289]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.026c0ad1-328b-48cd-9a8d-f6ebd6b22df4" returned: 0 in 0.945s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.026c0ad1-328b-48cd-9a8d-f6ebd6b22df4 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:22 devstack sudo[94295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.026c0ad1-328b-48cd-9a8d-f6ebd6b22df4 Jul 10 06:42:22 devstack sudo[94295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:23 devstack sudo[94295]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.026c0ad1-328b-48cd-9a8d-f6ebd6b22df4" returned: 0 in 0.662s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:23 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Lock "cinder-quobyte-026c0ad1-328b-48cd-9a8d-f6ebd6b22df4" released by "_delete_snapshot" :: held 3.510s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:42:23 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Lock "cinder-quobyte-ea95490f-2979-4071-8f07-135cddd0a35f" released by "delete_snapshot" :: held 3.535s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:42:23 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Created reservations ['892ac66d-4a5e-47d8-a94c-c304657f2c62', 'da5e8e17-bda0-4504-9664-6646b05d6682', 'd801b289-1e8e-4a12-958d-b64e33eb72f9', 'a9650afd-6d3f-419e-b98d-b2fa6506469b'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:42:23 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Delete snapshot completed successfully. Jul 10 06:42:23 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Lock "cinder-026c0ad1-328b-48cd-9a8d-f6ebd6b22df4-delete_snapshot" released by "delete_snapshot" :: held 3.690s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:42:23 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Acquiring lock "cinder-ff71f6f6-c16b-42a0-be2d-55edadd5f252-delete_snapshot" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:42:23 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Lock "cinder-ff71f6f6-c16b-42a0-be2d-55edadd5f252-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:42:23 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Acquiring lock "cinder-quobyte-ea95490f-2979-4071-8f07-135cddd0a35f" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:42:23 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Lock "cinder-quobyte-ea95490f-2979-4071-8f07-135cddd0a35f" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:42:23 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Acquiring lock "cinder-quobyte-ff71f6f6-c16b-42a0-be2d-55edadd5f252" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:42:23 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Lock "cinder-quobyte-ff71f6f6-c16b-42a0-be2d-55edadd5f252" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:42:23 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Deleting offline snapshot ff71f6f6-c16b-42a0-be2d-55edadd5f252 of volume ea95490f-2979-4071-8f07-135cddd0a35f {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:42:23 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] snapshot_file for this snap is: volume-ea95490f-2979-4071-8f07-135cddd0a35f.ff71f6f6-c16b-42a0-be2d-55edadd5f252 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:42:23 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1798ff4-b30a-47ce-9d33-eca12c34f7ee]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:42:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.ff71f6f6-c16b-42a0-be2d-55edadd5f252 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:23 devstack sudo[94298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.ff71f6f6-c16b-42a0-be2d-55edadd5f252 Jul 10 06:42:23 devstack sudo[94298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:24 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d9e4359-f9d2-44dc-a2b5-1e9e21297e18 tempest-AbsoluteLimitsTests-1111361147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:42:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-3d9e4359-f9d2-44dc-a2b5-1e9e21297e18 tempest-AbsoluteLimitsTests-1111361147 None] Flow 'volume_create_manager' (ca1a8e2a-21d2-43bc-b996-7c0ad8a7f002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:42:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-3d9e4359-f9d2-44dc-a2b5-1e9e21297e18 tempest-AbsoluteLimitsTests-1111361147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (405f46a3-da28-43eb-b2d0-62098e439fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-3d9e4359-f9d2-44dc-a2b5-1e9e21297e18 tempest-AbsoluteLimitsTests-1111361147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (405f46a3-da28-43eb-b2d0-62098e439fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-971555037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f34b895d-02e0-421b-9388-b9fca38414d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5c85e7786c54d7a8c84b128250edd92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:42:24Z,use_quota=True,user_id='dc7b778ef4004f098b6f857cbe21c9d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-3d9e4359-f9d2-44dc-a2b5-1e9e21297e18 tempest-AbsoluteLimitsTests-1111361147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1bf57da-95c6-4139-90cf-98cbb14bc50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-3d9e4359-f9d2-44dc-a2b5-1e9e21297e18 tempest-AbsoluteLimitsTests-1111361147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1bf57da-95c6-4139-90cf-98cbb14bc50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-3d9e4359-f9d2-44dc-a2b5-1e9e21297e18 tempest-AbsoluteLimitsTests-1111361147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b8f3523-bc31-4b1f-b2fd-c2f2e1bfe077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-3d9e4359-f9d2-44dc-a2b5-1e9e21297e18 tempest-AbsoluteLimitsTests-1111361147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b8f3523-bc31-4b1f-b2fd-c2f2e1bfe077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f34b895d-02e0-421b-9388-b9fca38414d8', 'volume_name': 'volume-f34b895d-02e0-421b-9388-b9fca38414d8', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-3d9e4359-f9d2-44dc-a2b5-1e9e21297e18 tempest-AbsoluteLimitsTests-1111361147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a0bc4e3-78d6-4bca-ac36-3901281c885f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-3d9e4359-f9d2-44dc-a2b5-1e9e21297e18 tempest-AbsoluteLimitsTests-1111361147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a0bc4e3-78d6-4bca-ac36-3901281c885f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-3d9e4359-f9d2-44dc-a2b5-1e9e21297e18 tempest-AbsoluteLimitsTests-1111361147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c048416a-a02f-4ce0-bc21-6fcd6b6d9c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:24 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-3d9e4359-f9d2-44dc-a2b5-1e9e21297e18 tempest-AbsoluteLimitsTests-1111361147 None] Volume f34b895d-02e0-421b-9388-b9fca38414d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f34b895d-02e0-421b-9388-b9fca38414d8', 'volume_size': 1} Jul 10 06:42:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-3d9e4359-f9d2-44dc-a2b5-1e9e21297e18 tempest-AbsoluteLimitsTests-1111361147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-3d9e4359-f9d2-44dc-a2b5-1e9e21297e18 tempest-AbsoluteLimitsTests-1111361147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:24 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-3d9e4359-f9d2-44dc-a2b5-1e9e21297e18 tempest-AbsoluteLimitsTests-1111361147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-971555037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f34b895d-02e0-421b-9388-b9fca38414d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5c85e7786c54d7a8c84b128250edd92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:42:24Z,use_quota=True,user_id='dc7b778ef4004f098b6f857cbe21c9d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:42:24 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-3d9e4359-f9d2-44dc-a2b5-1e9e21297e18 tempest-AbsoluteLimitsTests-1111361147 None] Creating volume f34b895d-02e0-421b-9388-b9fca38414d8 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:42:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-3d9e4359-f9d2-44dc-a2b5-1e9e21297e18 tempest-AbsoluteLimitsTests-1111361147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-3d9e4359-f9d2-44dc-a2b5-1e9e21297e18 tempest-AbsoluteLimitsTests-1111361147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:24 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-3d9e4359-f9d2-44dc-a2b5-1e9e21297e18 tempest-AbsoluteLimitsTests-1111361147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:42:24 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-3d9e4359-f9d2-44dc-a2b5-1e9e21297e18 tempest-AbsoluteLimitsTests-1111361147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:42:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-3d9e4359-f9d2-44dc-a2b5-1e9e21297e18 tempest-AbsoluteLimitsTests-1111361147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:24 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-3d9e4359-f9d2-44dc-a2b5-1e9e21297e18 tempest-AbsoluteLimitsTests-1111361147 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:42:24 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-3d9e4359-f9d2-44dc-a2b5-1e9e21297e18 tempest-AbsoluteLimitsTests-1111361147 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:42:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3d9e4359-f9d2-44dc-a2b5-1e9e21297e18 tempest-AbsoluteLimitsTests-1111361147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f34b895d-02e0-421b-9388-b9fca38414d8 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:24 devstack sudo[94300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f34b895d-02e0-421b-9388-b9fca38414d8 1073741824 Jul 10 06:42:24 devstack sudo[94300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:24 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b2321d27-6416-4052-8256-1ee3a4cab08f tempest-GroupsTest-348137327 None] Acquiring lock "cinder-quobyte-2845d16b-92d6-4dfc-a9f7-d5b300d56354" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:42:24 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b2321d27-6416-4052-8256-1ee3a4cab08f tempest-GroupsTest-348137327 None] Lock "cinder-quobyte-2845d16b-92d6-4dfc-a9f7-d5b300d56354" acquired by "delete_volume" :: waited 0.023s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:42:24 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[3301cbd7-9b9e-4001-b6ca-3653d090a168]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:42:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b2321d27-6416-4052-8256-1ee3a4cab08f tempest-GroupsTest-348137327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2845d16b-92d6-4dfc-a9f7-d5b300d56354 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:24 devstack sudo[94304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2845d16b-92d6-4dfc-a9f7-d5b300d56354 Jul 10 06:42:24 devstack sudo[94304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:24 devstack sudo[94298]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.ff71f6f6-c16b-42a0-be2d-55edadd5f252" returned: 0 in 0.812s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:24 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea95490f-2979-4071-8f07-135cddd0a35f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:42:24 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[67088839-9377-44e6-b7cb-5a2cbcff2f06]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:42:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:24 devstack sudo[94307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f Jul 10 06:42:24 devstack sudo[94307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:24 devstack sudo[94300]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3d9e4359-f9d2-44dc-a2b5-1e9e21297e18 tempest-AbsoluteLimitsTests-1111361147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f34b895d-02e0-421b-9388-b9fca38414d8 1073741824" returned: 0 in 0.852s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3d9e4359-f9d2-44dc-a2b5-1e9e21297e18 tempest-AbsoluteLimitsTests-1111361147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f34b895d-02e0-421b-9388-b9fca38414d8 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:25 devstack sudo[94315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f34b895d-02e0-421b-9388-b9fca38414d8 Jul 10 06:42:25 devstack sudo[94315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:25 devstack sudo[94304]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b2321d27-6416-4052-8256-1ee3a4cab08f tempest-GroupsTest-348137327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2845d16b-92d6-4dfc-a9f7-d5b300d56354" returned: 0 in 0.858s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b2321d27-6416-4052-8256-1ee3a4cab08f tempest-GroupsTest-348137327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2845d16b-92d6-4dfc-a9f7-d5b300d56354 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:25 devstack sudo[94319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2845d16b-92d6-4dfc-a9f7-d5b300d56354 Jul 10 06:42:25 devstack sudo[94319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:25 devstack sudo[94307]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f" returned: 0 in 0.860s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.ff71f6f6-c16b-42a0-be2d-55edadd5f252 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:25 devstack sudo[94322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.ff71f6f6-c16b-42a0-be2d-55edadd5f252 Jul 10 06:42:25 devstack sudo[94322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:25 devstack sudo[94315]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3d9e4359-f9d2-44dc-a2b5-1e9e21297e18 tempest-AbsoluteLimitsTests-1111361147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f34b895d-02e0-421b-9388-b9fca38414d8" returned: 0 in 0.717s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:25 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-3d9e4359-f9d2-44dc-a2b5-1e9e21297e18 tempest-AbsoluteLimitsTests-1111361147 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:42:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-3d9e4359-f9d2-44dc-a2b5-1e9e21297e18 tempest-AbsoluteLimitsTests-1111361147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:25 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-3d9e4359-f9d2-44dc-a2b5-1e9e21297e18 tempest-AbsoluteLimitsTests-1111361147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c048416a-a02f-4ce0-bc21-6fcd6b6d9c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f34b895d-02e0-421b-9388-b9fca38414d8', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:25 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-3d9e4359-f9d2-44dc-a2b5-1e9e21297e18 tempest-AbsoluteLimitsTests-1111361147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aff7e40-93bb-4898-bbf6-805938e1cf98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:25 devstack sudo[94319]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b2321d27-6416-4052-8256-1ee3a4cab08f tempest-GroupsTest-348137327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2845d16b-92d6-4dfc-a9f7-d5b300d56354" returned: 0 in 0.725s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:25 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-3d9e4359-f9d2-44dc-a2b5-1e9e21297e18 tempest-AbsoluteLimitsTests-1111361147 None] Volume volume-f34b895d-02e0-421b-9388-b9fca38414d8 (f34b895d-02e0-421b-9388-b9fca38414d8): created successfully Jul 10 06:42:25 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-3d9e4359-f9d2-44dc-a2b5-1e9e21297e18 tempest-AbsoluteLimitsTests-1111361147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aff7e40-93bb-4898-bbf6-805938e1cf98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:25 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-3d9e4359-f9d2-44dc-a2b5-1e9e21297e18 tempest-AbsoluteLimitsTests-1111361147 None] Flow 'volume_create_manager' (ca1a8e2a-21d2-43bc-b996-7c0ad8a7f002) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:42:25 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b2321d27-6416-4052-8256-1ee3a4cab08f tempest-GroupsTest-348137327 None] Lock "cinder-quobyte-2845d16b-92d6-4dfc-a9f7-d5b300d56354" released by "delete_volume" :: held 1.650s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:42:25 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b2321d27-6416-4052-8256-1ee3a4cab08f tempest-GroupsTest-348137327 None] Acquiring lock "cinder-quobyte-558138a0-15eb-4510-89f6-5e0572de7c7e" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:42:25 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-3d9e4359-f9d2-44dc-a2b5-1e9e21297e18 tempest-AbsoluteLimitsTests-1111361147 None] Created volume successfully. Jul 10 06:42:25 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b2321d27-6416-4052-8256-1ee3a4cab08f tempest-GroupsTest-348137327 None] Lock "cinder-quobyte-558138a0-15eb-4510-89f6-5e0572de7c7e" acquired by "delete_volume" :: waited 0.026s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:42:25 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[77164200-2c0a-4e8a-9ed9-4780e7119c3d]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:42:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b2321d27-6416-4052-8256-1ee3a4cab08f tempest-GroupsTest-348137327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-558138a0-15eb-4510-89f6-5e0572de7c7e {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:26 devstack sudo[94332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-558138a0-15eb-4510-89f6-5e0572de7c7e Jul 10 06:42:26 devstack sudo[94332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:26 devstack sudo[94322]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.ff71f6f6-c16b-42a0-be2d-55edadd5f252" returned: 0 in 0.915s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.ff71f6f6-c16b-42a0-be2d-55edadd5f252 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:26 devstack sudo[94338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.ff71f6f6-c16b-42a0-be2d-55edadd5f252 Jul 10 06:42:26 devstack sudo[94338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:26 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e68a69e0-7986-48a5-8d69-ad609958e636 tempest-AbsoluteLimitsTests-1111361147 None] Acquiring lock "cinder-f34b895d-02e0-421b-9388-b9fca38414d8-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:42:26 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e68a69e0-7986-48a5-8d69-ad609958e636 tempest-AbsoluteLimitsTests-1111361147 None] Lock "cinder-f34b895d-02e0-421b-9388-b9fca38414d8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:42:26 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e68a69e0-7986-48a5-8d69-ad609958e636 tempest-AbsoluteLimitsTests-1111361147 None] Acquiring lock "cinder-quobyte-f34b895d-02e0-421b-9388-b9fca38414d8" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:42:26 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e68a69e0-7986-48a5-8d69-ad609958e636 tempest-AbsoluteLimitsTests-1111361147 None] Lock "cinder-quobyte-f34b895d-02e0-421b-9388-b9fca38414d8" acquired by "delete_volume" :: waited 0.023s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:42:26 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e4d825-4aba-4f62-a325-39fef8dea085]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:42:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e68a69e0-7986-48a5-8d69-ad609958e636 tempest-AbsoluteLimitsTests-1111361147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f34b895d-02e0-421b-9388-b9fca38414d8 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:26 devstack sudo[94340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f34b895d-02e0-421b-9388-b9fca38414d8 Jul 10 06:42:26 devstack sudo[94340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:26 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-80ecc75e-8609-4edc-9be9-b141f0b7ddc4 tempest-AttachVolumeTestJSON-1155117856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:42:26 devstack sudo[94332]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-80ecc75e-8609-4edc-9be9-b141f0b7ddc4 tempest-AttachVolumeTestJSON-1155117856 None] Flow 'volume_create_manager' (7c9bc64a-2361-4203-a7cf-e29d3ea7e76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:42:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-80ecc75e-8609-4edc-9be9-b141f0b7ddc4 tempest-AttachVolumeTestJSON-1155117856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dfda118-5c28-4000-b9ed-36ae60409f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b2321d27-6416-4052-8256-1ee3a4cab08f tempest-GroupsTest-348137327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-558138a0-15eb-4510-89f6-5e0572de7c7e" returned: 0 in 1.045s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b2321d27-6416-4052-8256-1ee3a4cab08f tempest-GroupsTest-348137327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-558138a0-15eb-4510-89f6-5e0572de7c7e {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-80ecc75e-8609-4edc-9be9-b141f0b7ddc4 tempest-AttachVolumeTestJSON-1155117856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dfda118-5c28-4000-b9ed-36ae60409f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1191756699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59f78cb8-a2d0-427f-ab1b-3883e220fbd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbc42550af72433497aac3c1eb3b6741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:42:27Z,use_quota=True,user_id='6d0a6c06d30f4c2b9b4de6a4dc322e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:26 devstack sudo[94346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-558138a0-15eb-4510-89f6-5e0572de7c7e Jul 10 06:42:26 devstack sudo[94346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-80ecc75e-8609-4edc-9be9-b141f0b7ddc4 tempest-AttachVolumeTestJSON-1155117856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d60081-f947-487a-875e-16de8b99fe60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-80ecc75e-8609-4edc-9be9-b141f0b7ddc4 tempest-AttachVolumeTestJSON-1155117856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d60081-f947-487a-875e-16de8b99fe60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-80ecc75e-8609-4edc-9be9-b141f0b7ddc4 tempest-AttachVolumeTestJSON-1155117856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f9a0df-232b-4edc-afb6-7b5d75674380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-80ecc75e-8609-4edc-9be9-b141f0b7ddc4 tempest-AttachVolumeTestJSON-1155117856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f9a0df-232b-4edc-afb6-7b5d75674380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59f78cb8-a2d0-427f-ab1b-3883e220fbd5', 'volume_name': 'volume-59f78cb8-a2d0-427f-ab1b-3883e220fbd5', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-80ecc75e-8609-4edc-9be9-b141f0b7ddc4 tempest-AttachVolumeTestJSON-1155117856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad6f173d-14d1-44b6-866f-9e7bca31fcc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-80ecc75e-8609-4edc-9be9-b141f0b7ddc4 tempest-AttachVolumeTestJSON-1155117856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad6f173d-14d1-44b6-866f-9e7bca31fcc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-80ecc75e-8609-4edc-9be9-b141f0b7ddc4 tempest-AttachVolumeTestJSON-1155117856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cf87e47-7011-41d3-9b87-59c6b073bcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:27 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-80ecc75e-8609-4edc-9be9-b141f0b7ddc4 tempest-AttachVolumeTestJSON-1155117856 None] Volume 59f78cb8-a2d0-427f-ab1b-3883e220fbd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59f78cb8-a2d0-427f-ab1b-3883e220fbd5', 'volume_size': 1} Jul 10 06:42:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-80ecc75e-8609-4edc-9be9-b141f0b7ddc4 tempest-AttachVolumeTestJSON-1155117856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-80ecc75e-8609-4edc-9be9-b141f0b7ddc4 tempest-AttachVolumeTestJSON-1155117856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:27 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-80ecc75e-8609-4edc-9be9-b141f0b7ddc4 tempest-AttachVolumeTestJSON-1155117856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1191756699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59f78cb8-a2d0-427f-ab1b-3883e220fbd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbc42550af72433497aac3c1eb3b6741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:42:27Z,use_quota=True,user_id='6d0a6c06d30f4c2b9b4de6a4dc322e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:42:27 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-80ecc75e-8609-4edc-9be9-b141f0b7ddc4 tempest-AttachVolumeTestJSON-1155117856 None] Creating volume 59f78cb8-a2d0-427f-ab1b-3883e220fbd5 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:42:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-80ecc75e-8609-4edc-9be9-b141f0b7ddc4 tempest-AttachVolumeTestJSON-1155117856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-80ecc75e-8609-4edc-9be9-b141f0b7ddc4 tempest-AttachVolumeTestJSON-1155117856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:27 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-80ecc75e-8609-4edc-9be9-b141f0b7ddc4 tempest-AttachVolumeTestJSON-1155117856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:42:27 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-80ecc75e-8609-4edc-9be9-b141f0b7ddc4 tempest-AttachVolumeTestJSON-1155117856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:42:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-80ecc75e-8609-4edc-9be9-b141f0b7ddc4 tempest-AttachVolumeTestJSON-1155117856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:27 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-80ecc75e-8609-4edc-9be9-b141f0b7ddc4 tempest-AttachVolumeTestJSON-1155117856 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:42:27 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-80ecc75e-8609-4edc-9be9-b141f0b7ddc4 tempest-AttachVolumeTestJSON-1155117856 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:42:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-80ecc75e-8609-4edc-9be9-b141f0b7ddc4 tempest-AttachVolumeTestJSON-1155117856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-59f78cb8-a2d0-427f-ab1b-3883e220fbd5 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:27 devstack sudo[94338]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f.ff71f6f6-c16b-42a0-be2d-55edadd5f252" returned: 0 in 0.871s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:27 devstack sudo[94348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-59f78cb8-a2d0-427f-ab1b-3883e220fbd5 1073741824 Jul 10 06:42:27 devstack sudo[94348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:27 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Lock "cinder-quobyte-ff71f6f6-c16b-42a0-be2d-55edadd5f252" released by "_delete_snapshot" :: held 3.572s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:42:27 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Lock "cinder-quobyte-ea95490f-2979-4071-8f07-135cddd0a35f" released by "delete_snapshot" :: held 3.601s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:42:27 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Created reservations ['3e032897-4a4e-42bd-81f5-441eaf91d01b', '335758fe-e816-4e57-983a-8b4786486b1f', '82515221-c003-44c3-9603-5ffa32c7ec03', '242690ea-457a-49ff-a106-b36bfc3fe5bc'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:42:27 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Delete snapshot completed successfully. Jul 10 06:42:27 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Lock "cinder-ff71f6f6-c16b-42a0-be2d-55edadd5f252-delete_snapshot" released by "delete_snapshot" :: held 3.794s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:42:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Snapshots deleted, issuing volume delete {{(pid=87294) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 10 06:42:27 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Acquiring lock "cinder-quobyte-ea95490f-2979-4071-8f07-135cddd0a35f" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:42:27 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Lock "cinder-quobyte-ea95490f-2979-4071-8f07-135cddd0a35f" acquired by "delete_volume" :: waited 0.021s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:42:27 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ecfa8f-e523-4545-935b-71cf385a1906]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:42:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:27 devstack sudo[94340]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e68a69e0-7986-48a5-8d69-ad609958e636 tempest-AbsoluteLimitsTests-1111361147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f34b895d-02e0-421b-9388-b9fca38414d8" returned: 0 in 0.923s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e68a69e0-7986-48a5-8d69-ad609958e636 tempest-AbsoluteLimitsTests-1111361147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f34b895d-02e0-421b-9388-b9fca38414d8 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:27 devstack sudo[94351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f Jul 10 06:42:27 devstack sudo[94351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:27 devstack sudo[94356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f34b895d-02e0-421b-9388-b9fca38414d8 Jul 10 06:42:27 devstack sudo[94356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:27 devstack sudo[94346]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b2321d27-6416-4052-8256-1ee3a4cab08f tempest-GroupsTest-348137327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-558138a0-15eb-4510-89f6-5e0572de7c7e" returned: 0 in 0.780s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:27 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b2321d27-6416-4052-8256-1ee3a4cab08f tempest-GroupsTest-348137327 None] Lock "cinder-quobyte-558138a0-15eb-4510-89f6-5e0572de7c7e" released by "delete_volume" :: held 1.874s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:42:27 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-b2321d27-6416-4052-8256-1ee3a4cab08f tempest-GroupsTest-348137327 None] Created reservations ['540268db-91da-4a2d-9b18-a3cfa33661b1'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:42:27 devstack cinder-volume[87294]: WARNING cinder.quota [None req-b2321d27-6416-4052-8256-1ee3a4cab08f tempest-GroupsTest-348137327 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-974063355 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-974063355, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:42:27 devstack cinder-volume[87294]: WARNING cinder.quota [None req-b2321d27-6416-4052-8256-1ee3a4cab08f tempest-GroupsTest-348137327 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-974063355 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-974063355, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:42:27 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-b2321d27-6416-4052-8256-1ee3a4cab08f tempest-GroupsTest-348137327 None] Created reservations ['5ef50934-cacc-4774-8aca-99436c8a8e28', '718e7361-2a97-47a6-aa32-a8fac9b52df9', 'c951d95b-61c6-4a5f-ac18-3da80236fe8c', '7accffa8-872d-4a36-b379-2a7f8792b6fe'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:42:27 devstack sudo[94348]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-80ecc75e-8609-4edc-9be9-b141f0b7ddc4 tempest-AttachVolumeTestJSON-1155117856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-59f78cb8-a2d0-427f-ab1b-3883e220fbd5 1073741824" returned: 0 in 0.978s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-80ecc75e-8609-4edc-9be9-b141f0b7ddc4 tempest-AttachVolumeTestJSON-1155117856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-59f78cb8-a2d0-427f-ab1b-3883e220fbd5 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:28 devstack sudo[94364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-59f78cb8-a2d0-427f-ab1b-3883e220fbd5 Jul 10 06:42:28 devstack sudo[94364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:28 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-b2321d27-6416-4052-8256-1ee3a4cab08f tempest-GroupsTest-348137327 None] Created reservations ['a55e86a3-e6db-4391-a509-23f7e9e86f5e', 'da4fdb3b-3ec4-417b-828f-b231f6e344d9', '1cdf37c7-35dc-484b-bd4b-faa106eb4485', '46e2abb5-633b-45fc-86db-60c3afd1e0c8'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:42:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b2321d27-6416-4052-8256-1ee3a4cab08f tempest-GroupsTest-348137327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b2321d27-6416-4052-8256-1ee3a4cab08f tempest-GroupsTest-348137327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:28 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b2321d27-6416-4052-8256-1ee3a4cab08f tempest-GroupsTest-348137327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:42:28 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b2321d27-6416-4052-8256-1ee3a4cab08f tempest-GroupsTest-348137327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:42:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b2321d27-6416-4052-8256-1ee3a4cab08f tempest-GroupsTest-348137327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b2321d27-6416-4052-8256-1ee3a4cab08f tempest-GroupsTest-348137327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:28 devstack sudo[94370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:42:28 devstack sudo[94370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:28 devstack sudo[94356]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e68a69e0-7986-48a5-8d69-ad609958e636 tempest-AbsoluteLimitsTests-1111361147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f34b895d-02e0-421b-9388-b9fca38414d8" returned: 0 in 0.838s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:28 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e68a69e0-7986-48a5-8d69-ad609958e636 tempest-AbsoluteLimitsTests-1111361147 None] Lock "cinder-quobyte-f34b895d-02e0-421b-9388-b9fca38414d8" released by "delete_volume" :: held 1.834s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:42:28 devstack sudo[94351]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f" returned: 0 in 1.049s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:28 devstack sudo[94372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f Jul 10 06:42:28 devstack sudo[94372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:28 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-e68a69e0-7986-48a5-8d69-ad609958e636 tempest-AbsoluteLimitsTests-1111361147 None] Created reservations ['3b5aeaf9-6457-4c40-a429-efad1f2a047e', 'c4fd58be-d411-420c-82a1-7932f9efac4a', '895d47c1-58df-42a5-b670-bac1c1a70eba', 'b54ffc3c-14c7-48cc-9c87-9d3cbdd51d38'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:42:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e68a69e0-7986-48a5-8d69-ad609958e636 tempest-AbsoluteLimitsTests-1111361147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e68a69e0-7986-48a5-8d69-ad609958e636 tempest-AbsoluteLimitsTests-1111361147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:28 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-e68a69e0-7986-48a5-8d69-ad609958e636 tempest-AbsoluteLimitsTests-1111361147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:42:28 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-e68a69e0-7986-48a5-8d69-ad609958e636 tempest-AbsoluteLimitsTests-1111361147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:42:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e68a69e0-7986-48a5-8d69-ad609958e636 tempest-AbsoluteLimitsTests-1111361147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e68a69e0-7986-48a5-8d69-ad609958e636 tempest-AbsoluteLimitsTests-1111361147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:28 devstack sudo[94374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:42:28 devstack sudo[94374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:28 devstack sudo[94364]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-80ecc75e-8609-4edc-9be9-b141f0b7ddc4 tempest-AttachVolumeTestJSON-1155117856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-59f78cb8-a2d0-427f-ab1b-3883e220fbd5" returned: 0 in 0.882s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:28 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-80ecc75e-8609-4edc-9be9-b141f0b7ddc4 tempest-AttachVolumeTestJSON-1155117856 None] <== create_volume: return (1916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:42:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-80ecc75e-8609-4edc-9be9-b141f0b7ddc4 tempest-AttachVolumeTestJSON-1155117856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.918s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:28 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-80ecc75e-8609-4edc-9be9-b141f0b7ddc4 tempest-AttachVolumeTestJSON-1155117856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cf87e47-7011-41d3-9b87-59c6b073bcd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59f78cb8-a2d0-427f-ab1b-3883e220fbd5', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:28 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-80ecc75e-8609-4edc-9be9-b141f0b7ddc4 tempest-AttachVolumeTestJSON-1155117856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24bdf338-30c0-4719-8c2a-d36e8bfa50fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:28 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-80ecc75e-8609-4edc-9be9-b141f0b7ddc4 tempest-AttachVolumeTestJSON-1155117856 None] Volume volume-59f78cb8-a2d0-427f-ab1b-3883e220fbd5 (59f78cb8-a2d0-427f-ab1b-3883e220fbd5): created successfully Jul 10 06:42:29 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-80ecc75e-8609-4edc-9be9-b141f0b7ddc4 tempest-AttachVolumeTestJSON-1155117856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24bdf338-30c0-4719-8c2a-d36e8bfa50fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:29 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-80ecc75e-8609-4edc-9be9-b141f0b7ddc4 tempest-AttachVolumeTestJSON-1155117856 None] Flow 'volume_create_manager' (7c9bc64a-2361-4203-a7cf-e29d3ea7e76e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:42:29 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-80ecc75e-8609-4edc-9be9-b141f0b7ddc4 tempest-AttachVolumeTestJSON-1155117856 None] Created volume successfully. Jul 10 06:42:29 devstack sudo[94372]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea95490f-2979-4071-8f07-135cddd0a35f" returned: 0 in 0.842s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:29 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Lock "cinder-quobyte-ea95490f-2979-4071-8f07-135cddd0a35f" released by "delete_volume" :: held 1.972s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:42:29 devstack sudo[94370]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b2321d27-6416-4052-8256-1ee3a4cab08f tempest-GroupsTest-348137327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.024s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:29 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-b2321d27-6416-4052-8256-1ee3a4cab08f tempest-GroupsTest-348137327 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:42:29 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-b2321d27-6416-4052-8256-1ee3a4cab08f tempest-GroupsTest-348137327 None] Delete group completed successfully. Jul 10 06:42:29 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Created reservations ['bbea8b18-8a3e-4b37-aec8-01abbcd66ee3', 'f6df3884-2f1c-4fa3-9eed-ea8181957228', '2b4ca2d5-9f70-4f4e-9a50-60857efd4bec', '9796edef-20bc-41bf-b039-14d913206c12'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:42:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:29 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:42:29 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:42:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:29 devstack sudo[94374]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e68a69e0-7986-48a5-8d69-ad609958e636 tempest-AbsoluteLimitsTests-1111361147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.963s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:29 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-e68a69e0-7986-48a5-8d69-ad609958e636 tempest-AbsoluteLimitsTests-1111361147 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:42:29 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-e68a69e0-7986-48a5-8d69-ad609958e636 tempest-AbsoluteLimitsTests-1111361147 None] Deleted volume successfully. Jul 10 06:42:29 devstack sudo[94381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:42:29 devstack sudo[94381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:29 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e68a69e0-7986-48a5-8d69-ad609958e636 tempest-AbsoluteLimitsTests-1111361147 None] Lock "cinder-f34b895d-02e0-421b-9388-b9fca38414d8-delete_volume" released by "delete_volume" :: held 3.118s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:42:30 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-11001440-d104-40ba-ad78-68516f87d344 tempest-VolumesDeleteCascade-747554758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:42:30 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-11001440-d104-40ba-ad78-68516f87d344 tempest-VolumesDeleteCascade-747554758 None] Flow 'volume_create_manager' (88c21626-c2ca-4ea1-8627-5abbcbd010aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:42:30 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-11001440-d104-40ba-ad78-68516f87d344 tempest-VolumesDeleteCascade-747554758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb902831-ee33-41ba-92a1-8a9eb79c341f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:30 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-11001440-d104-40ba-ad78-68516f87d344 tempest-VolumesDeleteCascade-747554758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb902831-ee33-41ba-92a1-8a9eb79c341f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-344457871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bca90469-b1f3-4b8c-aa65-1532f054b12f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edc0dece380f4ae78fe0514a5474e3f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:42:30Z,use_quota=True,user_id='e885507eb88547068275d84b848318a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:30 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-11001440-d104-40ba-ad78-68516f87d344 tempest-VolumesDeleteCascade-747554758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95ff4fc9-075d-48d2-ac0f-082c604d2fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:30 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-11001440-d104-40ba-ad78-68516f87d344 tempest-VolumesDeleteCascade-747554758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95ff4fc9-075d-48d2-ac0f-082c604d2fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:30 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-11001440-d104-40ba-ad78-68516f87d344 tempest-VolumesDeleteCascade-747554758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48b39bb3-5670-4353-9580-57289713245e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:30 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-11001440-d104-40ba-ad78-68516f87d344 tempest-VolumesDeleteCascade-747554758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48b39bb3-5670-4353-9580-57289713245e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bca90469-b1f3-4b8c-aa65-1532f054b12f', 'volume_name': 'volume-bca90469-b1f3-4b8c-aa65-1532f054b12f', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:30 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-11001440-d104-40ba-ad78-68516f87d344 tempest-VolumesDeleteCascade-747554758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (547755d6-7298-460d-972b-1c21a90b734c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:30 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-11001440-d104-40ba-ad78-68516f87d344 tempest-VolumesDeleteCascade-747554758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (547755d6-7298-460d-972b-1c21a90b734c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:30 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-11001440-d104-40ba-ad78-68516f87d344 tempest-VolumesDeleteCascade-747554758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cad41299-ac92-46bc-abc2-4c3ec764263d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:30 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-11001440-d104-40ba-ad78-68516f87d344 tempest-VolumesDeleteCascade-747554758 None] Volume bca90469-b1f3-4b8c-aa65-1532f054b12f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bca90469-b1f3-4b8c-aa65-1532f054b12f', 'volume_size': 1} Jul 10 06:42:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-11001440-d104-40ba-ad78-68516f87d344 tempest-VolumesDeleteCascade-747554758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-11001440-d104-40ba-ad78-68516f87d344 tempest-VolumesDeleteCascade-747554758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:30 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-11001440-d104-40ba-ad78-68516f87d344 tempest-VolumesDeleteCascade-747554758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-344457871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bca90469-b1f3-4b8c-aa65-1532f054b12f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edc0dece380f4ae78fe0514a5474e3f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:42:30Z,use_quota=True,user_id='e885507eb88547068275d84b848318a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:42:30 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-11001440-d104-40ba-ad78-68516f87d344 tempest-VolumesDeleteCascade-747554758 None] Creating volume bca90469-b1f3-4b8c-aa65-1532f054b12f {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:42:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-11001440-d104-40ba-ad78-68516f87d344 tempest-VolumesDeleteCascade-747554758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:30 devstack sudo[94381]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-11001440-d104-40ba-ad78-68516f87d344 tempest-VolumesDeleteCascade-747554758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:30 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-11001440-d104-40ba-ad78-68516f87d344 tempest-VolumesDeleteCascade-747554758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:42:30 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-11001440-d104-40ba-ad78-68516f87d344 tempest-VolumesDeleteCascade-747554758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:42:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-11001440-d104-40ba-ad78-68516f87d344 tempest-VolumesDeleteCascade-747554758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:30 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-11001440-d104-40ba-ad78-68516f87d344 tempest-VolumesDeleteCascade-747554758 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:42:30 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-11001440-d104-40ba-ad78-68516f87d344 tempest-VolumesDeleteCascade-747554758 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:42:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-11001440-d104-40ba-ad78-68516f87d344 tempest-VolumesDeleteCascade-747554758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.082s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:30 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:42:30 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Deleted volume successfully. Jul 10 06:42:30 devstack sudo[94388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f 1073741824 Jul 10 06:42:30 devstack sudo[94388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:30 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c1d54556-8402-450a-bc55-b1753daf6d55 tempest-VolumesDeleteCascade-747554758 None] Lock "cinder-ea95490f-2979-4071-8f07-135cddd0a35f-delete_volume" released by "delete_volume" :: held 10.951s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:42:31 devstack sudo[94388]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-11001440-d104-40ba-ad78-68516f87d344 tempest-VolumesDeleteCascade-747554758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f 1073741824" returned: 0 in 1.050s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-11001440-d104-40ba-ad78-68516f87d344 tempest-VolumesDeleteCascade-747554758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:31 devstack sudo[94401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f Jul 10 06:42:31 devstack sudo[94401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:32 devstack sudo[94401]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-11001440-d104-40ba-ad78-68516f87d344 tempest-VolumesDeleteCascade-747554758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f" returned: 0 in 0.738s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:32 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-11001440-d104-40ba-ad78-68516f87d344 tempest-VolumesDeleteCascade-747554758 None] <== create_volume: return (1840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:42:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-11001440-d104-40ba-ad78-68516f87d344 tempest-VolumesDeleteCascade-747554758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.844s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:32 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-11001440-d104-40ba-ad78-68516f87d344 tempest-VolumesDeleteCascade-747554758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cad41299-ac92-46bc-abc2-4c3ec764263d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bca90469-b1f3-4b8c-aa65-1532f054b12f', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:32 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-11001440-d104-40ba-ad78-68516f87d344 tempest-VolumesDeleteCascade-747554758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5537afeb-4c58-4540-a9ce-7abbb5b2daab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:32 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-11001440-d104-40ba-ad78-68516f87d344 tempest-VolumesDeleteCascade-747554758 None] Volume volume-bca90469-b1f3-4b8c-aa65-1532f054b12f (bca90469-b1f3-4b8c-aa65-1532f054b12f): created successfully Jul 10 06:42:32 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-11001440-d104-40ba-ad78-68516f87d344 tempest-VolumesDeleteCascade-747554758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5537afeb-4c58-4540-a9ce-7abbb5b2daab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:32 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-11001440-d104-40ba-ad78-68516f87d344 tempest-VolumesDeleteCascade-747554758 None] Flow 'volume_create_manager' (88c21626-c2ca-4ea1-8627-5abbcbd010aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:42:32 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-11001440-d104-40ba-ad78-68516f87d344 tempest-VolumesDeleteCascade-747554758 None] Created volume successfully. Jul 10 06:42:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-944045be-dd51-4b8e-844b-db53774bc353 tempest-VolumesDeleteCascade-747554758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-944045be-dd51-4b8e-844b-db53774bc353 tempest-VolumesDeleteCascade-747554758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:34 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-944045be-dd51-4b8e-844b-db53774bc353 tempest-VolumesDeleteCascade-747554758 None] Creating offline snapshot c1d69906-5b27-42d0-9090-1b410debc281 of volume bca90469-b1f3-4b8c-aa65-1532f054b12f {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:42:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-91fcf511-05f5-4ba2-be3a-9869ff6a8f9a req-5c69891a-f3aa-4872-bd1e-9ec063042423 tempest-AttachVolumeTestJSON-1155117856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:34 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5a86c0-4d70-4dfd-9398-82b3b9b245c5]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:42:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-944045be-dd51-4b8e-844b-db53774bc353 tempest-VolumesDeleteCascade-747554758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:34 devstack sudo[94413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f Jul 10 06:42:34 devstack sudo[94413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:34 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf644602-5a94-4c85-b430-a72123c048df tempest-VolumesMetadataTest-887303801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:42:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bf644602-5a94-4c85-b430-a72123c048df tempest-VolumesMetadataTest-887303801 None] Flow 'volume_create_manager' (0882427d-eb50-471d-84c2-d9a4ff083c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:42:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bf644602-5a94-4c85-b430-a72123c048df tempest-VolumesMetadataTest-887303801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (000a5507-7303-4bf5-a190-17375edbcca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bf644602-5a94-4c85-b430-a72123c048df tempest-VolumesMetadataTest-887303801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (000a5507-7303-4bf5-a190-17375edbcca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:42:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1638216298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83559321-c1ea-41f7-9e53-063544cf3c3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30f3840373f7442eae33b0b8758775b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:42:35Z,use_quota=True,user_id='20885338533a4c58950155f3c0312816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bf644602-5a94-4c85-b430-a72123c048df tempest-VolumesMetadataTest-887303801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2585acd-d94e-441b-b7df-9e79c96f9b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bf644602-5a94-4c85-b430-a72123c048df tempest-VolumesMetadataTest-887303801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2585acd-d94e-441b-b7df-9e79c96f9b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bf644602-5a94-4c85-b430-a72123c048df tempest-VolumesMetadataTest-887303801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90e4117f-e1bc-4903-a490-d6bcc9ec8af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bf644602-5a94-4c85-b430-a72123c048df tempest-VolumesMetadataTest-887303801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90e4117f-e1bc-4903-a490-d6bcc9ec8af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83559321-c1ea-41f7-9e53-063544cf3c3d', 'volume_name': 'volume-83559321-c1ea-41f7-9e53-063544cf3c3d', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bf644602-5a94-4c85-b430-a72123c048df tempest-VolumesMetadataTest-887303801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12b66e4f-063e-49f8-9ec2-61448b080790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bf644602-5a94-4c85-b430-a72123c048df tempest-VolumesMetadataTest-887303801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12b66e4f-063e-49f8-9ec2-61448b080790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bf644602-5a94-4c85-b430-a72123c048df tempest-VolumesMetadataTest-887303801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22089673-bc64-4abb-9c35-cc1666a9a362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:34 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-bf644602-5a94-4c85-b430-a72123c048df tempest-VolumesMetadataTest-887303801 None] Volume 83559321-c1ea-41f7-9e53-063544cf3c3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83559321-c1ea-41f7-9e53-063544cf3c3d', 'volume_size': 1} Jul 10 06:42:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-bf644602-5a94-4c85-b430-a72123c048df tempest-VolumesMetadataTest-887303801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:34 devstack sudo[94413]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-944045be-dd51-4b8e-844b-db53774bc353 tempest-VolumesDeleteCascade-747554758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f" returned: 0 in 0.890s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-944045be-dd51-4b8e-844b-db53774bc353 tempest-VolumesDeleteCascade-747554758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f.c1d69906-5b27-42d0-9090-1b410debc281 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:34 devstack sudo[94418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f.c1d69906-5b27-42d0-9090-1b410debc281 1G Jul 10 06:42:34 devstack sudo[94418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:35 devstack sudo[94418]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-944045be-dd51-4b8e-844b-db53774bc353 tempest-VolumesDeleteCascade-747554758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f.c1d69906-5b27-42d0-9090-1b410debc281 1G" returned: 0 in 0.861s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-944045be-dd51-4b8e-844b-db53774bc353 tempest-VolumesDeleteCascade-747554758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bca90469-b1f3-4b8c-aa65-1532f054b12f -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f.c1d69906-5b27-42d0-9090-1b410debc281 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:35 devstack sudo[94424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bca90469-b1f3-4b8c-aa65-1532f054b12f -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f.c1d69906-5b27-42d0-9090-1b410debc281 Jul 10 06:42:35 devstack sudo[94424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:36 devstack sudo[94424]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-944045be-dd51-4b8e-844b-db53774bc353 tempest-VolumesDeleteCascade-747554758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bca90469-b1f3-4b8c-aa65-1532f054b12f -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f.c1d69906-5b27-42d0-9090-1b410debc281" returned: 0 in 0.730s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:36 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-944045be-dd51-4b8e-844b-db53774bc353 tempest-VolumesDeleteCascade-747554758 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f.c1d69906-5b27-42d0-9090-1b410debc281 is being set with open permissions: ugo+rw Jul 10 06:42:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-944045be-dd51-4b8e-844b-db53774bc353 tempest-VolumesDeleteCascade-747554758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f.c1d69906-5b27-42d0-9090-1b410debc281 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:36 devstack sudo[94430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f.c1d69906-5b27-42d0-9090-1b410debc281 Jul 10 06:42:36 devstack sudo[94430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:37 devstack sudo[94430]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-944045be-dd51-4b8e-844b-db53774bc353 tempest-VolumesDeleteCascade-747554758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f.c1d69906-5b27-42d0-9090-1b410debc281" returned: 0 in 0.717s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-944045be-dd51-4b8e-844b-db53774bc353 tempest-VolumesDeleteCascade-747554758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:37 devstack sudo[94433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f.info Jul 10 06:42:37 devstack sudo[94433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:38 devstack sudo[94433]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-944045be-dd51-4b8e-844b-db53774bc353 tempest-VolumesDeleteCascade-747554758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f.info" returned: 0 in 0.711s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:38 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-944045be-dd51-4b8e-844b-db53774bc353 tempest-VolumesDeleteCascade-747554758 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f.info is being set with open permissions: ugo+rw Jul 10 06:42:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-944045be-dd51-4b8e-844b-db53774bc353 tempest-VolumesDeleteCascade-747554758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:38 devstack sudo[94437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f.info Jul 10 06:42:38 devstack sudo[94437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:38 devstack sudo[94437]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-944045be-dd51-4b8e-844b-db53774bc353 tempest-VolumesDeleteCascade-747554758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f.info" returned: 0 in 0.689s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-944045be-dd51-4b8e-844b-db53774bc353 tempest-VolumesDeleteCascade-747554758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.727s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-91fcf511-05f5-4ba2-be3a-9869ff6a8f9a req-5c69891a-f3aa-4872-bd1e-9ec063042423 tempest-AttachVolumeTestJSON-1155117856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.671s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:38 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[636c9d6e-ef20-41f5-852b-3baf198bc5f5]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:42:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-91fcf511-05f5-4ba2-be3a-9869ff6a8f9a req-5c69891a-f3aa-4872-bd1e-9ec063042423 tempest-AttachVolumeTestJSON-1155117856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-59f78cb8-a2d0-427f-ab1b-3883e220fbd5 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:38 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-944045be-dd51-4b8e-844b-db53774bc353 tempest-VolumesDeleteCascade-747554758 None] Create snapshot completed successfully Jul 10 06:42:38 devstack sudo[94440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-59f78cb8-a2d0-427f-ab1b-3883e220fbd5 Jul 10 06:42:38 devstack sudo[94440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:39 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:42:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Flow 'volume_create_manager' (d6afcafd-d6e1-4d17-a9e2-fec847702ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:42:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a271cab-a5ab-4b2f-86bb-d384f8433d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a271cab-a5ab-4b2f-86bb-d384f8433d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1117106101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2038a75-4171-4c7a-ba7a-6b3c2de9f464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edc0dece380f4ae78fe0514a5474e3f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c1d69906-5b27-42d0-9090-1b410debc281,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:42:39Z,use_quota=True,user_id='e885507eb88547068275d84b848318a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee64dde3-e6bb-4c03-874a-b7894123d313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee64dde3-e6bb-4c03-874a-b7894123d313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd71e018-3e52-4cd8-a89f-0f4a6cbcc86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd71e018-3e52-4cd8-a89f-0f4a6cbcc86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f2038a75-4171-4c7a-ba7a-6b3c2de9f464', 'volume_name': 'volume-f2038a75-4171-4c7a-ba7a-6b3c2de9f464', 'volume_size': 1, 'snapshot_id': 'c1d69906-5b27-42d0-9090-1b410debc281'}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:39 devstack sudo[94440]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (006aa635-4d51-42f6-805a-f79d09d88144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (006aa635-4d51-42f6-805a-f79d09d88144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b47e11b-5048-4da7-bb50-0dc1861140c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:39 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Volume f2038a75-4171-4c7a-ba7a-6b3c2de9f464: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f2038a75-4171-4c7a-ba7a-6b3c2de9f464', 'volume_size': 1, 'snapshot_id': 'c1d69906-5b27-42d0-9090-1b410debc281'} Jul 10 06:42:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-91fcf511-05f5-4ba2-be3a-9869ff6a8f9a req-5c69891a-f3aa-4872-bd1e-9ec063042423 tempest-AttachVolumeTestJSON-1155117856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-59f78cb8-a2d0-427f-ab1b-3883e220fbd5" returned: 0 in 0.857s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-91fcf511-05f5-4ba2-be3a-9869ff6a8f9a req-5c69891a-f3aa-4872-bd1e-9ec063042423 tempest-AttachVolumeTestJSON-1155117856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.881s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-bf644602-5a94-4c85-b430-a72123c048df tempest-VolumesMetadataTest-887303801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.748s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:39 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-bf644602-5a94-4c85-b430-a72123c048df tempest-VolumesMetadataTest-887303801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:42:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1638216298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83559321-c1ea-41f7-9e53-063544cf3c3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30f3840373f7442eae33b0b8758775b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:42:35Z,use_quota=True,user_id='20885338533a4c58950155f3c0312816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:42:39 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-bf644602-5a94-4c85-b430-a72123c048df tempest-VolumesMetadataTest-887303801 None] Creating volume 83559321-c1ea-41f7-9e53-063544cf3c3d {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:42:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-bf644602-5a94-4c85-b430-a72123c048df tempest-VolumesMetadataTest-887303801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-bf644602-5a94-4c85-b430-a72123c048df tempest-VolumesMetadataTest-887303801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:39 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-bf644602-5a94-4c85-b430-a72123c048df tempest-VolumesMetadataTest-887303801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:42:39 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-bf644602-5a94-4c85-b430-a72123c048df tempest-VolumesMetadataTest-887303801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:42:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-bf644602-5a94-4c85-b430-a72123c048df tempest-VolumesMetadataTest-887303801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:39 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-bf644602-5a94-4c85-b430-a72123c048df tempest-VolumesMetadataTest-887303801 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:42:39 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-bf644602-5a94-4c85-b430-a72123c048df tempest-VolumesMetadataTest-887303801 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:42:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bf644602-5a94-4c85-b430-a72123c048df tempest-VolumesMetadataTest-887303801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-83559321-c1ea-41f7-9e53-063544cf3c3d 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:39 devstack sudo[94446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-83559321-c1ea-41f7-9e53-063544cf3c3d 1073741824 Jul 10 06:42:39 devstack sudo[94446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-91fcf511-05f5-4ba2-be3a-9869ff6a8f9a req-5c69891a-f3aa-4872-bd1e-9ec063042423 tempest-AttachVolumeTestJSON-1155117856 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804', 'name': 'volume-59f78cb8-a2d0-427f-ab1b-3883e220fbd5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2ed31324-0469-40e4-a078-1cbcc77be555', 'enforce_multipath': True} {{(pid=87294) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:42:39 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-91fcf511-05f5-4ba2-be3a-9869ff6a8f9a req-5c69891a-f3aa-4872-bd1e-9ec063042423 tempest-AttachVolumeTestJSON-1155117856 None] attachment_update completed successfully. Jul 10 06:42:40 devstack sudo[94446]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bf644602-5a94-4c85-b430-a72123c048df tempest-VolumesMetadataTest-887303801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-83559321-c1ea-41f7-9e53-063544cf3c3d 1073741824" returned: 0 in 1.007s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bf644602-5a94-4c85-b430-a72123c048df tempest-VolumesMetadataTest-887303801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-83559321-c1ea-41f7-9e53-063544cf3c3d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:40 devstack sudo[94519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-83559321-c1ea-41f7-9e53-063544cf3c3d Jul 10 06:42:40 devstack sudo[94519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:41 devstack sudo[94519]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bf644602-5a94-4c85-b430-a72123c048df tempest-VolumesMetadataTest-887303801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-83559321-c1ea-41f7-9e53-063544cf3c3d" returned: 0 in 0.820s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:41 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-bf644602-5a94-4c85-b430-a72123c048df tempest-VolumesMetadataTest-887303801 None] <== create_volume: return (1867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:42:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-bf644602-5a94-4c85-b430-a72123c048df tempest-VolumesMetadataTest-887303801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.870s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.846s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Acquiring lock "cinder-quobyte-c1d69906-5b27-42d0-9090-1b410debc281-f2038a75-4171-4c7a-ba7a-6b3c2de9f464" by "_create_volume_from_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:42:41 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bf644602-5a94-4c85-b430-a72123c048df tempest-VolumesMetadataTest-887303801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22089673-bc64-4abb-9c35-cc1666a9a362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83559321-c1ea-41f7-9e53-063544cf3c3d', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:41 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bf644602-5a94-4c85-b430-a72123c048df tempest-VolumesMetadataTest-887303801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd0f8b09-c6f5-4797-85fa-ff732ad97801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Lock "cinder-quobyte-c1d69906-5b27-42d0-9090-1b410debc281-f2038a75-4171-4c7a-ba7a-6b3c2de9f464" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:42:41 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Creating volume f2038a75-4171-4c7a-ba7a-6b3c2de9f464 from snapshot c1d69906-5b27-42d0-9090-1b410debc281 {{(pid=87294) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 06:42:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:41 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:42:41 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:42:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:41 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:42:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Acquiring lock "cinder-quobyte-f2038a75-4171-4c7a-ba7a-6b3c2de9f464" by "_copy_volume_from_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:42:41 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-bf644602-5a94-4c85-b430-a72123c048df tempest-VolumesMetadataTest-887303801 None] Volume volume-83559321-c1ea-41f7-9e53-063544cf3c3d (83559321-c1ea-41f7-9e53-063544cf3c3d): created successfully Jul 10 06:42:41 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bf644602-5a94-4c85-b430-a72123c048df tempest-VolumesMetadataTest-887303801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd0f8b09-c6f5-4797-85fa-ff732ad97801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:41 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bf644602-5a94-4c85-b430-a72123c048df tempest-VolumesMetadataTest-887303801 None] Flow 'volume_create_manager' (0882427d-eb50-471d-84c2-d9a4ff083c1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:42:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Lock "cinder-quobyte-f2038a75-4171-4c7a-ba7a-6b3c2de9f464" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:42:41 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] snapshot: c1d69906-5b27-42d0-9090-1b410debc281, volume: f2038a75-4171-4c7a-ba7a-6b3c2de9f464, {{(pid=87294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 06:42:41 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-bf644602-5a94-4c85-b430-a72123c048df tempest-VolumesMetadataTest-887303801 None] Created volume successfully. Jul 10 06:42:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:41 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:42:41 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:42:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:41 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b588920-a2f7-4b35-8ad7-1c2e26141d59]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:42:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f.c1d69906-5b27-42d0-9090-1b410debc281 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:41 devstack sudo[94838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f.c1d69906-5b27-42d0-9090-1b410debc281 Jul 10 06:42:41 devstack sudo[94838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:42 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddf7229f-130a-46d2-8b57-05ef3824f601 tempest-SnapshotsActionsTest-1766860581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:42:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ddf7229f-130a-46d2-8b57-05ef3824f601 tempest-SnapshotsActionsTest-1766860581 None] Flow 'volume_create_manager' (dc90b6ed-3b00-48e4-a6fa-2600cacb6dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:42:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ddf7229f-130a-46d2-8b57-05ef3824f601 tempest-SnapshotsActionsTest-1766860581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (099d659f-1c47-4257-b599-3155fc34b129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ddf7229f-130a-46d2-8b57-05ef3824f601 tempest-SnapshotsActionsTest-1766860581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (099d659f-1c47-4257-b599-3155fc34b129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:42:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1049125843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b95e459e-1083-48d2-b8b3-4e659a5880c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81316e5ff8ff43948f7ea5e8de5e58b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:42:42Z,use_quota=True,user_id='d16c1bdbf0654f7da6d6c80567062b0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ddf7229f-130a-46d2-8b57-05ef3824f601 tempest-SnapshotsActionsTest-1766860581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b15e62-a5de-49b9-8998-96aacc6b918c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ddf7229f-130a-46d2-8b57-05ef3824f601 tempest-SnapshotsActionsTest-1766860581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b15e62-a5de-49b9-8998-96aacc6b918c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ddf7229f-130a-46d2-8b57-05ef3824f601 tempest-SnapshotsActionsTest-1766860581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24d7ae2b-ad9b-4799-a2eb-11be141ecd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ddf7229f-130a-46d2-8b57-05ef3824f601 tempest-SnapshotsActionsTest-1766860581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24d7ae2b-ad9b-4799-a2eb-11be141ecd9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b95e459e-1083-48d2-b8b3-4e659a5880c7', 'volume_name': 'volume-b95e459e-1083-48d2-b8b3-4e659a5880c7', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ddf7229f-130a-46d2-8b57-05ef3824f601 tempest-SnapshotsActionsTest-1766860581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45175a78-23d1-4687-95ae-30b8344abddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ddf7229f-130a-46d2-8b57-05ef3824f601 tempest-SnapshotsActionsTest-1766860581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45175a78-23d1-4687-95ae-30b8344abddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ddf7229f-130a-46d2-8b57-05ef3824f601 tempest-SnapshotsActionsTest-1766860581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cab49b9-2d6d-4f05-8e08-0212d99bb877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:42 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-ddf7229f-130a-46d2-8b57-05ef3824f601 tempest-SnapshotsActionsTest-1766860581 None] Volume b95e459e-1083-48d2-b8b3-4e659a5880c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b95e459e-1083-48d2-b8b3-4e659a5880c7', 'volume_size': 1} Jul 10 06:42:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ddf7229f-130a-46d2-8b57-05ef3824f601 tempest-SnapshotsActionsTest-1766860581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:42 devstack sudo[94838]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f.c1d69906-5b27-42d0-9090-1b410debc281" returned: 0 in 0.776s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:42 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bca90469-b1f3-4b8c-aa65-1532f054b12f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:42:42 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f {{(pid=87294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 06:42:42 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Creating direct copy from snapshot {{(pid=87294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 06:42:42 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a22f36-b5e9-4620-8447-af19aef178b9]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:42:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:42 devstack sudo[94843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f Jul 10 06:42:42 devstack sudo[94843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:43 devstack sudo[94843]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f" returned: 0 in 0.818s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:43 devstack cinder-volume[87294]: DEBUG cinder.utils [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Path /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f2038a75-4171-4c7a-ba7a-6b3c2de9f464 not found in is_blk_device check {{(pid=87294) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 06:42:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f2038a75-4171-4c7a-ba7a-6b3c2de9f464 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:43 devstack sudo[94848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f2038a75-4171-4c7a-ba7a-6b3c2de9f464 Jul 10 06:42:43 devstack sudo[94848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:43 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f78c4fc9-a94e-4f20-94e7-8d4d225ab3c6 tempest-VolumesMetadataTest-887303801 None] Acquiring lock "cinder-83559321-c1ea-41f7-9e53-063544cf3c3d-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:42:43 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f78c4fc9-a94e-4f20-94e7-8d4d225ab3c6 tempest-VolumesMetadataTest-887303801 None] Lock "cinder-83559321-c1ea-41f7-9e53-063544cf3c3d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:42:43 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f78c4fc9-a94e-4f20-94e7-8d4d225ab3c6 tempest-VolumesMetadataTest-887303801 None] Acquiring lock "cinder-quobyte-83559321-c1ea-41f7-9e53-063544cf3c3d" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:42:43 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f78c4fc9-a94e-4f20-94e7-8d4d225ab3c6 tempest-VolumesMetadataTest-887303801 None] Lock "cinder-quobyte-83559321-c1ea-41f7-9e53-063544cf3c3d" acquired by "delete_volume" :: waited 0.017s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:42:43 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[846633d3-f4bf-426b-8741-5feb2624ff49]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:42:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f78c4fc9-a94e-4f20-94e7-8d4d225ab3c6 tempest-VolumesMetadataTest-887303801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-83559321-c1ea-41f7-9e53-063544cf3c3d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:43 devstack sudo[94850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-83559321-c1ea-41f7-9e53-063544cf3c3d Jul 10 06:42:43 devstack sudo[94850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:45 devstack sudo[94850]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f78c4fc9-a94e-4f20-94e7-8d4d225ab3c6 tempest-VolumesMetadataTest-887303801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-83559321-c1ea-41f7-9e53-063544cf3c3d" returned: 0 in 1.541s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f78c4fc9-a94e-4f20-94e7-8d4d225ab3c6 tempest-VolumesMetadataTest-887303801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-83559321-c1ea-41f7-9e53-063544cf3c3d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:45 devstack sudo[94878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-83559321-c1ea-41f7-9e53-063544cf3c3d Jul 10 06:42:45 devstack sudo[94878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:47 devstack sudo[94878]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f78c4fc9-a94e-4f20-94e7-8d4d225ab3c6 tempest-VolumesMetadataTest-887303801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-83559321-c1ea-41f7-9e53-063544cf3c3d" returned: 0 in 1.966s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:47 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f78c4fc9-a94e-4f20-94e7-8d4d225ab3c6 tempest-VolumesMetadataTest-887303801 None] Lock "cinder-quobyte-83559321-c1ea-41f7-9e53-063544cf3c3d" released by "delete_volume" :: held 3.570s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:42:47 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-f78c4fc9-a94e-4f20-94e7-8d4d225ab3c6 tempest-VolumesMetadataTest-887303801 None] Created reservations ['9a7ed3fd-f470-4d3c-ac79-8fd3621ccaaf', '22a495f5-1ad2-4804-b8db-9359627839a8', '60078390-6ae0-460d-93fb-40a83bdaac53', 'f59b71cf-7f9b-46b4-910d-4528caff76ae'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:42:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f78c4fc9-a94e-4f20-94e7-8d4d225ab3c6 tempest-VolumesMetadataTest-887303801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f78c4fc9-a94e-4f20-94e7-8d4d225ab3c6 tempest-VolumesMetadataTest-887303801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:47 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f78c4fc9-a94e-4f20-94e7-8d4d225ab3c6 tempest-VolumesMetadataTest-887303801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:42:47 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f78c4fc9-a94e-4f20-94e7-8d4d225ab3c6 tempest-VolumesMetadataTest-887303801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:42:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f78c4fc9-a94e-4f20-94e7-8d4d225ab3c6 tempest-VolumesMetadataTest-887303801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f78c4fc9-a94e-4f20-94e7-8d4d225ab3c6 tempest-VolumesMetadataTest-887303801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:47 devstack sudo[94890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:42:47 devstack sudo[94890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:48 devstack sudo[94848]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f2038a75-4171-4c7a-ba7a-6b3c2de9f464" returned: 0 in 5.559s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:48 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[daadaff2-83d0-404d-a00b-421bb266aba4]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:42:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:48 devstack sudo[94890]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f78c4fc9-a94e-4f20-94e7-8d4d225ab3c6 tempest-VolumesMetadataTest-887303801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.325s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:48 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-f78c4fc9-a94e-4f20-94e7-8d4d225ab3c6 tempest-VolumesMetadataTest-887303801 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:42:48 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-f78c4fc9-a94e-4f20-94e7-8d4d225ab3c6 tempest-VolumesMetadataTest-887303801 None] Deleted volume successfully. Jul 10 06:42:48 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f78c4fc9-a94e-4f20-94e7-8d4d225ab3c6 tempest-VolumesMetadataTest-887303801 None] Lock "cinder-83559321-c1ea-41f7-9e53-063544cf3c3d-delete_volume" released by "delete_volume" :: held 5.449s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:42:48 devstack sudo[94893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f Jul 10 06:42:48 devstack sudo[94893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:49 devstack sudo[94893]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f" returned: 0 in 1.031s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:49 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f, size 1024.00 MB, duration 5.56 sec, destination /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f2038a75-4171-4c7a-ba7a-6b3c2de9f464 {{(pid=87294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 06:42:49 devstack cinder-volume[87294]: INFO cinder.image.image_utils [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Converted 1024.00 MB image at 184.15 MB/s Jul 10 06:42:49 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f2038a75-4171-4c7a-ba7a-6b3c2de9f464 is being set with open permissions: ugo+rw Jul 10 06:42:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f2038a75-4171-4c7a-ba7a-6b3c2de9f464 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:49 devstack sudo[94900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f2038a75-4171-4c7a-ba7a-6b3c2de9f464 Jul 10 06:42:49 devstack sudo[94900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:50 devstack sudo[94900]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f2038a75-4171-4c7a-ba7a-6b3c2de9f464" returned: 0 in 0.778s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:50 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Lock "cinder-quobyte-f2038a75-4171-4c7a-ba7a-6b3c2de9f464" released by "_copy_volume_from_snapshot" :: held 9.061s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:42:50 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Lock "cinder-quobyte-c1d69906-5b27-42d0-9090-1b410debc281-f2038a75-4171-4c7a-ba7a-6b3c2de9f464" released by "_create_volume_from_snapshot" :: held 9.118s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:42:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.156s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ddf7229f-130a-46d2-8b57-05ef3824f601 tempest-SnapshotsActionsTest-1766860581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.453s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:50 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-ddf7229f-130a-46d2-8b57-05ef3824f601 tempest-SnapshotsActionsTest-1766860581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:42:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1049125843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b95e459e-1083-48d2-b8b3-4e659a5880c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81316e5ff8ff43948f7ea5e8de5e58b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:42:42Z,use_quota=True,user_id='d16c1bdbf0654f7da6d6c80567062b0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:42:50 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-ddf7229f-130a-46d2-8b57-05ef3824f601 tempest-SnapshotsActionsTest-1766860581 None] Creating volume b95e459e-1083-48d2-b8b3-4e659a5880c7 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:42:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ddf7229f-130a-46d2-8b57-05ef3824f601 tempest-SnapshotsActionsTest-1766860581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ddf7229f-130a-46d2-8b57-05ef3824f601 tempest-SnapshotsActionsTest-1766860581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:50 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-ddf7229f-130a-46d2-8b57-05ef3824f601 tempest-SnapshotsActionsTest-1766860581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:42:50 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-ddf7229f-130a-46d2-8b57-05ef3824f601 tempest-SnapshotsActionsTest-1766860581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:42:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ddf7229f-130a-46d2-8b57-05ef3824f601 tempest-SnapshotsActionsTest-1766860581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:50 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-ddf7229f-130a-46d2-8b57-05ef3824f601 tempest-SnapshotsActionsTest-1766860581 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:42:50 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-ddf7229f-130a-46d2-8b57-05ef3824f601 tempest-SnapshotsActionsTest-1766860581 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:42:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ddf7229f-130a-46d2-8b57-05ef3824f601 tempest-SnapshotsActionsTest-1766860581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:50 devstack sudo[94903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7 1073741824 Jul 10 06:42:50 devstack sudo[94903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:50 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b47e11b-5048-4da7-bb50-0dc1861140c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2038a75-4171-4c7a-ba7a-6b3c2de9f464', 'volume_size': 1, 'snapshot_id': 'c1d69906-5b27-42d0-9090-1b410debc281'}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:50 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e8f3905-5065-4a03-a256-fcc6066e8538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:50 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Volume volume-f2038a75-4171-4c7a-ba7a-6b3c2de9f464 (f2038a75-4171-4c7a-ba7a-6b3c2de9f464): created successfully Jul 10 06:42:50 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e8f3905-5065-4a03-a256-fcc6066e8538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:50 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Flow 'volume_create_manager' (d6afcafd-d6e1-4d17-a9e2-fec847702ee1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:42:50 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-092be442-bc4b-4294-a641-7e705e8a5649 tempest-VolumesDeleteCascade-747554758 None] Created volume successfully. Jul 10 06:42:51 devstack sudo[94903]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ddf7229f-130a-46d2-8b57-05ef3824f601 tempest-SnapshotsActionsTest-1766860581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7 1073741824" returned: 0 in 0.976s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ddf7229f-130a-46d2-8b57-05ef3824f601 tempest-SnapshotsActionsTest-1766860581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:51 devstack sudo[94909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7 Jul 10 06:42:51 devstack sudo[94909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:51 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2a56ccc1-bcf4-4811-809b-06d8e668ff67 tempest-VolumesDeleteCascade-747554758 None] Acquiring lock "cinder-bca90469-b1f3-4b8c-aa65-1532f054b12f-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:42:51 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2a56ccc1-bcf4-4811-809b-06d8e668ff67 tempest-VolumesDeleteCascade-747554758 None] Lock "cinder-bca90469-b1f3-4b8c-aa65-1532f054b12f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:42:51 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2a56ccc1-bcf4-4811-809b-06d8e668ff67 tempest-VolumesDeleteCascade-747554758 None] Performing cascade delete. {{(pid=87294) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 10 06:42:51 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2a56ccc1-bcf4-4811-809b-06d8e668ff67 tempest-VolumesDeleteCascade-747554758 None] Acquiring lock "cinder-c1d69906-5b27-42d0-9090-1b410debc281-delete_snapshot" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:42:51 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2a56ccc1-bcf4-4811-809b-06d8e668ff67 tempest-VolumesDeleteCascade-747554758 None] Lock "cinder-c1d69906-5b27-42d0-9090-1b410debc281-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:42:51 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2a56ccc1-bcf4-4811-809b-06d8e668ff67 tempest-VolumesDeleteCascade-747554758 None] Acquiring lock "cinder-quobyte-bca90469-b1f3-4b8c-aa65-1532f054b12f" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:42:52 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2a56ccc1-bcf4-4811-809b-06d8e668ff67 tempest-VolumesDeleteCascade-747554758 None] Lock "cinder-quobyte-bca90469-b1f3-4b8c-aa65-1532f054b12f" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:42:52 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2a56ccc1-bcf4-4811-809b-06d8e668ff67 tempest-VolumesDeleteCascade-747554758 None] Acquiring lock "cinder-quobyte-c1d69906-5b27-42d0-9090-1b410debc281" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:42:52 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2a56ccc1-bcf4-4811-809b-06d8e668ff67 tempest-VolumesDeleteCascade-747554758 None] Lock "cinder-quobyte-c1d69906-5b27-42d0-9090-1b410debc281" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:42:52 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-2a56ccc1-bcf4-4811-809b-06d8e668ff67 tempest-VolumesDeleteCascade-747554758 None] Deleting offline snapshot c1d69906-5b27-42d0-9090-1b410debc281 of volume bca90469-b1f3-4b8c-aa65-1532f054b12f {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:42:52 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-2a56ccc1-bcf4-4811-809b-06d8e668ff67 tempest-VolumesDeleteCascade-747554758 None] snapshot_file for this snap is: volume-bca90469-b1f3-4b8c-aa65-1532f054b12f.c1d69906-5b27-42d0-9090-1b410debc281 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:42:52 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dba518e-cbfa-4e6a-a282-f425f7d08346]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:42:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2a56ccc1-bcf4-4811-809b-06d8e668ff67 tempest-VolumesDeleteCascade-747554758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f.c1d69906-5b27-42d0-9090-1b410debc281 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:52 devstack sudo[94911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f.c1d69906-5b27-42d0-9090-1b410debc281 Jul 10 06:42:52 devstack sudo[94911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:52 devstack sudo[94909]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ddf7229f-130a-46d2-8b57-05ef3824f601 tempest-SnapshotsActionsTest-1766860581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7" returned: 0 in 0.777s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:52 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-ddf7229f-130a-46d2-8b57-05ef3824f601 tempest-SnapshotsActionsTest-1766860581 None] <== create_volume: return (1816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:42:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ddf7229f-130a-46d2-8b57-05ef3824f601 tempest-SnapshotsActionsTest-1766860581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.820s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:52 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ddf7229f-130a-46d2-8b57-05ef3824f601 tempest-SnapshotsActionsTest-1766860581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cab49b9-2d6d-4f05-8e08-0212d99bb877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b95e459e-1083-48d2-b8b3-4e659a5880c7', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:52 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ddf7229f-130a-46d2-8b57-05ef3824f601 tempest-SnapshotsActionsTest-1766860581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1d9a815-c542-4a31-84be-3310aa9b4d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:52 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-ddf7229f-130a-46d2-8b57-05ef3824f601 tempest-SnapshotsActionsTest-1766860581 None] Volume volume-b95e459e-1083-48d2-b8b3-4e659a5880c7 (b95e459e-1083-48d2-b8b3-4e659a5880c7): created successfully Jul 10 06:42:52 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ddf7229f-130a-46d2-8b57-05ef3824f601 tempest-SnapshotsActionsTest-1766860581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1d9a815-c542-4a31-84be-3310aa9b4d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:52 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ddf7229f-130a-46d2-8b57-05ef3824f601 tempest-SnapshotsActionsTest-1766860581 None] Flow 'volume_create_manager' (dc90b6ed-3b00-48e4-a6fa-2600cacb6dcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:42:52 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-ddf7229f-130a-46d2-8b57-05ef3824f601 tempest-SnapshotsActionsTest-1766860581 None] Created volume successfully. Jul 10 06:42:52 devstack sudo[94911]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2a56ccc1-bcf4-4811-809b-06d8e668ff67 tempest-VolumesDeleteCascade-747554758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f.c1d69906-5b27-42d0-9090-1b410debc281" returned: 0 in 0.840s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:52 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-2a56ccc1-bcf4-4811-809b-06d8e668ff67 tempest-VolumesDeleteCascade-747554758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bca90469-b1f3-4b8c-aa65-1532f054b12f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:42:52 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[99648c42-bbf0-47f3-b690-bfb2e508d803]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:42:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2a56ccc1-bcf4-4811-809b-06d8e668ff67 tempest-VolumesDeleteCascade-747554758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:53 devstack sudo[94917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f Jul 10 06:42:53 devstack sudo[94917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-daf32837-0cdd-4af9-ac35-aa262b0da891 tempest-SnapshotsActionsTest-1766860581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-daf32837-0cdd-4af9-ac35-aa262b0da891 tempest-SnapshotsActionsTest-1766860581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:53 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-daf32837-0cdd-4af9-ac35-aa262b0da891 tempest-SnapshotsActionsTest-1766860581 None] Creating offline snapshot b46f72be-1de8-4a10-af7d-f5deeaba5d08 of volume b95e459e-1083-48d2-b8b3-4e659a5880c7 {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:42:53 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c2263a0-37d3-49b1-afb4-c24c8c216028 tempest-VolumesTransfersTest-1961831863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:42:53 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-3c2263a0-37d3-49b1-afb4-c24c8c216028 tempest-VolumesTransfersTest-1961831863 None] Flow 'volume_create_manager' (c5311aee-cfa5-4578-bc96-59788c920087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:42:53 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-3c2263a0-37d3-49b1-afb4-c24c8c216028 tempest-VolumesTransfersTest-1961831863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9675007-71c0-423b-bedf-7767e6bd949b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:53 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac3a7d1-25cf-49fa-9cfb-2cac55536bdd]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:42:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-daf32837-0cdd-4af9-ac35-aa262b0da891 tempest-SnapshotsActionsTest-1766860581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:53 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-3c2263a0-37d3-49b1-afb4-c24c8c216028 tempest-VolumesTransfersTest-1961831863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9675007-71c0-423b-bedf-7767e6bd949b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1985577455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16de9991-8612-434d-ab8a-a7f8a9ac6572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e471df33330475ba610da5ad7635de2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:42:53Z,use_quota=True,user_id='c2fdf40b9eef4ed0b68b4ca592f40380',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:53 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-3c2263a0-37d3-49b1-afb4-c24c8c216028 tempest-VolumesTransfersTest-1961831863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57a7b33e-89b7-42b8-9a06-ab59263f2c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:53 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-3c2263a0-37d3-49b1-afb4-c24c8c216028 tempest-VolumesTransfersTest-1961831863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57a7b33e-89b7-42b8-9a06-ab59263f2c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:53 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-3c2263a0-37d3-49b1-afb4-c24c8c216028 tempest-VolumesTransfersTest-1961831863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f004c67-bf96-414d-94b0-c8b95f995e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:53 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-3c2263a0-37d3-49b1-afb4-c24c8c216028 tempest-VolumesTransfersTest-1961831863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f004c67-bf96-414d-94b0-c8b95f995e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16de9991-8612-434d-ab8a-a7f8a9ac6572', 'volume_name': 'volume-16de9991-8612-434d-ab8a-a7f8a9ac6572', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:53 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-3c2263a0-37d3-49b1-afb4-c24c8c216028 tempest-VolumesTransfersTest-1961831863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7962675f-a36e-490d-9c51-b4d3da0524d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:53 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-3c2263a0-37d3-49b1-afb4-c24c8c216028 tempest-VolumesTransfersTest-1961831863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7962675f-a36e-490d-9c51-b4d3da0524d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:42:53 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-3c2263a0-37d3-49b1-afb4-c24c8c216028 tempest-VolumesTransfersTest-1961831863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (000d4750-9e0e-4d6d-885d-9dd91c4c3c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:42:53 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-3c2263a0-37d3-49b1-afb4-c24c8c216028 tempest-VolumesTransfersTest-1961831863 None] Volume 16de9991-8612-434d-ab8a-a7f8a9ac6572: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16de9991-8612-434d-ab8a-a7f8a9ac6572', 'volume_size': 1} Jul 10 06:42:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-3c2263a0-37d3-49b1-afb4-c24c8c216028 tempest-VolumesTransfersTest-1961831863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:53 devstack sudo[94920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7 Jul 10 06:42:53 devstack sudo[94920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:53 devstack sudo[94917]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2a56ccc1-bcf4-4811-809b-06d8e668ff67 tempest-VolumesDeleteCascade-747554758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f" returned: 0 in 0.849s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2a56ccc1-bcf4-4811-809b-06d8e668ff67 tempest-VolumesDeleteCascade-747554758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f.c1d69906-5b27-42d0-9090-1b410debc281 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:53 devstack sudo[94926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f.c1d69906-5b27-42d0-9090-1b410debc281 Jul 10 06:42:53 devstack sudo[94926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:54 devstack sudo[94920]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-daf32837-0cdd-4af9-ac35-aa262b0da891 tempest-SnapshotsActionsTest-1766860581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7" returned: 0 in 0.801s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-daf32837-0cdd-4af9-ac35-aa262b0da891 tempest-SnapshotsActionsTest-1766860581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:54 devstack sudo[94932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08 1G Jul 10 06:42:54 devstack sudo[94932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:54 devstack sudo[94926]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2a56ccc1-bcf4-4811-809b-06d8e668ff67 tempest-VolumesDeleteCascade-747554758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f.c1d69906-5b27-42d0-9090-1b410debc281" returned: 0 in 0.784s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2a56ccc1-bcf4-4811-809b-06d8e668ff67 tempest-VolumesDeleteCascade-747554758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f.c1d69906-5b27-42d0-9090-1b410debc281 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:54 devstack sudo[94937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f.c1d69906-5b27-42d0-9090-1b410debc281 Jul 10 06:42:54 devstack sudo[94937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:55 devstack sudo[94932]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-daf32837-0cdd-4af9-ac35-aa262b0da891 tempest-SnapshotsActionsTest-1766860581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08 1G" returned: 0 in 1.001s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-daf32837-0cdd-4af9-ac35-aa262b0da891 tempest-SnapshotsActionsTest-1766860581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b95e459e-1083-48d2-b8b3-4e659a5880c7 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:55 devstack sudo[94984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b95e459e-1083-48d2-b8b3-4e659a5880c7 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08 Jul 10 06:42:55 devstack sudo[94984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:55 devstack sudo[94937]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2a56ccc1-bcf4-4811-809b-06d8e668ff67 tempest-VolumesDeleteCascade-747554758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f.c1d69906-5b27-42d0-9090-1b410debc281" returned: 0 in 0.971s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2a56ccc1-bcf4-4811-809b-06d8e668ff67 tempest-VolumesDeleteCascade-747554758 None] Lock "cinder-quobyte-c1d69906-5b27-42d0-9090-1b410debc281" released by "_delete_snapshot" :: held 3.578s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:42:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2a56ccc1-bcf4-4811-809b-06d8e668ff67 tempest-VolumesDeleteCascade-747554758 None] Lock "cinder-quobyte-bca90469-b1f3-4b8c-aa65-1532f054b12f" released by "delete_snapshot" :: held 3.608s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:42:55 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-2a56ccc1-bcf4-4811-809b-06d8e668ff67 tempest-VolumesDeleteCascade-747554758 None] Created reservations ['0693d915-92ae-405e-8e0c-d65d547b1687', '2c78794e-2339-4b0f-8629-98e41dca1015', 'a945c722-f61f-4566-9ae7-b307485dafd5', '9dcb364d-7f56-44ed-9518-488f494bcc2d'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:42:55 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-2a56ccc1-bcf4-4811-809b-06d8e668ff67 tempest-VolumesDeleteCascade-747554758 None] Delete snapshot completed successfully. Jul 10 06:42:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2a56ccc1-bcf4-4811-809b-06d8e668ff67 tempest-VolumesDeleteCascade-747554758 None] Lock "cinder-c1d69906-5b27-42d0-9090-1b410debc281-delete_snapshot" released by "delete_snapshot" :: held 3.782s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:42:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2a56ccc1-bcf4-4811-809b-06d8e668ff67 tempest-VolumesDeleteCascade-747554758 None] Snapshots deleted, issuing volume delete {{(pid=87294) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 10 06:42:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2a56ccc1-bcf4-4811-809b-06d8e668ff67 tempest-VolumesDeleteCascade-747554758 None] Acquiring lock "cinder-quobyte-bca90469-b1f3-4b8c-aa65-1532f054b12f" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:42:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2a56ccc1-bcf4-4811-809b-06d8e668ff67 tempest-VolumesDeleteCascade-747554758 None] Lock "cinder-quobyte-bca90469-b1f3-4b8c-aa65-1532f054b12f" acquired by "delete_volume" :: waited 0.015s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:42:55 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e854be-433e-4d4e-987a-3f57945de6e1]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:42:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2a56ccc1-bcf4-4811-809b-06d8e668ff67 tempest-VolumesDeleteCascade-747554758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:55 devstack sudo[95054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f Jul 10 06:42:55 devstack sudo[95054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:56 devstack sudo[94984]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-daf32837-0cdd-4af9-ac35-aa262b0da891 tempest-SnapshotsActionsTest-1766860581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b95e459e-1083-48d2-b8b3-4e659a5880c7 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08" returned: 0 in 0.771s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:56 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-daf32837-0cdd-4af9-ac35-aa262b0da891 tempest-SnapshotsActionsTest-1766860581 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08 is being set with open permissions: ugo+rw Jul 10 06:42:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-daf32837-0cdd-4af9-ac35-aa262b0da891 tempest-SnapshotsActionsTest-1766860581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:56 devstack sudo[95059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08 Jul 10 06:42:56 devstack sudo[95059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:56 devstack sudo[95054]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2a56ccc1-bcf4-4811-809b-06d8e668ff67 tempest-VolumesDeleteCascade-747554758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f" returned: 0 in 0.799s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2a56ccc1-bcf4-4811-809b-06d8e668ff67 tempest-VolumesDeleteCascade-747554758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:56 devstack sudo[95067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f Jul 10 06:42:56 devstack sudo[95067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:56 devstack sudo[95059]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-daf32837-0cdd-4af9-ac35-aa262b0da891 tempest-SnapshotsActionsTest-1766860581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08" returned: 0 in 0.696s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-daf32837-0cdd-4af9-ac35-aa262b0da891 tempest-SnapshotsActionsTest-1766860581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:56 devstack sudo[95074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.info Jul 10 06:42:56 devstack sudo[95074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:57 devstack sudo[95067]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2a56ccc1-bcf4-4811-809b-06d8e668ff67 tempest-VolumesDeleteCascade-747554758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bca90469-b1f3-4b8c-aa65-1532f054b12f" returned: 0 in 0.666s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:57 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2a56ccc1-bcf4-4811-809b-06d8e668ff67 tempest-VolumesDeleteCascade-747554758 None] Lock "cinder-quobyte-bca90469-b1f3-4b8c-aa65-1532f054b12f" released by "delete_volume" :: held 1.531s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:42:57 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:SELECT=107,cinder:UPDATE=135,cinder:INSERT=41,cinder:DELETE=8 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:42:57 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-2a56ccc1-bcf4-4811-809b-06d8e668ff67 tempest-VolumesDeleteCascade-747554758 None] Created reservations ['1297e21d-d100-4fd2-aaa9-652282e9f403', '253b2389-8bde-4a3d-a8f3-b3f44adc8d0c', '8a6f2b87-76ec-4dcc-8039-c306b47b6baf', 'cf4b057a-ac83-4a50-8da8-89327d89ecf9'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:42:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2a56ccc1-bcf4-4811-809b-06d8e668ff67 tempest-VolumesDeleteCascade-747554758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2a56ccc1-bcf4-4811-809b-06d8e668ff67 tempest-VolumesDeleteCascade-747554758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:57 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-2a56ccc1-bcf4-4811-809b-06d8e668ff67 tempest-VolumesDeleteCascade-747554758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:42:57 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-2a56ccc1-bcf4-4811-809b-06d8e668ff67 tempest-VolumesDeleteCascade-747554758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:42:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2a56ccc1-bcf4-4811-809b-06d8e668ff67 tempest-VolumesDeleteCascade-747554758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2a56ccc1-bcf4-4811-809b-06d8e668ff67 tempest-VolumesDeleteCascade-747554758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:57 devstack sudo[95080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:42:57 devstack sudo[95080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:57 devstack sudo[95074]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-daf32837-0cdd-4af9-ac35-aa262b0da891 tempest-SnapshotsActionsTest-1766860581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.info" returned: 0 in 0.684s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:57 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-daf32837-0cdd-4af9-ac35-aa262b0da891 tempest-SnapshotsActionsTest-1766860581 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.info is being set with open permissions: ugo+rw Jul 10 06:42:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-daf32837-0cdd-4af9-ac35-aa262b0da891 tempest-SnapshotsActionsTest-1766860581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:57 devstack sudo[95083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.info Jul 10 06:42:57 devstack sudo[95083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:58 devstack sudo[95080]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2a56ccc1-bcf4-4811-809b-06d8e668ff67 tempest-VolumesDeleteCascade-747554758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.707s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:58 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-2a56ccc1-bcf4-4811-809b-06d8e668ff67 tempest-VolumesDeleteCascade-747554758 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:42:58 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-2a56ccc1-bcf4-4811-809b-06d8e668ff67 tempest-VolumesDeleteCascade-747554758 None] Deleted volume successfully. Jul 10 06:42:58 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2a56ccc1-bcf4-4811-809b-06d8e668ff67 tempest-VolumesDeleteCascade-747554758 None] Lock "cinder-bca90469-b1f3-4b8c-aa65-1532f054b12f-delete_volume" released by "delete_volume" :: held 6.317s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:42:58 devstack sudo[95083]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-daf32837-0cdd-4af9-ac35-aa262b0da891 tempest-SnapshotsActionsTest-1766860581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.info" returned: 0 in 0.671s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:42:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-daf32837-0cdd-4af9-ac35-aa262b0da891 tempest-SnapshotsActionsTest-1766860581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.743s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-3c2263a0-37d3-49b1-afb4-c24c8c216028 tempest-VolumesTransfersTest-1961831863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.579s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:58 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-3c2263a0-37d3-49b1-afb4-c24c8c216028 tempest-VolumesTransfersTest-1961831863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1985577455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16de9991-8612-434d-ab8a-a7f8a9ac6572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e471df33330475ba610da5ad7635de2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:42:53Z,use_quota=True,user_id='c2fdf40b9eef4ed0b68b4ca592f40380',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:42:58 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-3c2263a0-37d3-49b1-afb4-c24c8c216028 tempest-VolumesTransfersTest-1961831863 None] Creating volume 16de9991-8612-434d-ab8a-a7f8a9ac6572 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:42:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-3c2263a0-37d3-49b1-afb4-c24c8c216028 tempest-VolumesTransfersTest-1961831863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-3c2263a0-37d3-49b1-afb4-c24c8c216028 tempest-VolumesTransfersTest-1961831863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:42:58 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-3c2263a0-37d3-49b1-afb4-c24c8c216028 tempest-VolumesTransfersTest-1961831863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:42:58 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-3c2263a0-37d3-49b1-afb4-c24c8c216028 tempest-VolumesTransfersTest-1961831863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:42:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-3c2263a0-37d3-49b1-afb4-c24c8c216028 tempest-VolumesTransfersTest-1961831863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:42:58 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-3c2263a0-37d3-49b1-afb4-c24c8c216028 tempest-VolumesTransfersTest-1961831863 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:42:58 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-3c2263a0-37d3-49b1-afb4-c24c8c216028 tempest-VolumesTransfersTest-1961831863 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:42:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3c2263a0-37d3-49b1-afb4-c24c8c216028 tempest-VolumesTransfersTest-1961831863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-16de9991-8612-434d-ab8a-a7f8a9ac6572 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:58 devstack sudo[95092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-16de9991-8612-434d-ab8a-a7f8a9ac6572 1073741824 Jul 10 06:42:58 devstack sudo[95092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:58 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-daf32837-0cdd-4af9-ac35-aa262b0da891 tempest-SnapshotsActionsTest-1766860581 None] Create snapshot completed successfully Jul 10 06:42:58 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d9d225d7-1df7-48d9-8443-507e668db77f tempest-VolumesDeleteCascade-747554758 None] Acquiring lock "cinder-f2038a75-4171-4c7a-ba7a-6b3c2de9f464-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:42:58 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d9d225d7-1df7-48d9-8443-507e668db77f tempest-VolumesDeleteCascade-747554758 None] Lock "cinder-f2038a75-4171-4c7a-ba7a-6b3c2de9f464-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:42:58 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d9d225d7-1df7-48d9-8443-507e668db77f tempest-VolumesDeleteCascade-747554758 None] Acquiring lock "cinder-quobyte-f2038a75-4171-4c7a-ba7a-6b3c2de9f464" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:42:58 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d9d225d7-1df7-48d9-8443-507e668db77f tempest-VolumesDeleteCascade-747554758 None] Lock "cinder-quobyte-f2038a75-4171-4c7a-ba7a-6b3c2de9f464" acquired by "delete_volume" :: waited 0.032s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:42:59 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[26cf0afb-f697-4dad-9acc-dab7019398ba]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:42:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d9d225d7-1df7-48d9-8443-507e668db77f tempest-VolumesDeleteCascade-747554758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f2038a75-4171-4c7a-ba7a-6b3c2de9f464 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:42:59 devstack sudo[95459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f2038a75-4171-4c7a-ba7a-6b3c2de9f464 Jul 10 06:42:59 devstack sudo[95459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:42:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9ea19901-a6be-4fa7-baa4-0b3277475a37 tempest-SnapshotsActionsTest-1766860581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:42:59 devstack sudo[95092]: pam_unix(sudo:session): session closed for user root Jul 10 06:42:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3c2263a0-37d3-49b1-afb4-c24c8c216028 tempest-VolumesTransfersTest-1961831863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-16de9991-8612-434d-ab8a-a7f8a9ac6572 1073741824" returned: 0 in 1.756s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3c2263a0-37d3-49b1-afb4-c24c8c216028 tempest-VolumesTransfersTest-1961831863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-16de9991-8612-434d-ab8a-a7f8a9ac6572 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:00 devstack sudo[95481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-16de9991-8612-434d-ab8a-a7f8a9ac6572 Jul 10 06:43:00 devstack sudo[95481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:00 devstack sudo[95459]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d9d225d7-1df7-48d9-8443-507e668db77f tempest-VolumesDeleteCascade-747554758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f2038a75-4171-4c7a-ba7a-6b3c2de9f464" returned: 0 in 1.331s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d9d225d7-1df7-48d9-8443-507e668db77f tempest-VolumesDeleteCascade-747554758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f2038a75-4171-4c7a-ba7a-6b3c2de9f464 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:00 devstack sudo[95488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f2038a75-4171-4c7a-ba7a-6b3c2de9f464 Jul 10 06:43:00 devstack sudo[95488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:00 devstack sudo[95481]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3c2263a0-37d3-49b1-afb4-c24c8c216028 tempest-VolumesTransfersTest-1961831863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-16de9991-8612-434d-ab8a-a7f8a9ac6572" returned: 0 in 0.809s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:00 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-3c2263a0-37d3-49b1-afb4-c24c8c216028 tempest-VolumesTransfersTest-1961831863 None] <== create_volume: return (2623ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:43:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-3c2263a0-37d3-49b1-afb4-c24c8c216028 tempest-VolumesTransfersTest-1961831863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.628s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:43:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9ea19901-a6be-4fa7-baa4-0b3277475a37 tempest-SnapshotsActionsTest-1766860581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.917s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:43:00 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-9ea19901-a6be-4fa7-baa4-0b3277475a37 tempest-SnapshotsActionsTest-1766860581 None] Creating offline snapshot f5432f5e-8004-4205-a969-d66bc80cd657 of volume b95e459e-1083-48d2-b8b3-4e659a5880c7 {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:43:00 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-3c2263a0-37d3-49b1-afb4-c24c8c216028 tempest-VolumesTransfersTest-1961831863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (000d4750-9e0e-4d6d-885d-9dd91c4c3c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16de9991-8612-434d-ab8a-a7f8a9ac6572', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:00 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-3c2263a0-37d3-49b1-afb4-c24c8c216028 tempest-VolumesTransfersTest-1961831863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab906f05-db76-405c-8566-77ca530ba103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:00 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[24413993-3255-4ac8-8172-84352e45f3e6]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:43:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9ea19901-a6be-4fa7-baa4-0b3277475a37 tempest-SnapshotsActionsTest-1766860581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:00 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-3c2263a0-37d3-49b1-afb4-c24c8c216028 tempest-VolumesTransfersTest-1961831863 None] Volume volume-16de9991-8612-434d-ab8a-a7f8a9ac6572 (16de9991-8612-434d-ab8a-a7f8a9ac6572): created successfully Jul 10 06:43:00 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-3c2263a0-37d3-49b1-afb4-c24c8c216028 tempest-VolumesTransfersTest-1961831863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab906f05-db76-405c-8566-77ca530ba103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:00 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-3c2263a0-37d3-49b1-afb4-c24c8c216028 tempest-VolumesTransfersTest-1961831863 None] Flow 'volume_create_manager' (c5311aee-cfa5-4578-bc96-59788c920087) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:43:01 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-3c2263a0-37d3-49b1-afb4-c24c8c216028 tempest-VolumesTransfersTest-1961831863 None] Created volume successfully. Jul 10 06:43:01 devstack sudo[95491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08 Jul 10 06:43:01 devstack sudo[95491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:01 devstack sudo[95488]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d9d225d7-1df7-48d9-8443-507e668db77f tempest-VolumesDeleteCascade-747554758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f2038a75-4171-4c7a-ba7a-6b3c2de9f464" returned: 0 in 0.749s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:01 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d9d225d7-1df7-48d9-8443-507e668db77f tempest-VolumesDeleteCascade-747554758 None] Lock "cinder-quobyte-f2038a75-4171-4c7a-ba7a-6b3c2de9f464" released by "delete_volume" :: held 2.184s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:43:01 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-d9d225d7-1df7-48d9-8443-507e668db77f tempest-VolumesDeleteCascade-747554758 None] Created reservations ['a0ae23d7-b038-4cf1-ba79-e77eb63a9ca7', 'f75454cc-784f-4f75-b753-9b2d5fa7e9f9', 'dafbb6cb-45b9-41e0-8234-e0ee3efd36f0', '37a00ab9-cb81-480c-bc5c-3bd53bf56772'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:43:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d9d225d7-1df7-48d9-8443-507e668db77f tempest-VolumesDeleteCascade-747554758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:43:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d9d225d7-1df7-48d9-8443-507e668db77f tempest-VolumesDeleteCascade-747554758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:43:01 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-d9d225d7-1df7-48d9-8443-507e668db77f tempest-VolumesDeleteCascade-747554758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:43:01 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-d9d225d7-1df7-48d9-8443-507e668db77f tempest-VolumesDeleteCascade-747554758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:43:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d9d225d7-1df7-48d9-8443-507e668db77f tempest-VolumesDeleteCascade-747554758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:43:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d9d225d7-1df7-48d9-8443-507e668db77f tempest-VolumesDeleteCascade-747554758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:01 devstack sudo[95494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:43:01 devstack sudo[95494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:01 devstack sudo[95491]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9ea19901-a6be-4fa7-baa4-0b3277475a37 tempest-SnapshotsActionsTest-1766860581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08" returned: 0 in 0.935s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:01 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-9ea19901-a6be-4fa7-baa4-0b3277475a37 tempest-SnapshotsActionsTest-1766860581 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b95e459e-1083-48d2-b8b3-4e659a5880c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:43:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9ea19901-a6be-4fa7-baa4-0b3277475a37 tempest-SnapshotsActionsTest-1766860581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.f5432f5e-8004-4205-a969-d66bc80cd657 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:01 devstack sudo[95499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.f5432f5e-8004-4205-a969-d66bc80cd657 1G Jul 10 06:43:01 devstack sudo[95499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:02 devstack sudo[95494]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d9d225d7-1df7-48d9-8443-507e668db77f tempest-VolumesDeleteCascade-747554758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.907s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:02 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-d9d225d7-1df7-48d9-8443-507e668db77f tempest-VolumesDeleteCascade-747554758 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:43:02 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-d9d225d7-1df7-48d9-8443-507e668db77f tempest-VolumesDeleteCascade-747554758 None] Deleted volume successfully. Jul 10 06:43:02 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d9d225d7-1df7-48d9-8443-507e668db77f tempest-VolumesDeleteCascade-747554758 None] Lock "cinder-f2038a75-4171-4c7a-ba7a-6b3c2de9f464-delete_volume" released by "delete_volume" :: held 3.426s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:43:03 devstack sudo[95499]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9ea19901-a6be-4fa7-baa4-0b3277475a37 tempest-SnapshotsActionsTest-1766860581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.f5432f5e-8004-4205-a969-d66bc80cd657 1G" returned: 0 in 1.253s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9ea19901-a6be-4fa7-baa4-0b3277475a37 tempest-SnapshotsActionsTest-1766860581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.f5432f5e-8004-4205-a969-d66bc80cd657 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:03 devstack sudo[95506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.f5432f5e-8004-4205-a969-d66bc80cd657 Jul 10 06:43:03 devstack sudo[95506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:03 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-e407dd78-a326-476c-8d2e-ddcd526987e4 tempest-VolumesTransfersTest-1566518259 None] Transfer volume completed successfully. Jul 10 06:43:03 devstack sudo[95506]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9ea19901-a6be-4fa7-baa4-0b3277475a37 tempest-SnapshotsActionsTest-1766860581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.f5432f5e-8004-4205-a969-d66bc80cd657" returned: 0 in 0.862s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:03 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-9ea19901-a6be-4fa7-baa4-0b3277475a37 tempest-SnapshotsActionsTest-1766860581 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.f5432f5e-8004-4205-a969-d66bc80cd657 is being set with open permissions: ugo+rw Jul 10 06:43:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9ea19901-a6be-4fa7-baa4-0b3277475a37 tempest-SnapshotsActionsTest-1766860581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.f5432f5e-8004-4205-a969-d66bc80cd657 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:04 devstack sudo[95511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.f5432f5e-8004-4205-a969-d66bc80cd657 Jul 10 06:43:04 devstack sudo[95511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:04 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2e8b475f-70e7-4fcb-82ae-ff77efe3f4e0 tempest-VolumesTransfersTest-1598252103 None] Acquiring lock "cinder-16de9991-8612-434d-ab8a-a7f8a9ac6572-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:43:04 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2e8b475f-70e7-4fcb-82ae-ff77efe3f4e0 tempest-VolumesTransfersTest-1598252103 None] Lock "cinder-16de9991-8612-434d-ab8a-a7f8a9ac6572-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:43:04 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2e8b475f-70e7-4fcb-82ae-ff77efe3f4e0 tempest-VolumesTransfersTest-1598252103 None] Acquiring lock "cinder-quobyte-16de9991-8612-434d-ab8a-a7f8a9ac6572" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:43:04 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2e8b475f-70e7-4fcb-82ae-ff77efe3f4e0 tempest-VolumesTransfersTest-1598252103 None] Lock "cinder-quobyte-16de9991-8612-434d-ab8a-a7f8a9ac6572" acquired by "delete_volume" :: waited 0.023s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:43:04 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cdc9d55-997f-4dd9-b1c5-1ba1070cc25d]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:43:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2e8b475f-70e7-4fcb-82ae-ff77efe3f4e0 tempest-VolumesTransfersTest-1598252103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-16de9991-8612-434d-ab8a-a7f8a9ac6572 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:04 devstack sudo[95511]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9ea19901-a6be-4fa7-baa4-0b3277475a37 tempest-SnapshotsActionsTest-1766860581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.f5432f5e-8004-4205-a969-d66bc80cd657" returned: 0 in 0.825s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:04 devstack sudo[95514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-16de9991-8612-434d-ab8a-a7f8a9ac6572 Jul 10 06:43:04 devstack sudo[95514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9ea19901-a6be-4fa7-baa4-0b3277475a37 tempest-SnapshotsActionsTest-1766860581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.024s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:43:04 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-9ea19901-a6be-4fa7-baa4-0b3277475a37 tempest-SnapshotsActionsTest-1766860581 None] Create snapshot completed successfully Jul 10 06:43:05 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-82c444b2-89a3-452b-9f91-ebad54eaba27 tempest-SnapshotsActionsTest-358660859 None] Acquiring lock "cinder-f5432f5e-8004-4205-a969-d66bc80cd657-delete_snapshot" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:43:05 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-82c444b2-89a3-452b-9f91-ebad54eaba27 tempest-SnapshotsActionsTest-358660859 None] Lock "cinder-f5432f5e-8004-4205-a969-d66bc80cd657-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:43:05 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-82c444b2-89a3-452b-9f91-ebad54eaba27 tempest-SnapshotsActionsTest-358660859 None] Acquiring lock "cinder-quobyte-b95e459e-1083-48d2-b8b3-4e659a5880c7" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:43:05 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-82c444b2-89a3-452b-9f91-ebad54eaba27 tempest-SnapshotsActionsTest-358660859 None] Lock "cinder-quobyte-b95e459e-1083-48d2-b8b3-4e659a5880c7" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:43:05 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-82c444b2-89a3-452b-9f91-ebad54eaba27 tempest-SnapshotsActionsTest-358660859 None] Acquiring lock "cinder-quobyte-f5432f5e-8004-4205-a969-d66bc80cd657" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:43:05 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-82c444b2-89a3-452b-9f91-ebad54eaba27 tempest-SnapshotsActionsTest-358660859 None] Lock "cinder-quobyte-f5432f5e-8004-4205-a969-d66bc80cd657" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:43:05 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-82c444b2-89a3-452b-9f91-ebad54eaba27 tempest-SnapshotsActionsTest-358660859 None] Deleting offline snapshot f5432f5e-8004-4205-a969-d66bc80cd657 of volume b95e459e-1083-48d2-b8b3-4e659a5880c7 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:43:05 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-82c444b2-89a3-452b-9f91-ebad54eaba27 tempest-SnapshotsActionsTest-358660859 None] snapshot_file for this snap is: volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.f5432f5e-8004-4205-a969-d66bc80cd657 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:43:05 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff19ea1-0169-4f15-80ca-a94fa81539a8]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:43:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-82c444b2-89a3-452b-9f91-ebad54eaba27 tempest-SnapshotsActionsTest-358660859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.f5432f5e-8004-4205-a969-d66bc80cd657 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:05 devstack sudo[95514]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2e8b475f-70e7-4fcb-82ae-ff77efe3f4e0 tempest-VolumesTransfersTest-1598252103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-16de9991-8612-434d-ab8a-a7f8a9ac6572" returned: 0 in 0.963s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2e8b475f-70e7-4fcb-82ae-ff77efe3f4e0 tempest-VolumesTransfersTest-1598252103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-16de9991-8612-434d-ab8a-a7f8a9ac6572 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:05 devstack sudo[95519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.f5432f5e-8004-4205-a969-d66bc80cd657 Jul 10 06:43:05 devstack sudo[95519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:05 devstack sudo[95520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-16de9991-8612-434d-ab8a-a7f8a9ac6572 Jul 10 06:43:05 devstack sudo[95520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:06 devstack sudo[95520]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2e8b475f-70e7-4fcb-82ae-ff77efe3f4e0 tempest-VolumesTransfersTest-1598252103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-16de9991-8612-434d-ab8a-a7f8a9ac6572" returned: 0 in 0.858s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:06 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2e8b475f-70e7-4fcb-82ae-ff77efe3f4e0 tempest-VolumesTransfersTest-1598252103 None] Lock "cinder-quobyte-16de9991-8612-434d-ab8a-a7f8a9ac6572" released by "delete_volume" :: held 1.873s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:43:06 devstack sudo[95519]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-82c444b2-89a3-452b-9f91-ebad54eaba27 tempest-SnapshotsActionsTest-358660859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.f5432f5e-8004-4205-a969-d66bc80cd657" returned: 0 in 1.064s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:06 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-82c444b2-89a3-452b-9f91-ebad54eaba27 tempest-SnapshotsActionsTest-358660859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b95e459e-1083-48d2-b8b3-4e659a5880c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:43:06 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[12eb5efe-0ff9-4f2c-88fd-2ecff508f0ae]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:43:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-82c444b2-89a3-452b-9f91-ebad54eaba27 tempest-SnapshotsActionsTest-358660859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:06 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-2e8b475f-70e7-4fcb-82ae-ff77efe3f4e0 tempest-VolumesTransfersTest-1598252103 None] Created reservations ['d93cc0dd-a746-4a44-890f-7484fa7e09c7', '3dc3e16c-f01f-4b43-843e-18f6899a7c77', '1225c4ce-cf6a-4c39-be3a-5b7b57abeab6', '3183c5c4-cfc9-4801-a0ab-617eb70edde0'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:43:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2e8b475f-70e7-4fcb-82ae-ff77efe3f4e0 tempest-VolumesTransfersTest-1598252103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:43:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2e8b475f-70e7-4fcb-82ae-ff77efe3f4e0 tempest-VolumesTransfersTest-1598252103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:43:06 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-2e8b475f-70e7-4fcb-82ae-ff77efe3f4e0 tempest-VolumesTransfersTest-1598252103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:43:06 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-2e8b475f-70e7-4fcb-82ae-ff77efe3f4e0 tempest-VolumesTransfersTest-1598252103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:43:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2e8b475f-70e7-4fcb-82ae-ff77efe3f4e0 tempest-VolumesTransfersTest-1598252103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:43:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2e8b475f-70e7-4fcb-82ae-ff77efe3f4e0 tempest-VolumesTransfersTest-1598252103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:06 devstack sudo[95528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:43:06 devstack sudo[95528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:06 devstack sudo[95527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08 Jul 10 06:43:06 devstack sudo[95527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:07 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:SELECT=139,cinder:UPDATE=126,cinder:INSERT=33,cinder:DELETE=12 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:43:07 devstack sudo[95528]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2e8b475f-70e7-4fcb-82ae-ff77efe3f4e0 tempest-VolumesTransfersTest-1598252103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.098s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:07 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-2e8b475f-70e7-4fcb-82ae-ff77efe3f4e0 tempest-VolumesTransfersTest-1598252103 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:43:07 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-2e8b475f-70e7-4fcb-82ae-ff77efe3f4e0 tempest-VolumesTransfersTest-1598252103 None] Deleted volume successfully. Jul 10 06:43:07 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-ded1bea8-3b54-4278-ae32-cbd5c3c186ce tempest-VolumesTransfersTest-1961831863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:43:07 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ded1bea8-3b54-4278-ae32-cbd5c3c186ce tempest-VolumesTransfersTest-1961831863 None] Flow 'volume_create_manager' (6b365b27-6103-4568-835b-06f3ecff4e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:43:07 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ded1bea8-3b54-4278-ae32-cbd5c3c186ce tempest-VolumesTransfersTest-1961831863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa90030-a67c-4b9f-9cd0-a9cc7c737c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:07 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2e8b475f-70e7-4fcb-82ae-ff77efe3f4e0 tempest-VolumesTransfersTest-1598252103 None] Lock "cinder-16de9991-8612-434d-ab8a-a7f8a9ac6572-delete_volume" released by "delete_volume" :: held 3.333s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:43:07 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ded1bea8-3b54-4278-ae32-cbd5c3c186ce tempest-VolumesTransfersTest-1961831863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa90030-a67c-4b9f-9cd0-a9cc7c737c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1522585797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13acce36-983f-494a-a1f1-513fd29fcb18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e471df33330475ba610da5ad7635de2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:43:08Z,use_quota=True,user_id='c2fdf40b9eef4ed0b68b4ca592f40380',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:07 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ded1bea8-3b54-4278-ae32-cbd5c3c186ce tempest-VolumesTransfersTest-1961831863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12d8e99f-dedf-41f8-9168-315be06665a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:07 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ded1bea8-3b54-4278-ae32-cbd5c3c186ce tempest-VolumesTransfersTest-1961831863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12d8e99f-dedf-41f8-9168-315be06665a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:07 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ded1bea8-3b54-4278-ae32-cbd5c3c186ce tempest-VolumesTransfersTest-1961831863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b1550b9-2149-475c-8fc4-f36a2ff2d411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:07 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ded1bea8-3b54-4278-ae32-cbd5c3c186ce tempest-VolumesTransfersTest-1961831863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b1550b9-2149-475c-8fc4-f36a2ff2d411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13acce36-983f-494a-a1f1-513fd29fcb18', 'volume_name': 'volume-13acce36-983f-494a-a1f1-513fd29fcb18', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:07 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ded1bea8-3b54-4278-ae32-cbd5c3c186ce tempest-VolumesTransfersTest-1961831863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa3f942a-6d00-4048-ae31-7b8b058a30bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:07 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ded1bea8-3b54-4278-ae32-cbd5c3c186ce tempest-VolumesTransfersTest-1961831863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa3f942a-6d00-4048-ae31-7b8b058a30bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:07 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ded1bea8-3b54-4278-ae32-cbd5c3c186ce tempest-VolumesTransfersTest-1961831863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9f76200-47a9-4651-89d3-0528de44cfb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:07 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-ded1bea8-3b54-4278-ae32-cbd5c3c186ce tempest-VolumesTransfersTest-1961831863 None] Volume 13acce36-983f-494a-a1f1-513fd29fcb18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13acce36-983f-494a-a1f1-513fd29fcb18', 'volume_size': 1} Jul 10 06:43:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ded1bea8-3b54-4278-ae32-cbd5c3c186ce tempest-VolumesTransfersTest-1961831863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:43:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ded1bea8-3b54-4278-ae32-cbd5c3c186ce tempest-VolumesTransfersTest-1961831863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:43:07 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-ded1bea8-3b54-4278-ae32-cbd5c3c186ce tempest-VolumesTransfersTest-1961831863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1522585797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13acce36-983f-494a-a1f1-513fd29fcb18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e471df33330475ba610da5ad7635de2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:43:08Z,use_quota=True,user_id='c2fdf40b9eef4ed0b68b4ca592f40380',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:43:07 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-ded1bea8-3b54-4278-ae32-cbd5c3c186ce tempest-VolumesTransfersTest-1961831863 None] Creating volume 13acce36-983f-494a-a1f1-513fd29fcb18 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:43:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ded1bea8-3b54-4278-ae32-cbd5c3c186ce tempest-VolumesTransfersTest-1961831863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:43:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ded1bea8-3b54-4278-ae32-cbd5c3c186ce tempest-VolumesTransfersTest-1961831863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:43:07 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-ded1bea8-3b54-4278-ae32-cbd5c3c186ce tempest-VolumesTransfersTest-1961831863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:43:08 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-ded1bea8-3b54-4278-ae32-cbd5c3c186ce tempest-VolumesTransfersTest-1961831863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:43:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ded1bea8-3b54-4278-ae32-cbd5c3c186ce tempest-VolumesTransfersTest-1961831863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:43:08 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-ded1bea8-3b54-4278-ae32-cbd5c3c186ce tempest-VolumesTransfersTest-1961831863 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:43:08 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-ded1bea8-3b54-4278-ae32-cbd5c3c186ce tempest-VolumesTransfersTest-1961831863 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:43:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ded1bea8-3b54-4278-ae32-cbd5c3c186ce tempest-VolumesTransfersTest-1961831863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-13acce36-983f-494a-a1f1-513fd29fcb18 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:08 devstack sudo[95535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-13acce36-983f-494a-a1f1-513fd29fcb18 1073741824 Jul 10 06:43:08 devstack sudo[95535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:08 devstack sudo[95527]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-82c444b2-89a3-452b-9f91-ebad54eaba27 tempest-SnapshotsActionsTest-358660859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08" returned: 0 in 1.438s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:08 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-82c444b2-89a3-452b-9f91-ebad54eaba27 tempest-SnapshotsActionsTest-358660859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b95e459e-1083-48d2-b8b3-4e659a5880c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:43:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-82c444b2-89a3-452b-9f91-ebad54eaba27 tempest-SnapshotsActionsTest-358660859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.f5432f5e-8004-4205-a969-d66bc80cd657 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:08 devstack sudo[95537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.f5432f5e-8004-4205-a969-d66bc80cd657 Jul 10 06:43:08 devstack sudo[95537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:09 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7b55d6e-b6d5-4025-a65d-0480094c9050 tempest-VolumesTransfersV357Test-1728079610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:43:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b7b55d6e-b6d5-4025-a65d-0480094c9050 tempest-VolumesTransfersV357Test-1728079610 None] Flow 'volume_create_manager' (15756225-30cd-42cc-8af3-665ac86869e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:43:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b7b55d6e-b6d5-4025-a65d-0480094c9050 tempest-VolumesTransfersV357Test-1728079610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ba5906e-9d9b-4e5c-b3f4-e5bfeb6cf506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b7b55d6e-b6d5-4025-a65d-0480094c9050 tempest-VolumesTransfersV357Test-1728079610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ba5906e-9d9b-4e5c-b3f4-e5bfeb6cf506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:43:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-617023400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98b2fc5d-082f-43f1-91ff-66d86e5e744c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d551320164f436da7e17550bf948e66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:43:09Z,use_quota=True,user_id='b8c1ba1939ea4191b3be9092463b5a2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b7b55d6e-b6d5-4025-a65d-0480094c9050 tempest-VolumesTransfersV357Test-1728079610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58f379c7-87b1-4838-a714-54b0a6ec347e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b7b55d6e-b6d5-4025-a65d-0480094c9050 tempest-VolumesTransfersV357Test-1728079610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58f379c7-87b1-4838-a714-54b0a6ec347e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b7b55d6e-b6d5-4025-a65d-0480094c9050 tempest-VolumesTransfersV357Test-1728079610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ef13f6b-54a4-4c13-9bc7-042636328df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b7b55d6e-b6d5-4025-a65d-0480094c9050 tempest-VolumesTransfersV357Test-1728079610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ef13f6b-54a4-4c13-9bc7-042636328df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98b2fc5d-082f-43f1-91ff-66d86e5e744c', 'volume_name': 'volume-98b2fc5d-082f-43f1-91ff-66d86e5e744c', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b7b55d6e-b6d5-4025-a65d-0480094c9050 tempest-VolumesTransfersV357Test-1728079610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae4ebb22-8faf-4f8c-8dea-f6852920fad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b7b55d6e-b6d5-4025-a65d-0480094c9050 tempest-VolumesTransfersV357Test-1728079610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae4ebb22-8faf-4f8c-8dea-f6852920fad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b7b55d6e-b6d5-4025-a65d-0480094c9050 tempest-VolumesTransfersV357Test-1728079610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aac8a009-c2e0-4d58-8311-7dcf2f1196c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:09 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-b7b55d6e-b6d5-4025-a65d-0480094c9050 tempest-VolumesTransfersV357Test-1728079610 None] Volume 98b2fc5d-082f-43f1-91ff-66d86e5e744c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98b2fc5d-082f-43f1-91ff-66d86e5e744c', 'volume_size': 1} Jul 10 06:43:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b7b55d6e-b6d5-4025-a65d-0480094c9050 tempest-VolumesTransfersV357Test-1728079610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:43:09 devstack sudo[95535]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ded1bea8-3b54-4278-ae32-cbd5c3c186ce tempest-VolumesTransfersTest-1961831863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-13acce36-983f-494a-a1f1-513fd29fcb18 1073741824" returned: 0 in 1.182s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:09 devstack sudo[95537]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-82c444b2-89a3-452b-9f91-ebad54eaba27 tempest-SnapshotsActionsTest-358660859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.f5432f5e-8004-4205-a969-d66bc80cd657" returned: 0 in 1.140s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-82c444b2-89a3-452b-9f91-ebad54eaba27 tempest-SnapshotsActionsTest-358660859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.f5432f5e-8004-4205-a969-d66bc80cd657 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ded1bea8-3b54-4278-ae32-cbd5c3c186ce tempest-VolumesTransfersTest-1961831863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-13acce36-983f-494a-a1f1-513fd29fcb18 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:09 devstack sudo[95547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.f5432f5e-8004-4205-a969-d66bc80cd657 Jul 10 06:43:09 devstack sudo[95547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:09 devstack sudo[95549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-13acce36-983f-494a-a1f1-513fd29fcb18 Jul 10 06:43:09 devstack sudo[95549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:09 devstack sudo[95547]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-82c444b2-89a3-452b-9f91-ebad54eaba27 tempest-SnapshotsActionsTest-358660859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.f5432f5e-8004-4205-a969-d66bc80cd657" returned: 0 in 0.684s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:09 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-82c444b2-89a3-452b-9f91-ebad54eaba27 tempest-SnapshotsActionsTest-358660859 None] Lock "cinder-quobyte-f5432f5e-8004-4205-a969-d66bc80cd657" released by "_delete_snapshot" :: held 4.477s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:43:09 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-82c444b2-89a3-452b-9f91-ebad54eaba27 tempest-SnapshotsActionsTest-358660859 None] Lock "cinder-quobyte-b95e459e-1083-48d2-b8b3-4e659a5880c7" released by "delete_snapshot" :: held 4.519s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:43:10 devstack sudo[95549]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ded1bea8-3b54-4278-ae32-cbd5c3c186ce tempest-VolumesTransfersTest-1961831863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-13acce36-983f-494a-a1f1-513fd29fcb18" returned: 0 in 0.769s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:10 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-ded1bea8-3b54-4278-ae32-cbd5c3c186ce tempest-VolumesTransfersTest-1961831863 None] <== create_volume: return (2025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:43:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ded1bea8-3b54-4278-ae32-cbd5c3c186ce tempest-VolumesTransfersTest-1961831863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.028s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:43:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b7b55d6e-b6d5-4025-a65d-0480094c9050 tempest-VolumesTransfersV357Test-1728079610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.896s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:43:10 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b7b55d6e-b6d5-4025-a65d-0480094c9050 tempest-VolumesTransfersV357Test-1728079610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:43:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-617023400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98b2fc5d-082f-43f1-91ff-66d86e5e744c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d551320164f436da7e17550bf948e66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:43:09Z,use_quota=True,user_id='b8c1ba1939ea4191b3be9092463b5a2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:43:10 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-b7b55d6e-b6d5-4025-a65d-0480094c9050 tempest-VolumesTransfersV357Test-1728079610 None] Creating volume 98b2fc5d-082f-43f1-91ff-66d86e5e744c {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:43:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b7b55d6e-b6d5-4025-a65d-0480094c9050 tempest-VolumesTransfersV357Test-1728079610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:43:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b7b55d6e-b6d5-4025-a65d-0480094c9050 tempest-VolumesTransfersV357Test-1728079610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:43:10 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b7b55d6e-b6d5-4025-a65d-0480094c9050 tempest-VolumesTransfersV357Test-1728079610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:43:10 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b7b55d6e-b6d5-4025-a65d-0480094c9050 tempest-VolumesTransfersV357Test-1728079610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:43:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b7b55d6e-b6d5-4025-a65d-0480094c9050 tempest-VolumesTransfersV357Test-1728079610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:43:10 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b7b55d6e-b6d5-4025-a65d-0480094c9050 tempest-VolumesTransfersV357Test-1728079610 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:43:10 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-b7b55d6e-b6d5-4025-a65d-0480094c9050 tempest-VolumesTransfersV357Test-1728079610 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:43:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b7b55d6e-b6d5-4025-a65d-0480094c9050 tempest-VolumesTransfersV357Test-1728079610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-98b2fc5d-082f-43f1-91ff-66d86e5e744c 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:10 devstack sudo[95554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-98b2fc5d-082f-43f1-91ff-66d86e5e744c 1073741824 Jul 10 06:43:10 devstack sudo[95554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:10 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ded1bea8-3b54-4278-ae32-cbd5c3c186ce tempest-VolumesTransfersTest-1961831863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9f76200-47a9-4651-89d3-0528de44cfb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13acce36-983f-494a-a1f1-513fd29fcb18', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:10 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ded1bea8-3b54-4278-ae32-cbd5c3c186ce tempest-VolumesTransfersTest-1961831863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2542d02e-a72e-40bc-9741-a9b35370aa9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:10 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-ded1bea8-3b54-4278-ae32-cbd5c3c186ce tempest-VolumesTransfersTest-1961831863 None] Volume volume-13acce36-983f-494a-a1f1-513fd29fcb18 (13acce36-983f-494a-a1f1-513fd29fcb18): created successfully Jul 10 06:43:10 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ded1bea8-3b54-4278-ae32-cbd5c3c186ce tempest-VolumesTransfersTest-1961831863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2542d02e-a72e-40bc-9741-a9b35370aa9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:10 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ded1bea8-3b54-4278-ae32-cbd5c3c186ce tempest-VolumesTransfersTest-1961831863 None] Flow 'volume_create_manager' (6b365b27-6103-4568-835b-06f3ecff4e94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:43:10 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-82c444b2-89a3-452b-9f91-ebad54eaba27 tempest-SnapshotsActionsTest-358660859 None] Created reservations ['226a24e7-fffe-49ce-9397-9f9752ab3279', '09ba0f64-6520-494b-8aa0-e3df36167a9f', '804fe330-ca86-4695-9456-3cc7e968948e', '09e4c603-6906-4cb8-9f32-24b83955eda4'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:43:10 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-ded1bea8-3b54-4278-ae32-cbd5c3c186ce tempest-VolumesTransfersTest-1961831863 None] Created volume successfully. Jul 10 06:43:10 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-82c444b2-89a3-452b-9f91-ebad54eaba27 tempest-SnapshotsActionsTest-358660859 None] Delete snapshot completed successfully. Jul 10 06:43:10 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-82c444b2-89a3-452b-9f91-ebad54eaba27 tempest-SnapshotsActionsTest-358660859 None] Lock "cinder-f5432f5e-8004-4205-a969-d66bc80cd657-delete_snapshot" released by "delete_snapshot" :: held 4.786s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:43:11 devstack sudo[95554]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b7b55d6e-b6d5-4025-a65d-0480094c9050 tempest-VolumesTransfersV357Test-1728079610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-98b2fc5d-082f-43f1-91ff-66d86e5e744c 1073741824" returned: 0 in 1.102s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b7b55d6e-b6d5-4025-a65d-0480094c9050 tempest-VolumesTransfersV357Test-1728079610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-98b2fc5d-082f-43f1-91ff-66d86e5e744c {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:11 devstack sudo[95560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-98b2fc5d-082f-43f1-91ff-66d86e5e744c Jul 10 06:43:11 devstack sudo[95560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c26aa3c3-8029-4c41-9f26-6a4cf9e4ed09 tempest-SnapshotsActionsTest-1766860581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:43:11 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a461a4de-ce86-4cbf-942b-48a8fd43b036 tempest-VolumesTransfersTest-1598252103 None] Acquiring lock "cinder-13acce36-983f-494a-a1f1-513fd29fcb18-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:43:11 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a461a4de-ce86-4cbf-942b-48a8fd43b036 tempest-VolumesTransfersTest-1598252103 None] Lock "cinder-13acce36-983f-494a-a1f1-513fd29fcb18-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:43:11 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a461a4de-ce86-4cbf-942b-48a8fd43b036 tempest-VolumesTransfersTest-1598252103 None] Acquiring lock "cinder-quobyte-13acce36-983f-494a-a1f1-513fd29fcb18" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:43:11 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a461a4de-ce86-4cbf-942b-48a8fd43b036 tempest-VolumesTransfersTest-1598252103 None] Lock "cinder-quobyte-13acce36-983f-494a-a1f1-513fd29fcb18" acquired by "delete_volume" :: waited 0.022s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:43:11 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b3436f-2e8c-4673-bd31-c4f9c2a4c99f]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:43:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a461a4de-ce86-4cbf-942b-48a8fd43b036 tempest-VolumesTransfersTest-1598252103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-13acce36-983f-494a-a1f1-513fd29fcb18 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:11 devstack sudo[95562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-13acce36-983f-494a-a1f1-513fd29fcb18 Jul 10 06:43:11 devstack sudo[95562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:11 devstack sudo[95560]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b7b55d6e-b6d5-4025-a65d-0480094c9050 tempest-VolumesTransfersV357Test-1728079610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-98b2fc5d-082f-43f1-91ff-66d86e5e744c" returned: 0 in 0.789s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:12 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b7b55d6e-b6d5-4025-a65d-0480094c9050 tempest-VolumesTransfersV357Test-1728079610 None] <== create_volume: return (1979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:43:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b7b55d6e-b6d5-4025-a65d-0480094c9050 tempest-VolumesTransfersV357Test-1728079610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.982s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:43:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c26aa3c3-8029-4c41-9f26-6a4cf9e4ed09 tempest-SnapshotsActionsTest-1766860581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.744s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:43:12 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-c26aa3c3-8029-4c41-9f26-6a4cf9e4ed09 tempest-SnapshotsActionsTest-1766860581 None] Creating offline snapshot 34a90f09-46bd-4ccd-928b-622d359f418a of volume b95e459e-1083-48d2-b8b3-4e659a5880c7 {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:43:12 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b7b55d6e-b6d5-4025-a65d-0480094c9050 tempest-VolumesTransfersV357Test-1728079610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aac8a009-c2e0-4d58-8311-7dcf2f1196c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98b2fc5d-082f-43f1-91ff-66d86e5e744c', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:12 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b7b55d6e-b6d5-4025-a65d-0480094c9050 tempest-VolumesTransfersV357Test-1728079610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e570c1be-bf94-427a-81d3-517626dee61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:12 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50c105a-2bae-40f4-8f07-769209afe936]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:43:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c26aa3c3-8029-4c41-9f26-6a4cf9e4ed09 tempest-SnapshotsActionsTest-1766860581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:12 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-b7b55d6e-b6d5-4025-a65d-0480094c9050 tempest-VolumesTransfersV357Test-1728079610 None] Volume volume-98b2fc5d-082f-43f1-91ff-66d86e5e744c (98b2fc5d-082f-43f1-91ff-66d86e5e744c): created successfully Jul 10 06:43:12 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b7b55d6e-b6d5-4025-a65d-0480094c9050 tempest-VolumesTransfersV357Test-1728079610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e570c1be-bf94-427a-81d3-517626dee61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:12 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b7b55d6e-b6d5-4025-a65d-0480094c9050 tempest-VolumesTransfersV357Test-1728079610 None] Flow 'volume_create_manager' (15756225-30cd-42cc-8af3-665ac86869e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:43:12 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-b7b55d6e-b6d5-4025-a65d-0480094c9050 tempest-VolumesTransfersV357Test-1728079610 None] Created volume successfully. Jul 10 06:43:12 devstack sudo[95565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08 Jul 10 06:43:12 devstack sudo[95565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:12 devstack sudo[95562]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a461a4de-ce86-4cbf-942b-48a8fd43b036 tempest-VolumesTransfersTest-1598252103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-13acce36-983f-494a-a1f1-513fd29fcb18" returned: 0 in 0.874s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a461a4de-ce86-4cbf-942b-48a8fd43b036 tempest-VolumesTransfersTest-1598252103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-13acce36-983f-494a-a1f1-513fd29fcb18 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:12 devstack sudo[95570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-13acce36-983f-494a-a1f1-513fd29fcb18 Jul 10 06:43:12 devstack sudo[95570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:12 devstack sudo[95565]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c26aa3c3-8029-4c41-9f26-6a4cf9e4ed09 tempest-SnapshotsActionsTest-1766860581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08" returned: 0 in 0.882s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:12 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-c26aa3c3-8029-4c41-9f26-6a4cf9e4ed09 tempest-SnapshotsActionsTest-1766860581 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b95e459e-1083-48d2-b8b3-4e659a5880c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:43:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c26aa3c3-8029-4c41-9f26-6a4cf9e4ed09 tempest-SnapshotsActionsTest-1766860581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.34a90f09-46bd-4ccd-928b-622d359f418a 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:13 devstack sudo[95581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.34a90f09-46bd-4ccd-928b-622d359f418a 1G Jul 10 06:43:13 devstack sudo[95581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:13 devstack sudo[95570]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a461a4de-ce86-4cbf-942b-48a8fd43b036 tempest-VolumesTransfersTest-1598252103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-13acce36-983f-494a-a1f1-513fd29fcb18" returned: 0 in 0.898s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:13 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a461a4de-ce86-4cbf-942b-48a8fd43b036 tempest-VolumesTransfersTest-1598252103 None] Lock "cinder-quobyte-13acce36-983f-494a-a1f1-513fd29fcb18" released by "delete_volume" :: held 1.824s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:43:13 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-a461a4de-ce86-4cbf-942b-48a8fd43b036 tempest-VolumesTransfersTest-1598252103 None] Created reservations ['633c05da-b106-49ea-9bdc-1fb8aee93a0f', '37cbb194-2eb0-419e-9b7f-2387c1900b4a', 'c2c2c21c-836b-4b41-97a1-10ea8bebfc1e', '6c0bf5a9-129b-4126-a500-5f7089aca267'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:43:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a461a4de-ce86-4cbf-942b-48a8fd43b036 tempest-VolumesTransfersTest-1598252103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:43:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a461a4de-ce86-4cbf-942b-48a8fd43b036 tempest-VolumesTransfersTest-1598252103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:43:13 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-a461a4de-ce86-4cbf-942b-48a8fd43b036 tempest-VolumesTransfersTest-1598252103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:43:13 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-a461a4de-ce86-4cbf-942b-48a8fd43b036 tempest-VolumesTransfersTest-1598252103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:43:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a461a4de-ce86-4cbf-942b-48a8fd43b036 tempest-VolumesTransfersTest-1598252103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:43:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a461a4de-ce86-4cbf-942b-48a8fd43b036 tempest-VolumesTransfersTest-1598252103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:13 devstack sudo[95584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:43:13 devstack sudo[95584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:14 devstack sudo[95581]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c26aa3c3-8029-4c41-9f26-6a4cf9e4ed09 tempest-SnapshotsActionsTest-1766860581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.34a90f09-46bd-4ccd-928b-622d359f418a 1G" returned: 0 in 1.126s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c26aa3c3-8029-4c41-9f26-6a4cf9e4ed09 tempest-SnapshotsActionsTest-1766860581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.34a90f09-46bd-4ccd-928b-622d359f418a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:14 devstack sudo[95590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.34a90f09-46bd-4ccd-928b-622d359f418a Jul 10 06:43:14 devstack sudo[95590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:14 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-9a295120-c2fe-47c0-a108-d052b6b3f9cb tempest-VolumesTransfersV357Test-879579288 None] Transfer volume completed successfully. Jul 10 06:43:14 devstack sudo[95584]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a461a4de-ce86-4cbf-942b-48a8fd43b036 tempest-VolumesTransfersTest-1598252103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.894s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:14 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-a461a4de-ce86-4cbf-942b-48a8fd43b036 tempest-VolumesTransfersTest-1598252103 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:43:14 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-a461a4de-ce86-4cbf-942b-48a8fd43b036 tempest-VolumesTransfersTest-1598252103 None] Deleted volume successfully. Jul 10 06:43:14 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a461a4de-ce86-4cbf-942b-48a8fd43b036 tempest-VolumesTransfersTest-1598252103 None] Lock "cinder-13acce36-983f-494a-a1f1-513fd29fcb18-delete_volume" released by "delete_volume" :: held 3.018s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:43:14 devstack sudo[95590]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c26aa3c3-8029-4c41-9f26-6a4cf9e4ed09 tempest-SnapshotsActionsTest-1766860581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.34a90f09-46bd-4ccd-928b-622d359f418a" returned: 0 in 0.802s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:14 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-c26aa3c3-8029-4c41-9f26-6a4cf9e4ed09 tempest-SnapshotsActionsTest-1766860581 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.34a90f09-46bd-4ccd-928b-622d359f418a is being set with open permissions: ugo+rw Jul 10 06:43:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c26aa3c3-8029-4c41-9f26-6a4cf9e4ed09 tempest-SnapshotsActionsTest-1766860581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.34a90f09-46bd-4ccd-928b-622d359f418a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:14 devstack sudo[95598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.34a90f09-46bd-4ccd-928b-622d359f418a Jul 10 06:43:14 devstack sudo[95598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:15 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-27d94ebb-c9ac-479e-a1c5-f526d35c6209 tempest-VolumesTransfersV357Test-813215126 None] Acquiring lock "cinder-98b2fc5d-082f-43f1-91ff-66d86e5e744c-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:43:15 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-27d94ebb-c9ac-479e-a1c5-f526d35c6209 tempest-VolumesTransfersV357Test-813215126 None] Lock "cinder-98b2fc5d-082f-43f1-91ff-66d86e5e744c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:43:15 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-27d94ebb-c9ac-479e-a1c5-f526d35c6209 tempest-VolumesTransfersV357Test-813215126 None] Acquiring lock "cinder-quobyte-98b2fc5d-082f-43f1-91ff-66d86e5e744c" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:43:15 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-27d94ebb-c9ac-479e-a1c5-f526d35c6209 tempest-VolumesTransfersV357Test-813215126 None] Lock "cinder-quobyte-98b2fc5d-082f-43f1-91ff-66d86e5e744c" acquired by "delete_volume" :: waited 0.023s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:43:15 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[f370c5a5-3461-4da8-a7af-f1a563d09fc0]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:43:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-27d94ebb-c9ac-479e-a1c5-f526d35c6209 tempest-VolumesTransfersV357Test-813215126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-98b2fc5d-082f-43f1-91ff-66d86e5e744c {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:15 devstack sudo[95598]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c26aa3c3-8029-4c41-9f26-6a4cf9e4ed09 tempest-SnapshotsActionsTest-1766860581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.34a90f09-46bd-4ccd-928b-622d359f418a" returned: 0 in 0.810s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c26aa3c3-8029-4c41-9f26-6a4cf9e4ed09 tempest-SnapshotsActionsTest-1766860581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.761s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:43:15 devstack sudo[95661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-98b2fc5d-082f-43f1-91ff-66d86e5e744c Jul 10 06:43:15 devstack sudo[95661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:15 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-c26aa3c3-8029-4c41-9f26-6a4cf9e4ed09 tempest-SnapshotsActionsTest-1766860581 None] Create snapshot completed successfully Jul 10 06:43:16 devstack sudo[95661]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-27d94ebb-c9ac-479e-a1c5-f526d35c6209 tempest-VolumesTransfersV357Test-813215126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-98b2fc5d-082f-43f1-91ff-66d86e5e744c" returned: 0 in 0.931s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-27d94ebb-c9ac-479e-a1c5-f526d35c6209 tempest-VolumesTransfersV357Test-813215126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-98b2fc5d-082f-43f1-91ff-66d86e5e744c {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:16 devstack sudo[95666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-98b2fc5d-082f-43f1-91ff-66d86e5e744c Jul 10 06:43:16 devstack sudo[95666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:16 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-8861caae-34e2-4827-aeda-254ae9fba902 tempest-SnapshotsActionsTest-358660859 None] Acquiring lock "cinder-34a90f09-46bd-4ccd-928b-622d359f418a-delete_snapshot" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:43:16 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-8861caae-34e2-4827-aeda-254ae9fba902 tempest-SnapshotsActionsTest-358660859 None] Lock "cinder-34a90f09-46bd-4ccd-928b-622d359f418a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:43:16 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-8861caae-34e2-4827-aeda-254ae9fba902 tempest-SnapshotsActionsTest-358660859 None] Acquiring lock "cinder-quobyte-b95e459e-1083-48d2-b8b3-4e659a5880c7" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:43:16 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-8861caae-34e2-4827-aeda-254ae9fba902 tempest-SnapshotsActionsTest-358660859 None] Lock "cinder-quobyte-b95e459e-1083-48d2-b8b3-4e659a5880c7" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:43:16 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-8861caae-34e2-4827-aeda-254ae9fba902 tempest-SnapshotsActionsTest-358660859 None] Acquiring lock "cinder-quobyte-34a90f09-46bd-4ccd-928b-622d359f418a" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:43:16 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-8861caae-34e2-4827-aeda-254ae9fba902 tempest-SnapshotsActionsTest-358660859 None] Lock "cinder-quobyte-34a90f09-46bd-4ccd-928b-622d359f418a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:43:16 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-8861caae-34e2-4827-aeda-254ae9fba902 tempest-SnapshotsActionsTest-358660859 None] Deleting offline snapshot 34a90f09-46bd-4ccd-928b-622d359f418a of volume b95e459e-1083-48d2-b8b3-4e659a5880c7 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:43:16 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-8861caae-34e2-4827-aeda-254ae9fba902 tempest-SnapshotsActionsTest-358660859 None] snapshot_file for this snap is: volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.34a90f09-46bd-4ccd-928b-622d359f418a {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:43:16 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1bd19e-a112-45fc-a6fd-cdf1a3de47db]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:43:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8861caae-34e2-4827-aeda-254ae9fba902 tempest-SnapshotsActionsTest-358660859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.34a90f09-46bd-4ccd-928b-622d359f418a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:16 devstack sudo[95668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.34a90f09-46bd-4ccd-928b-622d359f418a Jul 10 06:43:16 devstack sudo[95668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:17 devstack sudo[95666]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-27d94ebb-c9ac-479e-a1c5-f526d35c6209 tempest-VolumesTransfersV357Test-813215126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-98b2fc5d-082f-43f1-91ff-66d86e5e744c" returned: 0 in 0.754s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:17 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-27d94ebb-c9ac-479e-a1c5-f526d35c6209 tempest-VolumesTransfersV357Test-813215126 None] Lock "cinder-quobyte-98b2fc5d-082f-43f1-91ff-66d86e5e744c" released by "delete_volume" :: held 1.754s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:43:17 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-27d94ebb-c9ac-479e-a1c5-f526d35c6209 tempest-VolumesTransfersV357Test-813215126 None] Created reservations ['79edda9f-bc70-4ae1-aaf6-f82252a8ea7f', '38219598-7e1b-4819-a33a-376ebe9533de', '92190a5a-ca7f-45db-9808-dc4145028407', 'a90ec90e-ac35-4265-9e0f-36f18fd86b54'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:43:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-27d94ebb-c9ac-479e-a1c5-f526d35c6209 tempest-VolumesTransfersV357Test-813215126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:43:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-27d94ebb-c9ac-479e-a1c5-f526d35c6209 tempest-VolumesTransfersV357Test-813215126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:43:17 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-27d94ebb-c9ac-479e-a1c5-f526d35c6209 tempest-VolumesTransfersV357Test-813215126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:43:17 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-27d94ebb-c9ac-479e-a1c5-f526d35c6209 tempest-VolumesTransfersV357Test-813215126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:43:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-27d94ebb-c9ac-479e-a1c5-f526d35c6209 tempest-VolumesTransfersV357Test-813215126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:43:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-27d94ebb-c9ac-479e-a1c5-f526d35c6209 tempest-VolumesTransfersV357Test-813215126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:17 devstack sudo[95674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:43:17 devstack sudo[95674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:17 devstack sudo[95668]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8861caae-34e2-4827-aeda-254ae9fba902 tempest-SnapshotsActionsTest-358660859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.34a90f09-46bd-4ccd-928b-622d359f418a" returned: 0 in 0.877s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:17 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-8861caae-34e2-4827-aeda-254ae9fba902 tempest-SnapshotsActionsTest-358660859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b95e459e-1083-48d2-b8b3-4e659a5880c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:43:17 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb09dda-20cd-463c-a8ac-d5da75c71adc]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:43:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8861caae-34e2-4827-aeda-254ae9fba902 tempest-SnapshotsActionsTest-358660859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:17 devstack sudo[95676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08 Jul 10 06:43:17 devstack sudo[95676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:18 devstack sudo[95674]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-27d94ebb-c9ac-479e-a1c5-f526d35c6209 tempest-VolumesTransfersV357Test-813215126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.887s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:18 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-27d94ebb-c9ac-479e-a1c5-f526d35c6209 tempest-VolumesTransfersV357Test-813215126 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:43:18 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-27d94ebb-c9ac-479e-a1c5-f526d35c6209 tempest-VolumesTransfersV357Test-813215126 None] Deleted volume successfully. Jul 10 06:43:18 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-27d94ebb-c9ac-479e-a1c5-f526d35c6209 tempest-VolumesTransfersV357Test-813215126 None] Lock "cinder-98b2fc5d-082f-43f1-91ff-66d86e5e744c-delete_volume" released by "delete_volume" :: held 2.915s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:43:18 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1f93b80-f63c-4f66-afd5-77742a1bd247 tempest-VolumesTransfersV357Test-1728079610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:43:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e1f93b80-f63c-4f66-afd5-77742a1bd247 tempest-VolumesTransfersV357Test-1728079610 None] Flow 'volume_create_manager' (7af791a0-2dc5-4b09-a361-096b37fc9ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:43:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e1f93b80-f63c-4f66-afd5-77742a1bd247 tempest-VolumesTransfersV357Test-1728079610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26006eb6-b456-44f9-9dc7-f792c75f70c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e1f93b80-f63c-4f66-afd5-77742a1bd247 tempest-VolumesTransfersV357Test-1728079610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26006eb6-b456-44f9-9dc7-f792c75f70c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:43:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1744206055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17ce80dd-8d2e-4689-96c4-ca9c8b361265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d551320164f436da7e17550bf948e66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:43:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:43:18Z,use_quota=True,user_id='b8c1ba1939ea4191b3be9092463b5a2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e1f93b80-f63c-4f66-afd5-77742a1bd247 tempest-VolumesTransfersV357Test-1728079610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (211c1460-3058-446f-bc3c-909c31d3f0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e1f93b80-f63c-4f66-afd5-77742a1bd247 tempest-VolumesTransfersV357Test-1728079610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (211c1460-3058-446f-bc3c-909c31d3f0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e1f93b80-f63c-4f66-afd5-77742a1bd247 tempest-VolumesTransfersV357Test-1728079610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5111806-e066-4e38-80b4-4b7101dafd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e1f93b80-f63c-4f66-afd5-77742a1bd247 tempest-VolumesTransfersV357Test-1728079610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5111806-e066-4e38-80b4-4b7101dafd0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17ce80dd-8d2e-4689-96c4-ca9c8b361265', 'volume_name': 'volume-17ce80dd-8d2e-4689-96c4-ca9c8b361265', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e1f93b80-f63c-4f66-afd5-77742a1bd247 tempest-VolumesTransfersV357Test-1728079610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7be08784-ae27-42db-bdd3-d00956ba3cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e1f93b80-f63c-4f66-afd5-77742a1bd247 tempest-VolumesTransfersV357Test-1728079610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7be08784-ae27-42db-bdd3-d00956ba3cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e1f93b80-f63c-4f66-afd5-77742a1bd247 tempest-VolumesTransfersV357Test-1728079610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (192d5092-0d6e-49a3-8e26-adbcc964b2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:18 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-e1f93b80-f63c-4f66-afd5-77742a1bd247 tempest-VolumesTransfersV357Test-1728079610 None] Volume 17ce80dd-8d2e-4689-96c4-ca9c8b361265: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17ce80dd-8d2e-4689-96c4-ca9c8b361265', 'volume_size': 1} Jul 10 06:43:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e1f93b80-f63c-4f66-afd5-77742a1bd247 tempest-VolumesTransfersV357Test-1728079610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:43:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e1f93b80-f63c-4f66-afd5-77742a1bd247 tempest-VolumesTransfersV357Test-1728079610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:43:18 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-e1f93b80-f63c-4f66-afd5-77742a1bd247 tempest-VolumesTransfersV357Test-1728079610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:43:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1744206055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17ce80dd-8d2e-4689-96c4-ca9c8b361265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d551320164f436da7e17550bf948e66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:43:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:43:18Z,use_quota=True,user_id='b8c1ba1939ea4191b3be9092463b5a2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:43:18 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-e1f93b80-f63c-4f66-afd5-77742a1bd247 tempest-VolumesTransfersV357Test-1728079610 None] Creating volume 17ce80dd-8d2e-4689-96c4-ca9c8b361265 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:43:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e1f93b80-f63c-4f66-afd5-77742a1bd247 tempest-VolumesTransfersV357Test-1728079610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:43:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e1f93b80-f63c-4f66-afd5-77742a1bd247 tempest-VolumesTransfersV357Test-1728079610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:43:18 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-e1f93b80-f63c-4f66-afd5-77742a1bd247 tempest-VolumesTransfersV357Test-1728079610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:43:18 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-e1f93b80-f63c-4f66-afd5-77742a1bd247 tempest-VolumesTransfersV357Test-1728079610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:43:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e1f93b80-f63c-4f66-afd5-77742a1bd247 tempest-VolumesTransfersV357Test-1728079610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:43:18 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-e1f93b80-f63c-4f66-afd5-77742a1bd247 tempest-VolumesTransfersV357Test-1728079610 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:43:18 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-e1f93b80-f63c-4f66-afd5-77742a1bd247 tempest-VolumesTransfersV357Test-1728079610 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:43:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e1f93b80-f63c-4f66-afd5-77742a1bd247 tempest-VolumesTransfersV357Test-1728079610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-17ce80dd-8d2e-4689-96c4-ca9c8b361265 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:18 devstack sudo[95683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-17ce80dd-8d2e-4689-96c4-ca9c8b361265 1073741824 Jul 10 06:43:18 devstack sudo[95683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:18 devstack sudo[95676]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8861caae-34e2-4827-aeda-254ae9fba902 tempest-SnapshotsActionsTest-358660859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08" returned: 0 in 1.018s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:18 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-8861caae-34e2-4827-aeda-254ae9fba902 tempest-SnapshotsActionsTest-358660859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b95e459e-1083-48d2-b8b3-4e659a5880c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:43:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8861caae-34e2-4827-aeda-254ae9fba902 tempest-SnapshotsActionsTest-358660859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.34a90f09-46bd-4ccd-928b-622d359f418a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:18 devstack sudo[95686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.34a90f09-46bd-4ccd-928b-622d359f418a Jul 10 06:43:18 devstack sudo[95686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:19 devstack sudo[95686]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8861caae-34e2-4827-aeda-254ae9fba902 tempest-SnapshotsActionsTest-358660859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.34a90f09-46bd-4ccd-928b-622d359f418a" returned: 0 in 1.072s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8861caae-34e2-4827-aeda-254ae9fba902 tempest-SnapshotsActionsTest-358660859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.34a90f09-46bd-4ccd-928b-622d359f418a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:19 devstack sudo[95700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.34a90f09-46bd-4ccd-928b-622d359f418a Jul 10 06:43:19 devstack sudo[95700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:20 devstack sudo[95683]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e1f93b80-f63c-4f66-afd5-77742a1bd247 tempest-VolumesTransfersV357Test-1728079610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-17ce80dd-8d2e-4689-96c4-ca9c8b361265 1073741824" returned: 0 in 1.390s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e1f93b80-f63c-4f66-afd5-77742a1bd247 tempest-VolumesTransfersV357Test-1728079610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-17ce80dd-8d2e-4689-96c4-ca9c8b361265 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:20 devstack sudo[95708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-17ce80dd-8d2e-4689-96c4-ca9c8b361265 Jul 10 06:43:20 devstack sudo[95708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:20 devstack sudo[95700]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8861caae-34e2-4827-aeda-254ae9fba902 tempest-SnapshotsActionsTest-358660859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.34a90f09-46bd-4ccd-928b-622d359f418a" returned: 0 in 0.922s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:20 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-8861caae-34e2-4827-aeda-254ae9fba902 tempest-SnapshotsActionsTest-358660859 None] Lock "cinder-quobyte-34a90f09-46bd-4ccd-928b-622d359f418a" released by "_delete_snapshot" :: held 4.030s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:43:20 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-8861caae-34e2-4827-aeda-254ae9fba902 tempest-SnapshotsActionsTest-358660859 None] Lock "cinder-quobyte-b95e459e-1083-48d2-b8b3-4e659a5880c7" released by "delete_snapshot" :: held 4.065s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:43:20 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-8861caae-34e2-4827-aeda-254ae9fba902 tempest-SnapshotsActionsTest-358660859 None] Created reservations ['dd523667-bdc3-4f26-9135-514cb3a12b35', '5607dfcb-5197-4585-a0db-7d40aee96596', '6cf3dedf-2170-45ad-800f-80b36eb0d2c7', '561545a2-6d6b-4f7f-989d-12f85eb97636'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:43:20 devstack sudo[95708]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e1f93b80-f63c-4f66-afd5-77742a1bd247 tempest-VolumesTransfersV357Test-1728079610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-17ce80dd-8d2e-4689-96c4-ca9c8b361265" returned: 0 in 0.803s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:20 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-e1f93b80-f63c-4f66-afd5-77742a1bd247 tempest-VolumesTransfersV357Test-1728079610 None] <== create_volume: return (2289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:43:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e1f93b80-f63c-4f66-afd5-77742a1bd247 tempest-VolumesTransfersV357Test-1728079610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.292s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:43:20 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-8861caae-34e2-4827-aeda-254ae9fba902 tempest-SnapshotsActionsTest-358660859 None] Delete snapshot completed successfully. Jul 10 06:43:20 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-8861caae-34e2-4827-aeda-254ae9fba902 tempest-SnapshotsActionsTest-358660859 None] Lock "cinder-34a90f09-46bd-4ccd-928b-622d359f418a-delete_snapshot" released by "delete_snapshot" :: held 4.270s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:43:20 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e1f93b80-f63c-4f66-afd5-77742a1bd247 tempest-VolumesTransfersV357Test-1728079610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (192d5092-0d6e-49a3-8e26-adbcc964b2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17ce80dd-8d2e-4689-96c4-ca9c8b361265', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:20 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e1f93b80-f63c-4f66-afd5-77742a1bd247 tempest-VolumesTransfersV357Test-1728079610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c37e502f-e927-482d-852c-156665acbf6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:20 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-e1f93b80-f63c-4f66-afd5-77742a1bd247 tempest-VolumesTransfersV357Test-1728079610 None] Volume volume-17ce80dd-8d2e-4689-96c4-ca9c8b361265 (17ce80dd-8d2e-4689-96c4-ca9c8b361265): created successfully Jul 10 06:43:20 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e1f93b80-f63c-4f66-afd5-77742a1bd247 tempest-VolumesTransfersV357Test-1728079610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c37e502f-e927-482d-852c-156665acbf6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:20 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e1f93b80-f63c-4f66-afd5-77742a1bd247 tempest-VolumesTransfersV357Test-1728079610 None] Flow 'volume_create_manager' (7af791a0-2dc5-4b09-a361-096b37fc9ce3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:43:21 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-e1f93b80-f63c-4f66-afd5-77742a1bd247 tempest-VolumesTransfersV357Test-1728079610 None] Created volume successfully. Jul 10 06:43:21 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:43:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Flow 'volume_create_manager' (aac76f95-6464-44dd-ac48-a720794dc2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:43:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd9cf320-d4ce-4913-8a1d-0d1ad0089dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd9cf320-d4ce-4913-8a1d-0d1ad0089dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1261093420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b40721b6-84e4-48c6-8bbc-51a3009adaf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527a9a56bd0049be8dc2fb79806cb171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:43:21Z,use_quota=True,user_id='db6f39caeef845c6a8ad01923d44e2ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da49695c-fb01-405e-96da-beb90c0d9cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da49695c-fb01-405e-96da-beb90c0d9cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece949d3-b81d-45f6-ada4-ce58ee0bdb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:21 devstack cinder-volume[87294]: DEBUG cinder.image.glance [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Creating Keystone auth plugin from conf {{(pid=87294) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 06:43:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-476f0ccb-a5d8-4bf6-8859-54069ce6fd44 tempest-SnapshotsActionsTest-1766860581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:43:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-476f0ccb-a5d8-4bf6-8859-54069ce6fd44 tempest-SnapshotsActionsTest-1766860581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:43:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-476f0ccb-a5d8-4bf6-8859-54069ce6fd44 tempest-SnapshotsActionsTest-1766860581 None] Creating offline snapshot c5db2ae5-5c0a-41b1-91a2-ee0261a733ff of volume b95e459e-1083-48d2-b8b3-4e659a5880c7 {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:43:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece949d3-b81d-45f6-ada4-ce58ee0bdb2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b40721b6-84e4-48c6-8bbc-51a3009adaf1', 'volume_name': 'volume-b40721b6-84e4-48c6-8bbc-51a3009adaf1', 'volume_size': 1, 'image_id': 'fce564e0-408f-448f-b73c-5fae94549898', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fce564e0-408f-448f-b73c-5fae94549898', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '62db6635aac548658dfcc55ac904ccde', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fce564e0-408f-448f-b73c-5fae94549898', 'created_at': datetime.datetime(2026, 7, 10, 4, 29, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 29, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fce564e0-408f-448f-b73c-5fae94549898/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d11d574-9867-4bd5-a7eb-33fbd8cd6975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d11d574-9867-4bd5-a7eb-33fbd8cd6975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (490d797e-b56d-42de-8509-ce6194a9ec99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:21 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Volume b40721b6-84e4-48c6-8bbc-51a3009adaf1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b40721b6-84e4-48c6-8bbc-51a3009adaf1', 'volume_size': 1, 'image_id': 'fce564e0-408f-448f-b73c-5fae94549898', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fce564e0-408f-448f-b73c-5fae94549898', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '62db6635aac548658dfcc55ac904ccde', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fce564e0-408f-448f-b73c-5fae94549898', 'created_at': datetime.datetime(2026, 7, 10, 4, 29, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 29, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fce564e0-408f-448f-b73c-5fae94549898/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 06:43:21 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Trying to clone b40721b6-84e4-48c6-8bbc-51a3009adaf1 from image fce564e0-408f-448f-b73c-5fae94549898 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fce564e0-408f-448f-b73c-5fae94549898', 'metadata': {}}]). {{(pid=87294) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 06:43:21 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[145e277b-57cf-4413-b842-e27c19f7942b]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:43:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-476f0ccb-a5d8-4bf6-8859-54069ce6fd44 tempest-SnapshotsActionsTest-1766860581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:21 devstack sudo[95713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08 Jul 10 06:43:21 devstack sudo[95713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:21 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_0ovjwagydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87294) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 06:43:21 devstack cinder-volume[87294]: INFO cinder.image.image_utils [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Image download 20.69 MB at 20.69 MB/s Jul 10 06:43:21 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[b757b013-baf8-4c40-b28e-b0a29cb651ee]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:43:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_0ovjwagydevstack@QuobyteHD {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:21 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:43:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:43:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:43:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:43:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:43:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:43:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:21 devstack sudo[95716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_0ovjwagydevstack@QuobyteHD Jul 10 06:43:21 devstack sudo[95716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:21 devstack sudo[95718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:43:21 devstack sudo[95718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:22 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-07413da0-31b2-45fe-9123-982b28d0c33e tempest-VolumesTransfersV357Test-813215126 None] Acquiring lock "cinder-17ce80dd-8d2e-4689-96c4-ca9c8b361265-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:43:22 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-07413da0-31b2-45fe-9123-982b28d0c33e tempest-VolumesTransfersV357Test-813215126 None] Lock "cinder-17ce80dd-8d2e-4689-96c4-ca9c8b361265-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:43:22 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-07413da0-31b2-45fe-9123-982b28d0c33e tempest-VolumesTransfersV357Test-813215126 None] Acquiring lock "cinder-quobyte-17ce80dd-8d2e-4689-96c4-ca9c8b361265" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:43:22 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-07413da0-31b2-45fe-9123-982b28d0c33e tempest-VolumesTransfersV357Test-813215126 None] Lock "cinder-quobyte-17ce80dd-8d2e-4689-96c4-ca9c8b361265" acquired by "delete_volume" :: waited 0.025s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:43:22 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff78b9e-436f-4cbe-a5e0-3474ada33557]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:43:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-07413da0-31b2-45fe-9123-982b28d0c33e tempest-VolumesTransfersV357Test-813215126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-17ce80dd-8d2e-4689-96c4-ca9c8b361265 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:22 devstack sudo[95713]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-476f0ccb-a5d8-4bf6-8859-54069ce6fd44 tempest-SnapshotsActionsTest-1766860581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08" returned: 0 in 0.950s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:22 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-476f0ccb-a5d8-4bf6-8859-54069ce6fd44 tempest-SnapshotsActionsTest-1766860581 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b95e459e-1083-48d2-b8b3-4e659a5880c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:43:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-476f0ccb-a5d8-4bf6-8859-54069ce6fd44 tempest-SnapshotsActionsTest-1766860581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.c5db2ae5-5c0a-41b1-91a2-ee0261a733ff 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:22 devstack sudo[95723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-17ce80dd-8d2e-4689-96c4-ca9c8b361265 Jul 10 06:43:22 devstack sudo[95723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:22 devstack sudo[95725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.c5db2ae5-5c0a-41b1-91a2-ee0261a733ff 1G Jul 10 06:43:22 devstack sudo[95725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:22 devstack sudo[95718]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.775s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:22 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:43:22 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager._thread_info {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:43:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread count: 28 {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:43:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread info: [<_MainThread(MainThread, started 139245706264704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:43:22 devstack sudo[95716]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_0ovjwagydevstack@QuobyteHD" returned: 0 in 0.905s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:22 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Temporary image fce564e0-408f-448f-b73c-5fae94549898 is fetched for user db6f39caeef845c6a8ad01923d44e2ba. {{(pid=87294) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 06:43:22 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7292bf1-7a73-4eca-a271-a72c857b4660]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:43:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_0ovjwagydevstack@QuobyteHD {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:22 devstack sudo[95731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_0ovjwagydevstack@QuobyteHD Jul 10 06:43:22 devstack sudo[95731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:23 devstack sudo[95723]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-07413da0-31b2-45fe-9123-982b28d0c33e tempest-VolumesTransfersV357Test-813215126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-17ce80dd-8d2e-4689-96c4-ca9c8b361265" returned: 0 in 0.935s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-07413da0-31b2-45fe-9123-982b28d0c33e tempest-VolumesTransfersV357Test-813215126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-17ce80dd-8d2e-4689-96c4-ca9c8b361265 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:23 devstack sudo[95742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-17ce80dd-8d2e-4689-96c4-ca9c8b361265 Jul 10 06:43:23 devstack sudo[95742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:23 devstack sudo[95725]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-476f0ccb-a5d8-4bf6-8859-54069ce6fd44 tempest-SnapshotsActionsTest-1766860581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.c5db2ae5-5c0a-41b1-91a2-ee0261a733ff 1G" returned: 0 in 1.000s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-476f0ccb-a5d8-4bf6-8859-54069ce6fd44 tempest-SnapshotsActionsTest-1766860581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.c5db2ae5-5c0a-41b1-91a2-ee0261a733ff {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:23 devstack sudo[95744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.c5db2ae5-5c0a-41b1-91a2-ee0261a733ff Jul 10 06:43:23 devstack sudo[95744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:23 devstack sudo[95731]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_0ovjwagydevstack@QuobyteHD" returned: 0 in 0.788s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:43:23 devstack sudo[95742]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-07413da0-31b2-45fe-9123-982b28d0c33e tempest-VolumesTransfersV357Test-813215126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-17ce80dd-8d2e-4689-96c4-ca9c8b361265" returned: 0 in 0.787s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:23 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-07413da0-31b2-45fe-9123-982b28d0c33e tempest-VolumesTransfersV357Test-813215126 None] Lock "cinder-quobyte-17ce80dd-8d2e-4689-96c4-ca9c8b361265" released by "delete_volume" :: held 1.775s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:43:23 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-07413da0-31b2-45fe-9123-982b28d0c33e tempest-VolumesTransfersV357Test-813215126 None] Created reservations ['e67cccc7-14cc-421c-9f88-8dc96a954c86', 'ff638ec9-601b-471c-ba9e-caecfe95056c', '1c5d0e6f-5a65-4f71-87ab-bb54537e932b', '9bbfe18e-12b1-40a9-8ba1-ef6e9352e5dd'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:43:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-07413da0-31b2-45fe-9123-982b28d0c33e tempest-VolumesTransfersV357Test-813215126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:43:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-07413da0-31b2-45fe-9123-982b28d0c33e tempest-VolumesTransfersV357Test-813215126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:43:24 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-07413da0-31b2-45fe-9123-982b28d0c33e tempest-VolumesTransfersV357Test-813215126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:43:24 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-07413da0-31b2-45fe-9123-982b28d0c33e tempest-VolumesTransfersV357Test-813215126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:43:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-07413da0-31b2-45fe-9123-982b28d0c33e tempest-VolumesTransfersV357Test-813215126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:43:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-07413da0-31b2-45fe-9123-982b28d0c33e tempest-VolumesTransfersV357Test-813215126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:24 devstack sudo[95756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:43:24 devstack sudo[95756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:24 devstack sudo[95744]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-476f0ccb-a5d8-4bf6-8859-54069ce6fd44 tempest-SnapshotsActionsTest-1766860581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.c5db2ae5-5c0a-41b1-91a2-ee0261a733ff" returned: 0 in 0.840s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:24 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-476f0ccb-a5d8-4bf6-8859-54069ce6fd44 tempest-SnapshotsActionsTest-1766860581 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.c5db2ae5-5c0a-41b1-91a2-ee0261a733ff is being set with open permissions: ugo+rw Jul 10 06:43:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-476f0ccb-a5d8-4bf6-8859-54069ce6fd44 tempest-SnapshotsActionsTest-1766860581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.c5db2ae5-5c0a-41b1-91a2-ee0261a733ff {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:24 devstack sudo[95758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.c5db2ae5-5c0a-41b1-91a2-ee0261a733ff Jul 10 06:43:24 devstack sudo[95758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:24 devstack sudo[95756]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-07413da0-31b2-45fe-9123-982b28d0c33e tempest-VolumesTransfersV357Test-813215126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.722s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:24 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-07413da0-31b2-45fe-9123-982b28d0c33e tempest-VolumesTransfersV357Test-813215126 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:43:24 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-07413da0-31b2-45fe-9123-982b28d0c33e tempest-VolumesTransfersV357Test-813215126 None] Deleted volume successfully. Jul 10 06:43:24 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-07413da0-31b2-45fe-9123-982b28d0c33e tempest-VolumesTransfersV357Test-813215126 None] Lock "cinder-17ce80dd-8d2e-4689-96c4-ca9c8b361265-delete_volume" released by "delete_volume" :: held 2.750s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:43:24 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-daf89983-1d08-4e51-b922-bd00a967af4f req-e0f9eed5-42bd-4cc8-b499-a069f08b7df6 tempest-AttachVolumeTestJSON-1155117856 None] Terminate volume connection completed successfully. Jul 10 06:43:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-daf89983-1d08-4e51-b922-bd00a967af4f req-e0f9eed5-42bd-4cc8-b499-a069f08b7df6 tempest-AttachVolumeTestJSON-1155117856 None] Deleting attachment 2ed31324-0469-40e4-a078-1cbcc77be555. {{(pid=87294) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:43:25 devstack sudo[95758]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-476f0ccb-a5d8-4bf6-8859-54069ce6fd44 tempest-SnapshotsActionsTest-1766860581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.c5db2ae5-5c0a-41b1-91a2-ee0261a733ff" returned: 0 in 0.808s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-476f0ccb-a5d8-4bf6-8859-54069ce6fd44 tempest-SnapshotsActionsTest-1766860581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.770s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:43:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.523s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:43:25 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:43:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1261093420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b40721b6-84e4-48c6-8bbc-51a3009adaf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527a9a56bd0049be8dc2fb79806cb171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:43:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:43:21Z,use_quota=True,user_id='db6f39caeef845c6a8ad01923d44e2ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:43:25 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Creating volume b40721b6-84e4-48c6-8bbc-51a3009adaf1 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:43:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:43:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:43:25 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:43:25 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:43:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:43:25 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:43:25 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:43:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b40721b6-84e4-48c6-8bbc-51a3009adaf1 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:25 devstack sudo[95765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b40721b6-84e4-48c6-8bbc-51a3009adaf1 1073741824 Jul 10 06:43:25 devstack sudo[95765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:25 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-476f0ccb-a5d8-4bf6-8859-54069ce6fd44 tempest-SnapshotsActionsTest-1766860581 None] Create snapshot completed successfully Jul 10 06:43:25 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6ccf6fd3-9e86-4c27-b0b2-531a2706eebd tempest-SnapshotsActionsTest-358660859 None] Acquiring lock "cinder-c5db2ae5-5c0a-41b1-91a2-ee0261a733ff-delete_snapshot" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:43:25 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6ccf6fd3-9e86-4c27-b0b2-531a2706eebd tempest-SnapshotsActionsTest-358660859 None] Lock "cinder-c5db2ae5-5c0a-41b1-91a2-ee0261a733ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:43:25 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6ccf6fd3-9e86-4c27-b0b2-531a2706eebd tempest-SnapshotsActionsTest-358660859 None] Acquiring lock "cinder-quobyte-b95e459e-1083-48d2-b8b3-4e659a5880c7" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:43:25 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6ccf6fd3-9e86-4c27-b0b2-531a2706eebd tempest-SnapshotsActionsTest-358660859 None] Lock "cinder-quobyte-b95e459e-1083-48d2-b8b3-4e659a5880c7" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:43:25 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6ccf6fd3-9e86-4c27-b0b2-531a2706eebd tempest-SnapshotsActionsTest-358660859 None] Acquiring lock "cinder-quobyte-c5db2ae5-5c0a-41b1-91a2-ee0261a733ff" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:43:25 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6ccf6fd3-9e86-4c27-b0b2-531a2706eebd tempest-SnapshotsActionsTest-358660859 None] Lock "cinder-quobyte-c5db2ae5-5c0a-41b1-91a2-ee0261a733ff" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:43:25 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-6ccf6fd3-9e86-4c27-b0b2-531a2706eebd tempest-SnapshotsActionsTest-358660859 None] Deleting offline snapshot c5db2ae5-5c0a-41b1-91a2-ee0261a733ff of volume b95e459e-1083-48d2-b8b3-4e659a5880c7 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:43:25 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-6ccf6fd3-9e86-4c27-b0b2-531a2706eebd tempest-SnapshotsActionsTest-358660859 None] snapshot_file for this snap is: volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.c5db2ae5-5c0a-41b1-91a2-ee0261a733ff {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:43:25 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[8457dbd5-266f-4da8-9f36-149837da62d7]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:43:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6ccf6fd3-9e86-4c27-b0b2-531a2706eebd tempest-SnapshotsActionsTest-358660859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.c5db2ae5-5c0a-41b1-91a2-ee0261a733ff {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:25 devstack sudo[95770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.c5db2ae5-5c0a-41b1-91a2-ee0261a733ff Jul 10 06:43:25 devstack sudo[95770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:26 devstack sudo[95765]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b40721b6-84e4-48c6-8bbc-51a3009adaf1 1073741824" returned: 0 in 1.190s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b40721b6-84e4-48c6-8bbc-51a3009adaf1 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:26 devstack sudo[95773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b40721b6-84e4-48c6-8bbc-51a3009adaf1 Jul 10 06:43:26 devstack sudo[95773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:26 devstack sudo[95770]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6ccf6fd3-9e86-4c27-b0b2-531a2706eebd tempest-SnapshotsActionsTest-358660859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.c5db2ae5-5c0a-41b1-91a2-ee0261a733ff" returned: 0 in 1.056s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:26 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-6ccf6fd3-9e86-4c27-b0b2-531a2706eebd tempest-SnapshotsActionsTest-358660859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b95e459e-1083-48d2-b8b3-4e659a5880c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:43:26 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[901e6b8b-8ff5-4252-bc22-de419c321ca2]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:43:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6ccf6fd3-9e86-4c27-b0b2-531a2706eebd tempest-SnapshotsActionsTest-358660859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:26 devstack sudo[95778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08 Jul 10 06:43:26 devstack sudo[95778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:27 devstack sudo[95773]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b40721b6-84e4-48c6-8bbc-51a3009adaf1" returned: 0 in 0.827s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:27 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] <== create_volume: return (2083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:43:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.086s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:43:27 devstack cinder-volume[87294]: DEBUG cinder.volume.volume_utils [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Attempting download of fce564e0-408f-448f-b73c-5fae94549898 ((None, [{'url': 'file:///opt/stack/data/glance/images/fce564e0-408f-448f-b73c-5fae94549898', 'metadata': {}}])) to volume b40721b6-84e4-48c6-8bbc-51a3009adaf1. {{(pid=87294) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 06:43:27 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[196dda27-2fdc-4c01-b26d-ec28015ee41c]: (4, 'raw') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:43:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fce564e0-408f-448f-b73c-5fae94549898_k79kcxey {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:27 devstack sudo[95781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fce564e0-408f-448f-b73c-5fae94549898_k79kcxey Jul 10 06:43:27 devstack sudo[95781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:27 devstack sudo[95778]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6ccf6fd3-9e86-4c27-b0b2-531a2706eebd tempest-SnapshotsActionsTest-358660859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08" returned: 0 in 1.018s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:27 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-6ccf6fd3-9e86-4c27-b0b2-531a2706eebd tempest-SnapshotsActionsTest-358660859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b95e459e-1083-48d2-b8b3-4e659a5880c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:43:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6ccf6fd3-9e86-4c27-b0b2-531a2706eebd tempest-SnapshotsActionsTest-358660859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.c5db2ae5-5c0a-41b1-91a2-ee0261a733ff {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:27 devstack sudo[95790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.c5db2ae5-5c0a-41b1-91a2-ee0261a733ff Jul 10 06:43:27 devstack sudo[95790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:28 devstack sudo[95781]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fce564e0-408f-448f-b73c-5fae94549898_k79kcxey" returned: 0 in 0.991s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fce564e0-408f-448f-b73c-5fae94549898_k79kcxey {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:28 devstack sudo[95794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fce564e0-408f-448f-b73c-5fae94549898_k79kcxey Jul 10 06:43:28 devstack sudo[95794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:28 devstack sudo[95790]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6ccf6fd3-9e86-4c27-b0b2-531a2706eebd tempest-SnapshotsActionsTest-358660859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.c5db2ae5-5c0a-41b1-91a2-ee0261a733ff" returned: 0 in 1.024s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6ccf6fd3-9e86-4c27-b0b2-531a2706eebd tempest-SnapshotsActionsTest-358660859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.c5db2ae5-5c0a-41b1-91a2-ee0261a733ff {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:28 devstack sudo[95799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.c5db2ae5-5c0a-41b1-91a2-ee0261a733ff Jul 10 06:43:28 devstack sudo[95799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:29 devstack sudo[95794]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fce564e0-408f-448f-b73c-5fae94549898_k79kcxey" returned: 1 in 0.914s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fce564e0-408f-448f-b73c-5fae94549898_k79kcxey' failed. Not Retrying. {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:43:29 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece86e33-1f59-49a6-9fef-6b134d3f9b62]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:43:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_0ovjwagydevstack@QuobyteHD {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:29 devstack sudo[95804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_0ovjwagydevstack@QuobyteHD Jul 10 06:43:29 devstack sudo[95804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:29 devstack sudo[95799]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6ccf6fd3-9e86-4c27-b0b2-531a2706eebd tempest-SnapshotsActionsTest-358660859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.c5db2ae5-5c0a-41b1-91a2-ee0261a733ff" returned: 0 in 0.887s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:29 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6ccf6fd3-9e86-4c27-b0b2-531a2706eebd tempest-SnapshotsActionsTest-358660859 None] Lock "cinder-quobyte-c5db2ae5-5c0a-41b1-91a2-ee0261a733ff" released by "_delete_snapshot" :: held 4.119s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:43:29 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6ccf6fd3-9e86-4c27-b0b2-531a2706eebd tempest-SnapshotsActionsTest-358660859 None] Lock "cinder-quobyte-b95e459e-1083-48d2-b8b3-4e659a5880c7" released by "delete_snapshot" :: held 4.150s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:43:29 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-6ccf6fd3-9e86-4c27-b0b2-531a2706eebd tempest-SnapshotsActionsTest-358660859 None] Created reservations ['06d470c7-dee3-4294-8b4f-477485e6a14f', '8c2937db-081f-41de-9ef5-d28a5144e48b', 'aa4d9d7c-a485-431e-b73e-d232ebdb271f', '7ee77fde-9f50-4a73-9b82-1a5ecdc47db3'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:43:30 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-6ccf6fd3-9e86-4c27-b0b2-531a2706eebd tempest-SnapshotsActionsTest-358660859 None] Delete snapshot completed successfully. Jul 10 06:43:30 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6ccf6fd3-9e86-4c27-b0b2-531a2706eebd tempest-SnapshotsActionsTest-358660859 None] Lock "cinder-c5db2ae5-5c0a-41b1-91a2-ee0261a733ff-delete_snapshot" released by "delete_snapshot" :: held 4.348s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:43:30 devstack sudo[95804]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_0ovjwagydevstack@QuobyteHD" returned: 0 in 0.915s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:30 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] fce564e0-408f-448f-b73c-5fae94549898 was qcow2, converting to raw {{(pid=87294) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 06:43:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_0ovjwagydevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b40721b6-84e4-48c6-8bbc-51a3009adaf1 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:30 devstack sudo[95811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_0ovjwagydevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b40721b6-84e4-48c6-8bbc-51a3009adaf1 Jul 10 06:43:30 devstack sudo[95811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:31 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-80b92e48-036c-4a4c-85a7-99daa20a0157 tempest-VolumesCloneTest-589924206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:43:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-80b92e48-036c-4a4c-85a7-99daa20a0157 tempest-VolumesCloneTest-589924206 None] Flow 'volume_create_manager' (8008d513-a417-4652-835e-5cb1e85fe727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:43:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-80b92e48-036c-4a4c-85a7-99daa20a0157 tempest-VolumesCloneTest-589924206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9045b18a-ddc4-47be-aeea-8e383794516f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-80b92e48-036c-4a4c-85a7-99daa20a0157 tempest-VolumesCloneTest-589924206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9045b18a-ddc4-47be-aeea-8e383794516f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-151727978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=470e3323-cdb9-4bd2-9aa3-6531af04f768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80a165b5a7594d2297c2fc1d06bf9d3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:43:31Z,use_quota=True,user_id='97ff74c3c8be4032afae79198bc4bbbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-80b92e48-036c-4a4c-85a7-99daa20a0157 tempest-VolumesCloneTest-589924206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cadb71f-ef75-42b7-a3ae-6e694d1a0671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-80b92e48-036c-4a4c-85a7-99daa20a0157 tempest-VolumesCloneTest-589924206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cadb71f-ef75-42b7-a3ae-6e694d1a0671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-80b92e48-036c-4a4c-85a7-99daa20a0157 tempest-VolumesCloneTest-589924206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6bb9763-1051-405b-a3e1-a69722fd798a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-80b92e48-036c-4a4c-85a7-99daa20a0157 tempest-VolumesCloneTest-589924206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6bb9763-1051-405b-a3e1-a69722fd798a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '470e3323-cdb9-4bd2-9aa3-6531af04f768', 'volume_name': 'volume-470e3323-cdb9-4bd2-9aa3-6531af04f768', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-80b92e48-036c-4a4c-85a7-99daa20a0157 tempest-VolumesCloneTest-589924206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c27b3eed-1aca-4739-954f-3c6146ddc984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-80b92e48-036c-4a4c-85a7-99daa20a0157 tempest-VolumesCloneTest-589924206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c27b3eed-1aca-4739-954f-3c6146ddc984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-80b92e48-036c-4a4c-85a7-99daa20a0157 tempest-VolumesCloneTest-589924206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8fd1478-b30c-446c-a934-78420af610d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:31 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-80b92e48-036c-4a4c-85a7-99daa20a0157 tempest-VolumesCloneTest-589924206 None] Volume 470e3323-cdb9-4bd2-9aa3-6531af04f768: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-470e3323-cdb9-4bd2-9aa3-6531af04f768', 'volume_size': 1} Jul 10 06:43:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-80b92e48-036c-4a4c-85a7-99daa20a0157 tempest-VolumesCloneTest-589924206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:43:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-80b92e48-036c-4a4c-85a7-99daa20a0157 tempest-VolumesCloneTest-589924206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:43:31 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-80b92e48-036c-4a4c-85a7-99daa20a0157 tempest-VolumesCloneTest-589924206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-151727978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=470e3323-cdb9-4bd2-9aa3-6531af04f768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80a165b5a7594d2297c2fc1d06bf9d3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:43:31Z,use_quota=True,user_id='97ff74c3c8be4032afae79198bc4bbbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:43:31 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-80b92e48-036c-4a4c-85a7-99daa20a0157 tempest-VolumesCloneTest-589924206 None] Creating volume 470e3323-cdb9-4bd2-9aa3-6531af04f768 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:43:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-80b92e48-036c-4a4c-85a7-99daa20a0157 tempest-VolumesCloneTest-589924206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:43:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-80b92e48-036c-4a4c-85a7-99daa20a0157 tempest-VolumesCloneTest-589924206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:43:31 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-80b92e48-036c-4a4c-85a7-99daa20a0157 tempest-VolumesCloneTest-589924206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:43:31 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-80b92e48-036c-4a4c-85a7-99daa20a0157 tempest-VolumesCloneTest-589924206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:43:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-80b92e48-036c-4a4c-85a7-99daa20a0157 tempest-VolumesCloneTest-589924206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:43:31 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-80b92e48-036c-4a4c-85a7-99daa20a0157 tempest-VolumesCloneTest-589924206 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:43:31 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-80b92e48-036c-4a4c-85a7-99daa20a0157 tempest-VolumesCloneTest-589924206 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:43:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-80b92e48-036c-4a4c-85a7-99daa20a0157 tempest-VolumesCloneTest-589924206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c74dfada-79a0-457a-aa43-911090cd8ccd tempest-SnapshotsActionsTest-1766860581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:43:31 devstack sudo[95828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768 1073741824 Jul 10 06:43:31 devstack sudo[95828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:32 devstack sudo[95811]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_0ovjwagydevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b40721b6-84e4-48c6-8bbc-51a3009adaf1" returned: 0 in 2.252s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:32 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_0ovjwagydevstack@QuobyteHD, size 112.00 MB, duration 2.25 sec, destination /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b40721b6-84e4-48c6-8bbc-51a3009adaf1 {{(pid=87294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 06:43:32 devstack cinder-volume[87294]: INFO cinder.image.image_utils [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Converted 112.00 MB image at 49.69 MB/s Jul 10 06:43:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b40721b6-84e4-48c6-8bbc-51a3009adaf1 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:32 devstack sudo[95834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b40721b6-84e4-48c6-8bbc-51a3009adaf1 1G Jul 10 06:43:32 devstack sudo[95834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:32 devstack sudo[95828]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-80b92e48-036c-4a4c-85a7-99daa20a0157 tempest-VolumesCloneTest-589924206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768 1073741824" returned: 0 in 0.979s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-80b92e48-036c-4a4c-85a7-99daa20a0157 tempest-VolumesCloneTest-589924206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:32 devstack sudo[95836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768 Jul 10 06:43:32 devstack sudo[95836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:33 devstack sudo[95834]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b40721b6-84e4-48c6-8bbc-51a3009adaf1 1G" returned: 0 in 0.771s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:33 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c95bc7-6369-4133-9766-c5fdb1fb995d]: (4, 'raw') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:43:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b40721b6-84e4-48c6-8bbc-51a3009adaf1 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:33 devstack sudo[95836]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-80b92e48-036c-4a4c-85a7-99daa20a0157 tempest-VolumesCloneTest-589924206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768" returned: 0 in 0.697s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:33 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-80b92e48-036c-4a4c-85a7-99daa20a0157 tempest-VolumesCloneTest-589924206 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:43:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-80b92e48-036c-4a4c-85a7-99daa20a0157 tempest-VolumesCloneTest-589924206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:43:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c74dfada-79a0-457a-aa43-911090cd8ccd tempest-SnapshotsActionsTest-1766860581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.691s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:43:33 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-80b92e48-036c-4a4c-85a7-99daa20a0157 tempest-VolumesCloneTest-589924206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8fd1478-b30c-446c-a934-78420af610d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-470e3323-cdb9-4bd2-9aa3-6531af04f768', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:33 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-80b92e48-036c-4a4c-85a7-99daa20a0157 tempest-VolumesCloneTest-589924206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a49cb926-2d09-4e9e-828a-0fdd37dda335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:33 devstack sudo[95842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b40721b6-84e4-48c6-8bbc-51a3009adaf1 Jul 10 06:43:33 devstack sudo[95842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:33 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-c74dfada-79a0-457a-aa43-911090cd8ccd tempest-SnapshotsActionsTest-1766860581 None] Creating offline snapshot 79841227-6d6e-4f94-ab69-daa5e428dc9b of volume b95e459e-1083-48d2-b8b3-4e659a5880c7 {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:43:33 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-80b92e48-036c-4a4c-85a7-99daa20a0157 tempest-VolumesCloneTest-589924206 None] Volume volume-470e3323-cdb9-4bd2-9aa3-6531af04f768 (470e3323-cdb9-4bd2-9aa3-6531af04f768): created successfully Jul 10 06:43:33 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-80b92e48-036c-4a4c-85a7-99daa20a0157 tempest-VolumesCloneTest-589924206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a49cb926-2d09-4e9e-828a-0fdd37dda335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:33 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-80b92e48-036c-4a4c-85a7-99daa20a0157 tempest-VolumesCloneTest-589924206 None] Flow 'volume_create_manager' (8008d513-a417-4652-835e-5cb1e85fe727) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:43:33 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[816dc8dd-d2ea-41d5-86a8-7fcced814f0c]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:43:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c74dfada-79a0-457a-aa43-911090cd8ccd tempest-SnapshotsActionsTest-1766860581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:33 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-80b92e48-036c-4a4c-85a7-99daa20a0157 tempest-VolumesCloneTest-589924206 None] Created volume successfully. Jul 10 06:43:33 devstack sudo[95844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08 Jul 10 06:43:33 devstack sudo[95844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:34 devstack sudo[95842]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b40721b6-84e4-48c6-8bbc-51a3009adaf1" returned: 0 in 0.854s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b40721b6-84e4-48c6-8bbc-51a3009adaf1 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:34 devstack sudo[95849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b40721b6-84e4-48c6-8bbc-51a3009adaf1 Jul 10 06:43:34 devstack sudo[95849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:34 devstack sudo[95844]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c74dfada-79a0-457a-aa43-911090cd8ccd tempest-SnapshotsActionsTest-1766860581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08" returned: 0 in 0.802s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:34 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-c74dfada-79a0-457a-aa43-911090cd8ccd tempest-SnapshotsActionsTest-1766860581 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b95e459e-1083-48d2-b8b3-4e659a5880c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:43:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c74dfada-79a0-457a-aa43-911090cd8ccd tempest-SnapshotsActionsTest-1766860581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.79841227-6d6e-4f94-ab69-daa5e428dc9b 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:34 devstack sudo[95854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.79841227-6d6e-4f94-ab69-daa5e428dc9b 1G Jul 10 06:43:34 devstack sudo[95854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:35 devstack sudo[95849]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b40721b6-84e4-48c6-8bbc-51a3009adaf1" returned: 1 in 1.085s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b40721b6-84e4-48c6-8bbc-51a3009adaf1' failed. Not Retrying. {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:43:35 devstack cinder-volume[87294]: DEBUG cinder.volume.volume_utils [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Downloaded image fce564e0-408f-448f-b73c-5fae94549898 ((None, [{'url': 'file:///opt/stack/data/glance/images/fce564e0-408f-448f-b73c-5fae94549898', 'metadata': {}}])) to volume b40721b6-84e4-48c6-8bbc-51a3009adaf1 successfully. {{(pid=87294) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 06:43:35 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Temporary image fce564e0-408f-448f-b73c-5fae94549898 for user db6f39caeef845c6a8ad01923d44e2ba is deleted. {{(pid=87294) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 06:43:35 devstack cinder-volume[87294]: DEBUG cinder.volume.volume_utils [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Marking volume b40721b6-84e4-48c6-8bbc-51a3009adaf1 as bootable. {{(pid=87294) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 06:43:35 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Copying metadata from image fce564e0-408f-448f-b73c-5fae94549898 to b40721b6-84e4-48c6-8bbc-51a3009adaf1. {{(pid=87294) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 06:43:35 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Creating volume glance metadata for volume b40721b6-84e4-48c6-8bbc-51a3009adaf1 backed by image fce564e0-408f-448f-b73c-5fae94549898 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fce564e0-408f-448f-b73c-5fae94549898', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87294) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 06:43:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (490d797e-b56d-42de-8509-ce6194a9ec99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b40721b6-84e4-48c6-8bbc-51a3009adaf1', 'volume_size': 1, 'image_id': 'fce564e0-408f-448f-b73c-5fae94549898', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fce564e0-408f-448f-b73c-5fae94549898', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '62db6635aac548658dfcc55ac904ccde', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fce564e0-408f-448f-b73c-5fae94549898', 'created_at': datetime.datetime(2026, 7, 10, 4, 29, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 29, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fce564e0-408f-448f-b73c-5fae94549898/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef65c09c-082b-4a4a-9241-7efd7cb12aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:35 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Volume volume-b40721b6-84e4-48c6-8bbc-51a3009adaf1 (b40721b6-84e4-48c6-8bbc-51a3009adaf1): created successfully Jul 10 06:43:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef65c09c-082b-4a4a-9241-7efd7cb12aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Flow 'volume_create_manager' (aac76f95-6464-44dd-ac48-a720794dc2e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:43:35 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-cd714d94-ef94-4443-8bba-ea65d1d22b0a tempest-VolumesExtendTest-210033117 None] Created volume successfully. Jul 10 06:43:35 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:43:35 devstack sudo[95854]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Flow 'volume_create_manager' (75691508-0cbf-4e77-a9fd-51c5061d6d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:43:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb528a62-66d0-48eb-aa38-e312e90ef5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c74dfada-79a0-457a-aa43-911090cd8ccd tempest-SnapshotsActionsTest-1766860581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.79841227-6d6e-4f94-ab69-daa5e428dc9b 1G" returned: 0 in 1.384s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c74dfada-79a0-457a-aa43-911090cd8ccd tempest-SnapshotsActionsTest-1766860581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.79841227-6d6e-4f94-ab69-daa5e428dc9b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb528a62-66d0-48eb-aa38-e312e90ef5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-391550702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea857c41-9248-4251-9ecc-b9e631fce65d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80a165b5a7594d2297c2fc1d06bf9d3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:43:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=470e3323-cdb9-4bd2-9aa3-6531af04f768,status='creating',terminated_at=None,updated_at=2026-07-10T04:43:35Z,use_quota=True,user_id='97ff74c3c8be4032afae79198bc4bbbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:35 devstack sudo[95881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.79841227-6d6e-4f94-ab69-daa5e428dc9b Jul 10 06:43:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87720295-0369-48ee-af0e-41d26b23919c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:35 devstack sudo[95881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87720295-0369-48ee-af0e-41d26b23919c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ef6c2af-6f61-4573-8bd9-a1fb7304a52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ef6c2af-6f61-4573-8bd9-a1fb7304a52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ea857c41-9248-4251-9ecc-b9e631fce65d', 'volume_name': 'volume-ea857c41-9248-4251-9ecc-b9e631fce65d', 'volume_size': 2, 'source_volid': '470e3323-cdb9-4bd2-9aa3-6531af04f768', 'source_volstatus': 'available'}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28a53540-2e04-4ff2-bba6-9ac90c29b75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28a53540-2e04-4ff2-bba6-9ac90c29b75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85a14cdf-a9b2-4a4a-bca7-e9193c69cdb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:35 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Volume ea857c41-9248-4251-9ecc-b9e631fce65d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ea857c41-9248-4251-9ecc-b9e631fce65d', 'volume_size': 2, 'source_volid': '470e3323-cdb9-4bd2-9aa3-6531af04f768', 'source_volstatus': 'available'} Jul 10 06:43:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:43:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f1e295b1-493a-4d7d-8890-564d07d8ae0b tempest-VolumesExtendTest-210033117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:43:36 devstack sudo[95881]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c74dfada-79a0-457a-aa43-911090cd8ccd tempest-SnapshotsActionsTest-1766860581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.79841227-6d6e-4f94-ab69-daa5e428dc9b" returned: 0 in 0.699s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:36 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-c74dfada-79a0-457a-aa43-911090cd8ccd tempest-SnapshotsActionsTest-1766860581 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.79841227-6d6e-4f94-ab69-daa5e428dc9b is being set with open permissions: ugo+rw Jul 10 06:43:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c74dfada-79a0-457a-aa43-911090cd8ccd tempest-SnapshotsActionsTest-1766860581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.79841227-6d6e-4f94-ab69-daa5e428dc9b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:36 devstack sudo[95892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.79841227-6d6e-4f94-ab69-daa5e428dc9b Jul 10 06:43:36 devstack sudo[95892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:36 devstack sudo[95892]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c74dfada-79a0-457a-aa43-911090cd8ccd tempest-SnapshotsActionsTest-1766860581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.79841227-6d6e-4f94-ab69-daa5e428dc9b" returned: 0 in 0.633s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c74dfada-79a0-457a-aa43-911090cd8ccd tempest-SnapshotsActionsTest-1766860581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.671s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:43:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.276s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:43:36 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Cloning volume 470e3323-cdb9-4bd2-9aa3-6531af04f768 to volume ea857c41-9248-4251-9ecc-b9e631fce65d Jul 10 06:43:36 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-c74dfada-79a0-457a-aa43-911090cd8ccd tempest-SnapshotsActionsTest-1766860581 None] Create snapshot completed successfully Jul 10 06:43:36 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Creating offline snapshot 13f15234-426b-4007-b178-5b8351fd197f of volume 470e3323-cdb9-4bd2-9aa3-6531af04f768 {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:43:37 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[4688dd6b-c5c8-4ac1-b2bc-15633e26460e]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:43:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:37 devstack sudo[95901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768 Jul 10 06:43:37 devstack sudo[95901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:38 devstack sudo[95901]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768" returned: 0 in 1.041s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:38 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7f6dbc2b-890d-4683-982b-42c41a640c74 tempest-SnapshotsActionsTest-358660859 None] Acquiring lock "cinder-79841227-6d6e-4f94-ab69-daa5e428dc9b-delete_snapshot" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:43:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768.13f15234-426b-4007-b178-5b8351fd197f 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:38 devstack sudo[95962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768.13f15234-426b-4007-b178-5b8351fd197f 1G Jul 10 06:43:38 devstack sudo[95962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:38 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7f6dbc2b-890d-4683-982b-42c41a640c74 tempest-SnapshotsActionsTest-358660859 None] Lock "cinder-79841227-6d6e-4f94-ab69-daa5e428dc9b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:43:38 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7f6dbc2b-890d-4683-982b-42c41a640c74 tempest-SnapshotsActionsTest-358660859 None] Acquiring lock "cinder-quobyte-b95e459e-1083-48d2-b8b3-4e659a5880c7" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:43:38 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7f6dbc2b-890d-4683-982b-42c41a640c74 tempest-SnapshotsActionsTest-358660859 None] Lock "cinder-quobyte-b95e459e-1083-48d2-b8b3-4e659a5880c7" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:43:38 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7f6dbc2b-890d-4683-982b-42c41a640c74 tempest-SnapshotsActionsTest-358660859 None] Acquiring lock "cinder-quobyte-79841227-6d6e-4f94-ab69-daa5e428dc9b" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:43:38 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7f6dbc2b-890d-4683-982b-42c41a640c74 tempest-SnapshotsActionsTest-358660859 None] Lock "cinder-quobyte-79841227-6d6e-4f94-ab69-daa5e428dc9b" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:43:38 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-7f6dbc2b-890d-4683-982b-42c41a640c74 tempest-SnapshotsActionsTest-358660859 None] Deleting offline snapshot 79841227-6d6e-4f94-ab69-daa5e428dc9b of volume b95e459e-1083-48d2-b8b3-4e659a5880c7 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:43:38 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-7f6dbc2b-890d-4683-982b-42c41a640c74 tempest-SnapshotsActionsTest-358660859 None] snapshot_file for this snap is: volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.79841227-6d6e-4f94-ab69-daa5e428dc9b {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:43:38 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[31668ec4-4751-49ac-9005-75c59eb52b96]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:43:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7f6dbc2b-890d-4683-982b-42c41a640c74 tempest-SnapshotsActionsTest-358660859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.79841227-6d6e-4f94-ab69-daa5e428dc9b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:38 devstack sudo[95968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.79841227-6d6e-4f94-ab69-daa5e428dc9b Jul 10 06:43:38 devstack sudo[95968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:39 devstack sudo[95962]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768.13f15234-426b-4007-b178-5b8351fd197f 1G" returned: 0 in 1.141s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-470e3323-cdb9-4bd2-9aa3-6531af04f768 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768.13f15234-426b-4007-b178-5b8351fd197f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:39 devstack sudo[95983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-470e3323-cdb9-4bd2-9aa3-6531af04f768 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768.13f15234-426b-4007-b178-5b8351fd197f Jul 10 06:43:39 devstack sudo[95983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:39 devstack sudo[95968]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7f6dbc2b-890d-4683-982b-42c41a640c74 tempest-SnapshotsActionsTest-358660859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.79841227-6d6e-4f94-ab69-daa5e428dc9b" returned: 0 in 1.049s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:39 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-7f6dbc2b-890d-4683-982b-42c41a640c74 tempest-SnapshotsActionsTest-358660859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b95e459e-1083-48d2-b8b3-4e659a5880c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:43:39 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf73e14-fd9e-449f-9f62-6f336a77c338]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:43:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7f6dbc2b-890d-4683-982b-42c41a640c74 tempest-SnapshotsActionsTest-358660859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:39 devstack sudo[95986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08 Jul 10 06:43:39 devstack sudo[95986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:40 devstack sudo[95983]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-470e3323-cdb9-4bd2-9aa3-6531af04f768 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768.13f15234-426b-4007-b178-5b8351fd197f" returned: 0 in 0.855s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:40 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768.13f15234-426b-4007-b178-5b8351fd197f is being set with open permissions: ugo+rw Jul 10 06:43:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768.13f15234-426b-4007-b178-5b8351fd197f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:40 devstack sudo[95992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768.13f15234-426b-4007-b178-5b8351fd197f Jul 10 06:43:40 devstack sudo[95992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:40 devstack sudo[95986]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7f6dbc2b-890d-4683-982b-42c41a640c74 tempest-SnapshotsActionsTest-358660859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08" returned: 0 in 1.005s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:40 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-7f6dbc2b-890d-4683-982b-42c41a640c74 tempest-SnapshotsActionsTest-358660859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b95e459e-1083-48d2-b8b3-4e659a5880c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:43:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7f6dbc2b-890d-4683-982b-42c41a640c74 tempest-SnapshotsActionsTest-358660859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.79841227-6d6e-4f94-ab69-daa5e428dc9b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:40 devstack sudo[95997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.79841227-6d6e-4f94-ab69-daa5e428dc9b Jul 10 06:43:40 devstack sudo[95997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:40 devstack sudo[95992]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768.13f15234-426b-4007-b178-5b8351fd197f" returned: 0 in 0.759s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:40 devstack sudo[96000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768.info Jul 10 06:43:40 devstack sudo[96000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:41 devstack sudo[95997]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7f6dbc2b-890d-4683-982b-42c41a640c74 tempest-SnapshotsActionsTest-358660859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.79841227-6d6e-4f94-ab69-daa5e428dc9b" returned: 0 in 0.927s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7f6dbc2b-890d-4683-982b-42c41a640c74 tempest-SnapshotsActionsTest-358660859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.79841227-6d6e-4f94-ab69-daa5e428dc9b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:41 devstack sudo[96006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.79841227-6d6e-4f94-ab69-daa5e428dc9b Jul 10 06:43:41 devstack sudo[96006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:41 devstack sudo[96000]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768.info" returned: 0 in 0.853s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:41 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768.info is being set with open permissions: ugo+rw Jul 10 06:43:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:41 devstack sudo[96009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768.info Jul 10 06:43:41 devstack sudo[96009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:41 devstack sudo[96006]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7f6dbc2b-890d-4683-982b-42c41a640c74 tempest-SnapshotsActionsTest-358660859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.79841227-6d6e-4f94-ab69-daa5e428dc9b" returned: 0 in 0.739s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7f6dbc2b-890d-4683-982b-42c41a640c74 tempest-SnapshotsActionsTest-358660859 None] Lock "cinder-quobyte-79841227-6d6e-4f94-ab69-daa5e428dc9b" released by "_delete_snapshot" :: held 3.855s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:43:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7f6dbc2b-890d-4683-982b-42c41a640c74 tempest-SnapshotsActionsTest-358660859 None] Lock "cinder-quobyte-b95e459e-1083-48d2-b8b3-4e659a5880c7" released by "delete_snapshot" :: held 3.884s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:43:42 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-7f6dbc2b-890d-4683-982b-42c41a640c74 tempest-SnapshotsActionsTest-358660859 None] Created reservations ['a5d82c16-69bf-436f-b3d5-941eb1b648c8', '07185a4e-a57b-43ba-8113-8531b019443c', '76b4b34d-1824-4026-a4a0-d92fc8bec0d0', '9fe7cc1b-9b31-40a5-93c0-547127d584f6'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:43:42 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-7f6dbc2b-890d-4683-982b-42c41a640c74 tempest-SnapshotsActionsTest-358660859 None] Delete snapshot completed successfully. Jul 10 06:43:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7f6dbc2b-890d-4683-982b-42c41a640c74 tempest-SnapshotsActionsTest-358660859 None] Lock "cinder-79841227-6d6e-4f94-ab69-daa5e428dc9b-delete_snapshot" released by "delete_snapshot" :: held 4.049s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:43:42 devstack sudo[96009]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768.info" returned: 0 in 0.716s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Acquiring lock "cinder-quobyte-ea857c41-9248-4251-9ecc-b9e631fce65d" by "_copy_volume_from_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:43:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Lock "cinder-quobyte-ea857c41-9248-4251-9ecc-b9e631fce65d" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:43:42 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] snapshot: 13f15234-426b-4007-b178-5b8351fd197f, volume: ea857c41-9248-4251-9ecc-b9e631fce65d, {{(pid=87294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 06:43:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:43:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:43:42 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:43:42 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:43:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:43:42 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4a1c4f-457a-4781-8ffc-1dbd54198684]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:43:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768.13f15234-426b-4007-b178-5b8351fd197f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:42 devstack sudo[96013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768.13f15234-426b-4007-b178-5b8351fd197f Jul 10 06:43:42 devstack sudo[96013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-756ff969-6ac3-4f38-b775-760fc47aeffb tempest-SnapshotsActionsTest-1766860581 None] Acquiring lock "cinder-b46f72be-1de8-4a10-af7d-f5deeaba5d08-delete_snapshot" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:43:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-756ff969-6ac3-4f38-b775-760fc47aeffb tempest-SnapshotsActionsTest-1766860581 None] Lock "cinder-b46f72be-1de8-4a10-af7d-f5deeaba5d08-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:43:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-756ff969-6ac3-4f38-b775-760fc47aeffb tempest-SnapshotsActionsTest-1766860581 None] Acquiring lock "cinder-quobyte-b95e459e-1083-48d2-b8b3-4e659a5880c7" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:43:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-756ff969-6ac3-4f38-b775-760fc47aeffb tempest-SnapshotsActionsTest-1766860581 None] Lock "cinder-quobyte-b95e459e-1083-48d2-b8b3-4e659a5880c7" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:43:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-756ff969-6ac3-4f38-b775-760fc47aeffb tempest-SnapshotsActionsTest-1766860581 None] Acquiring lock "cinder-quobyte-b46f72be-1de8-4a10-af7d-f5deeaba5d08" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:43:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-756ff969-6ac3-4f38-b775-760fc47aeffb tempest-SnapshotsActionsTest-1766860581 None] Lock "cinder-quobyte-b46f72be-1de8-4a10-af7d-f5deeaba5d08" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:43:42 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-756ff969-6ac3-4f38-b775-760fc47aeffb tempest-SnapshotsActionsTest-1766860581 None] Deleting offline snapshot b46f72be-1de8-4a10-af7d-f5deeaba5d08 of volume b95e459e-1083-48d2-b8b3-4e659a5880c7 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:43:42 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-756ff969-6ac3-4f38-b775-760fc47aeffb tempest-SnapshotsActionsTest-1766860581 None] snapshot_file for this snap is: volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:43:42 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f1898f-95b5-496f-8bc7-7d6f86b2e714]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:43:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-756ff969-6ac3-4f38-b775-760fc47aeffb tempest-SnapshotsActionsTest-1766860581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:43 devstack sudo[96015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08 Jul 10 06:43:43 devstack sudo[96015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:43 devstack sudo[96013]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768.13f15234-426b-4007-b178-5b8351fd197f" returned: 0 in 0.813s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:43 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-470e3323-cdb9-4bd2-9aa3-6531af04f768(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:43:43 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768 {{(pid=87294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 06:43:43 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Creating direct copy from snapshot {{(pid=87294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 06:43:43 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e96cc93-505f-4eda-ac11-2cfa3d1b642d]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:43:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:43 devstack sudo[96020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768 Jul 10 06:43:43 devstack sudo[96020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:43 devstack sudo[96015]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-756ff969-6ac3-4f38-b775-760fc47aeffb tempest-SnapshotsActionsTest-1766860581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08" returned: 0 in 0.798s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:43 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-756ff969-6ac3-4f38-b775-760fc47aeffb tempest-SnapshotsActionsTest-1766860581 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b95e459e-1083-48d2-b8b3-4e659a5880c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:43:43 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef36e0bb-1dab-4b40-9117-9dd685d24290]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:43:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-756ff969-6ac3-4f38-b775-760fc47aeffb tempest-SnapshotsActionsTest-1766860581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:43 devstack sudo[96026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7 Jul 10 06:43:43 devstack sudo[96026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:44 devstack sudo[96020]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768" returned: 0 in 0.825s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:44 devstack cinder-volume[87294]: DEBUG cinder.utils [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Path /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea857c41-9248-4251-9ecc-b9e631fce65d not found in is_blk_device check {{(pid=87294) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 06:43:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea857c41-9248-4251-9ecc-b9e631fce65d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:44 devstack sudo[96031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea857c41-9248-4251-9ecc-b9e631fce65d Jul 10 06:43:44 devstack sudo[96031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:44 devstack sudo[96026]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-756ff969-6ac3-4f38-b775-760fc47aeffb tempest-SnapshotsActionsTest-1766860581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7" returned: 0 in 0.849s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-756ff969-6ac3-4f38-b775-760fc47aeffb tempest-SnapshotsActionsTest-1766860581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:44 devstack sudo[96037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08 Jul 10 06:43:44 devstack sudo[96037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:46 devstack sudo[96037]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-756ff969-6ac3-4f38-b775-760fc47aeffb tempest-SnapshotsActionsTest-1766860581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08" returned: 0 in 1.521s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-756ff969-6ac3-4f38-b775-760fc47aeffb tempest-SnapshotsActionsTest-1766860581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:46 devstack sudo[96052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08 Jul 10 06:43:46 devstack sudo[96052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:48 devstack sudo[96052]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-756ff969-6ac3-4f38-b775-760fc47aeffb tempest-SnapshotsActionsTest-1766860581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7.b46f72be-1de8-4a10-af7d-f5deeaba5d08" returned: 0 in 2.414s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:48 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-756ff969-6ac3-4f38-b775-760fc47aeffb tempest-SnapshotsActionsTest-1766860581 None] Lock "cinder-quobyte-b46f72be-1de8-4a10-af7d-f5deeaba5d08" released by "_delete_snapshot" :: held 5.775s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:43:48 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-756ff969-6ac3-4f38-b775-760fc47aeffb tempest-SnapshotsActionsTest-1766860581 None] Lock "cinder-quobyte-b95e459e-1083-48d2-b8b3-4e659a5880c7" released by "delete_snapshot" :: held 5.806s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:43:48 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-756ff969-6ac3-4f38-b775-760fc47aeffb tempest-SnapshotsActionsTest-1766860581 None] Created reservations ['af7bc1f2-b7bd-4c51-9316-6be18a9b0cf3', 'd6f392e7-b18d-4192-8c11-540be7db4456', '98a384d2-43b8-4f54-b0ca-89fde78174f2', '984550f2-08f6-43c1-893f-500623a4d221'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:43:49 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-756ff969-6ac3-4f38-b775-760fc47aeffb tempest-SnapshotsActionsTest-1766860581 None] Delete snapshot completed successfully. Jul 10 06:43:49 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-756ff969-6ac3-4f38-b775-760fc47aeffb tempest-SnapshotsActionsTest-1766860581 None] Lock "cinder-b46f72be-1de8-4a10-af7d-f5deeaba5d08-delete_snapshot" released by "delete_snapshot" :: held 6.234s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:43:49 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a4b02aed-d853-49c0-9fff-351f723fda76 tempest-SnapshotsActionsTest-1766860581 None] Acquiring lock "cinder-b95e459e-1083-48d2-b8b3-4e659a5880c7-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:43:49 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a4b02aed-d853-49c0-9fff-351f723fda76 tempest-SnapshotsActionsTest-1766860581 None] Lock "cinder-b95e459e-1083-48d2-b8b3-4e659a5880c7-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:43:49 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a4b02aed-d853-49c0-9fff-351f723fda76 tempest-SnapshotsActionsTest-1766860581 None] Acquiring lock "cinder-quobyte-b95e459e-1083-48d2-b8b3-4e659a5880c7" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:43:49 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a4b02aed-d853-49c0-9fff-351f723fda76 tempest-SnapshotsActionsTest-1766860581 None] Lock "cinder-quobyte-b95e459e-1083-48d2-b8b3-4e659a5880c7" acquired by "delete_volume" :: waited 0.046s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:43:50 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b6bfb0-9b76-4437-8577-883ac706a45a]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:43:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a4b02aed-d853-49c0-9fff-351f723fda76 tempest-SnapshotsActionsTest-1766860581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:50 devstack sudo[96057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7 Jul 10 06:43:50 devstack sudo[96057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:50 devstack sudo[96031]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea857c41-9248-4251-9ecc-b9e631fce65d" returned: 0 in 6.225s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:50 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ea1d8f-ca82-4248-9b6a-21ac65b87986]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:43:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:50 devstack sudo[96059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768 Jul 10 06:43:50 devstack sudo[96059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:51 devstack sudo[96057]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a4b02aed-d853-49c0-9fff-351f723fda76 tempest-SnapshotsActionsTest-1766860581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7" returned: 0 in 1.000s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a4b02aed-d853-49c0-9fff-351f723fda76 tempest-SnapshotsActionsTest-1766860581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:51 devstack sudo[96074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7 Jul 10 06:43:51 devstack sudo[96074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:51 devstack sudo[96059]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768" returned: 0 in 1.012s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:51 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768, size 1024.00 MB, duration 6.23 sec, destination /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea857c41-9248-4251-9ecc-b9e631fce65d {{(pid=87294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 06:43:51 devstack cinder-volume[87294]: INFO cinder.image.image_utils [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Converted 1024.00 MB image at 164.46 MB/s Jul 10 06:43:51 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea857c41-9248-4251-9ecc-b9e631fce65d is being set with open permissions: ugo+rw Jul 10 06:43:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea857c41-9248-4251-9ecc-b9e631fce65d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:51 devstack sudo[96079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea857c41-9248-4251-9ecc-b9e631fce65d Jul 10 06:43:51 devstack sudo[96079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:51 devstack sudo[96074]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a4b02aed-d853-49c0-9fff-351f723fda76 tempest-SnapshotsActionsTest-1766860581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b95e459e-1083-48d2-b8b3-4e659a5880c7" returned: 0 in 0.673s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:51 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a4b02aed-d853-49c0-9fff-351f723fda76 tempest-SnapshotsActionsTest-1766860581 None] Lock "cinder-quobyte-b95e459e-1083-48d2-b8b3-4e659a5880c7" released by "delete_volume" :: held 1.818s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:43:51 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-a4b02aed-d853-49c0-9fff-351f723fda76 tempest-SnapshotsActionsTest-1766860581 None] Created reservations ['cf8ad706-96cb-4d7d-9f50-cd32cc095a46', 'f6de7fe0-5f4a-4288-8e75-9dba82cd0178', 'f07c943b-3f82-43bd-a5f6-2756b4524ac1', 'f59ab0a9-74b0-49f7-a237-6d068e5b1cd5'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:43:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a4b02aed-d853-49c0-9fff-351f723fda76 tempest-SnapshotsActionsTest-1766860581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:43:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a4b02aed-d853-49c0-9fff-351f723fda76 tempest-SnapshotsActionsTest-1766860581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:43:51 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-a4b02aed-d853-49c0-9fff-351f723fda76 tempest-SnapshotsActionsTest-1766860581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:43:51 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-a4b02aed-d853-49c0-9fff-351f723fda76 tempest-SnapshotsActionsTest-1766860581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:43:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a4b02aed-d853-49c0-9fff-351f723fda76 tempest-SnapshotsActionsTest-1766860581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:43:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a4b02aed-d853-49c0-9fff-351f723fda76 tempest-SnapshotsActionsTest-1766860581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:51 devstack sudo[96082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:43:51 devstack sudo[96082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:52 devstack sudo[96079]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea857c41-9248-4251-9ecc-b9e631fce65d" returned: 0 in 0.673s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:52 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Lock "cinder-quobyte-ea857c41-9248-4251-9ecc-b9e631fce65d" released by "_copy_volume_from_snapshot" :: held 9.655s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:43:52 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Acquiring lock "cinder-quobyte-13f15234-426b-4007-b178-5b8351fd197f" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:43:52 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Lock "cinder-quobyte-13f15234-426b-4007-b178-5b8351fd197f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:43:52 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Deleting offline snapshot 13f15234-426b-4007-b178-5b8351fd197f of volume 470e3323-cdb9-4bd2-9aa3-6531af04f768 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:43:52 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] snapshot_file for this snap is: volume-470e3323-cdb9-4bd2-9aa3-6531af04f768.13f15234-426b-4007-b178-5b8351fd197f {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:43:52 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[88cb8525-d7ee-4b1d-bcc2-264958fd8f82]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:43:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768.13f15234-426b-4007-b178-5b8351fd197f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:52 devstack sudo[96085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768.13f15234-426b-4007-b178-5b8351fd197f Jul 10 06:43:52 devstack sudo[96085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:52 devstack sudo[96082]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a4b02aed-d853-49c0-9fff-351f723fda76 tempest-SnapshotsActionsTest-1766860581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.668s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:52 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-a4b02aed-d853-49c0-9fff-351f723fda76 tempest-SnapshotsActionsTest-1766860581 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:43:52 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-a4b02aed-d853-49c0-9fff-351f723fda76 tempest-SnapshotsActionsTest-1766860581 None] Deleted volume successfully. Jul 10 06:43:52 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a4b02aed-d853-49c0-9fff-351f723fda76 tempest-SnapshotsActionsTest-1766860581 None] Lock "cinder-b95e459e-1083-48d2-b8b3-4e659a5880c7-delete_volume" released by "delete_volume" :: held 2.869s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:43:52 devstack sudo[96085]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768.13f15234-426b-4007-b178-5b8351fd197f" returned: 0 in 0.802s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:52 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-470e3323-cdb9-4bd2-9aa3-6531af04f768(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:43:53 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0b1558-8a96-4949-ba10-0039a9a88078]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:43:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:53 devstack sudo[96092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768 Jul 10 06:43:53 devstack sudo[96092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:53 devstack sudo[96092]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768" returned: 0 in 0.752s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768.13f15234-426b-4007-b178-5b8351fd197f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:53 devstack sudo[96097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768.13f15234-426b-4007-b178-5b8351fd197f Jul 10 06:43:53 devstack sudo[96097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:54 devstack sudo[96097]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768.13f15234-426b-4007-b178-5b8351fd197f" returned: 0 in 0.850s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768.13f15234-426b-4007-b178-5b8351fd197f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:54 devstack sudo[96104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768.13f15234-426b-4007-b178-5b8351fd197f Jul 10 06:43:54 devstack sudo[96104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:55 devstack sudo[96104]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768.13f15234-426b-4007-b178-5b8351fd197f" returned: 0 in 0.630s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Lock "cinder-quobyte-13f15234-426b-4007-b178-5b8351fd197f" released by "_delete_snapshot" :: held 3.128s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:43:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.387s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:43:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f1e295b1-493a-4d7d-8890-564d07d8ae0b tempest-VolumesExtendTest-210033117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 19.111s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:43:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85a14cdf-a9b2-4a4a-bca7-e9193c69cdb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea857c41-9248-4251-9ecc-b9e631fce65d', 'volume_size': 2, 'source_volid': '470e3323-cdb9-4bd2-9aa3-6531af04f768', 'source_volstatus': 'available'}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4371c9b-ae73-4d17-ae89-76aad3620638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:43:55 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc54163-2bc7-496d-adab-26fed3bb1b2b]: (4, 'raw') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:43:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1e295b1-493a-4d7d-8890-564d07d8ae0b tempest-VolumesExtendTest-210033117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b40721b6-84e4-48c6-8bbc-51a3009adaf1 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:55 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Volume volume-ea857c41-9248-4251-9ecc-b9e631fce65d (ea857c41-9248-4251-9ecc-b9e631fce65d): created successfully Jul 10 06:43:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4371c9b-ae73-4d17-ae89-76aad3620638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:43:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Flow 'volume_create_manager' (75691508-0cbf-4e77-a9fd-51c5061d6d14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:43:55 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-03f804a1-ffbb-4b6d-8263-c9fdd5f61b84 tempest-VolumesCloneTest-589924206 None] Created volume successfully. Jul 10 06:43:55 devstack sudo[96107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b40721b6-84e4-48c6-8bbc-51a3009adaf1 Jul 10 06:43:55 devstack sudo[96107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:56 devstack sudo[96107]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1e295b1-493a-4d7d-8890-564d07d8ae0b tempest-VolumesExtendTest-210033117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b40721b6-84e4-48c6-8bbc-51a3009adaf1" returned: 0 in 0.779s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1e295b1-493a-4d7d-8890-564d07d8ae0b tempest-VolumesExtendTest-210033117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b40721b6-84e4-48c6-8bbc-51a3009adaf1 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:56 devstack sudo[96111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b40721b6-84e4-48c6-8bbc-51a3009adaf1 Jul 10 06:43:56 devstack sudo[96111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:56 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-39e7b0b3-f1e0-4570-a34e-e512376b9348 tempest-VolumesCloneTest-589924206 None] Acquiring lock "cinder-ea857c41-9248-4251-9ecc-b9e631fce65d-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:43:56 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-39e7b0b3-f1e0-4570-a34e-e512376b9348 tempest-VolumesCloneTest-589924206 None] Lock "cinder-ea857c41-9248-4251-9ecc-b9e631fce65d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:43:56 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-39e7b0b3-f1e0-4570-a34e-e512376b9348 tempest-VolumesCloneTest-589924206 None] Acquiring lock "cinder-quobyte-ea857c41-9248-4251-9ecc-b9e631fce65d" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:43:56 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-39e7b0b3-f1e0-4570-a34e-e512376b9348 tempest-VolumesCloneTest-589924206 None] Lock "cinder-quobyte-ea857c41-9248-4251-9ecc-b9e631fce65d" acquired by "delete_volume" :: waited 0.014s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:43:56 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[38fc8c8d-d5b8-4048-a667-3011091269d1]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:43:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-39e7b0b3-f1e0-4570-a34e-e512376b9348 tempest-VolumesCloneTest-589924206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea857c41-9248-4251-9ecc-b9e631fce65d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:56 devstack sudo[96115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea857c41-9248-4251-9ecc-b9e631fce65d Jul 10 06:43:56 devstack sudo[96115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:56 devstack sudo[96111]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1e295b1-493a-4d7d-8890-564d07d8ae0b tempest-VolumesExtendTest-210033117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b40721b6-84e4-48c6-8bbc-51a3009adaf1" returned: 1 in 0.774s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1e295b1-493a-4d7d-8890-564d07d8ae0b tempest-VolumesExtendTest-210033117 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b40721b6-84e4-48c6-8bbc-51a3009adaf1' failed. Not Retrying. {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:43:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1e295b1-493a-4d7d-8890-564d07d8ae0b tempest-VolumesExtendTest-210033117 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b40721b6-84e4-48c6-8bbc-51a3009adaf1 2G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1e295b1-493a-4d7d-8890-564d07d8ae0b tempest-VolumesExtendTest-210033117 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b40721b6-84e4-48c6-8bbc-51a3009adaf1 2G" returned: 0 in 0.057s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f1e295b1-493a-4d7d-8890-564d07d8ae0b tempest-VolumesExtendTest-210033117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.648s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:43:57 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-f1e295b1-493a-4d7d-8890-564d07d8ae0b tempest-VolumesExtendTest-210033117 None] Extend volume completed successfully. Jul 10 06:43:57 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-9c3b5fbc-8277-4367-b981-76af3c0e55f9 tempest-VolumesExtendTest-210033117 None] Acquiring lock "cinder-b40721b6-84e4-48c6-8bbc-51a3009adaf1-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:43:57 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-9c3b5fbc-8277-4367-b981-76af3c0e55f9 tempest-VolumesExtendTest-210033117 None] Lock "cinder-b40721b6-84e4-48c6-8bbc-51a3009adaf1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:43:57 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:UPDATE=111,cinder:SELECT=96,cinder:DELETE=9,cinder:INSERT=35 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:43:57 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-9c3b5fbc-8277-4367-b981-76af3c0e55f9 tempest-VolumesExtendTest-210033117 None] Acquiring lock "cinder-quobyte-b40721b6-84e4-48c6-8bbc-51a3009adaf1" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:43:57 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-9c3b5fbc-8277-4367-b981-76af3c0e55f9 tempest-VolumesExtendTest-210033117 None] Lock "cinder-quobyte-b40721b6-84e4-48c6-8bbc-51a3009adaf1" acquired by "delete_volume" :: waited 0.033s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:43:57 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[d383da43-9079-47f6-850c-f4ef06a7559e]: (4, 'raw') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:43:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9c3b5fbc-8277-4367-b981-76af3c0e55f9 tempest-VolumesExtendTest-210033117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b40721b6-84e4-48c6-8bbc-51a3009adaf1 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:57 devstack sudo[96115]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-39e7b0b3-f1e0-4570-a34e-e512376b9348 tempest-VolumesCloneTest-589924206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea857c41-9248-4251-9ecc-b9e631fce65d" returned: 0 in 0.926s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-39e7b0b3-f1e0-4570-a34e-e512376b9348 tempest-VolumesCloneTest-589924206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea857c41-9248-4251-9ecc-b9e631fce65d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:57 devstack sudo[96127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea857c41-9248-4251-9ecc-b9e631fce65d Jul 10 06:43:57 devstack sudo[96127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:57 devstack sudo[96126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b40721b6-84e4-48c6-8bbc-51a3009adaf1 Jul 10 06:43:57 devstack sudo[96126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:58 devstack sudo[96127]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-39e7b0b3-f1e0-4570-a34e-e512376b9348 tempest-VolumesCloneTest-589924206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ea857c41-9248-4251-9ecc-b9e631fce65d" returned: 0 in 0.770s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:58 devstack sudo[96126]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9c3b5fbc-8277-4367-b981-76af3c0e55f9 tempest-VolumesExtendTest-210033117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b40721b6-84e4-48c6-8bbc-51a3009adaf1" returned: 0 in 0.829s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9c3b5fbc-8277-4367-b981-76af3c0e55f9 tempest-VolumesExtendTest-210033117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b40721b6-84e4-48c6-8bbc-51a3009adaf1 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:58 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-39e7b0b3-f1e0-4570-a34e-e512376b9348 tempest-VolumesCloneTest-589924206 None] Lock "cinder-quobyte-ea857c41-9248-4251-9ecc-b9e631fce65d" released by "delete_volume" :: held 1.754s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:43:58 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-39e7b0b3-f1e0-4570-a34e-e512376b9348 tempest-VolumesCloneTest-589924206 None] Created reservations ['d8c9dffd-f04d-430a-9603-fa9a8a94dc34', '99d802b5-1a37-407c-9f5b-b70f8615ec24', '3729f188-c48f-4123-8693-9de91cb74364', '6cf134d9-10a4-4e06-a4f0-b9bc0656113b'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:43:58 devstack sudo[96133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b40721b6-84e4-48c6-8bbc-51a3009adaf1 Jul 10 06:43:58 devstack sudo[96133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-39e7b0b3-f1e0-4570-a34e-e512376b9348 tempest-VolumesCloneTest-589924206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:43:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-39e7b0b3-f1e0-4570-a34e-e512376b9348 tempest-VolumesCloneTest-589924206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:43:58 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-39e7b0b3-f1e0-4570-a34e-e512376b9348 tempest-VolumesCloneTest-589924206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:43:58 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-39e7b0b3-f1e0-4570-a34e-e512376b9348 tempest-VolumesCloneTest-589924206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:43:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-39e7b0b3-f1e0-4570-a34e-e512376b9348 tempest-VolumesCloneTest-589924206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:43:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-39e7b0b3-f1e0-4570-a34e-e512376b9348 tempest-VolumesCloneTest-589924206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:58 devstack sudo[96135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:43:58 devstack sudo[96135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:59 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d9a96f0b-9083-4dcf-93a0-8bac0a942d6d tempest-VolumesCloneTest-589924206 None] Acquiring lock "cinder-470e3323-cdb9-4bd2-9aa3-6531af04f768-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:43:59 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d9a96f0b-9083-4dcf-93a0-8bac0a942d6d tempest-VolumesCloneTest-589924206 None] Lock "cinder-470e3323-cdb9-4bd2-9aa3-6531af04f768-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:43:59 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d9a96f0b-9083-4dcf-93a0-8bac0a942d6d tempest-VolumesCloneTest-589924206 None] Acquiring lock "cinder-quobyte-470e3323-cdb9-4bd2-9aa3-6531af04f768" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:43:59 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d9a96f0b-9083-4dcf-93a0-8bac0a942d6d tempest-VolumesCloneTest-589924206 None] Lock "cinder-quobyte-470e3323-cdb9-4bd2-9aa3-6531af04f768" acquired by "delete_volume" :: waited 0.049s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:43:59 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d450052-b85f-4369-8718-2206817e40dc]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:43:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d9a96f0b-9083-4dcf-93a0-8bac0a942d6d tempest-VolumesCloneTest-589924206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:59 devstack sudo[96133]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9c3b5fbc-8277-4367-b981-76af3c0e55f9 tempest-VolumesExtendTest-210033117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b40721b6-84e4-48c6-8bbc-51a3009adaf1" returned: 1 in 1.234s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9c3b5fbc-8277-4367-b981-76af3c0e55f9 tempest-VolumesExtendTest-210033117 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b40721b6-84e4-48c6-8bbc-51a3009adaf1' failed. Not Retrying. {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:43:59 devstack sudo[96135]: pam_unix(sudo:session): session closed for user root Jul 10 06:43:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9c3b5fbc-8277-4367-b981-76af3c0e55f9 tempest-VolumesExtendTest-210033117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b40721b6-84e4-48c6-8bbc-51a3009adaf1 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:43:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-39e7b0b3-f1e0-4570-a34e-e512376b9348 tempest-VolumesCloneTest-589924206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.027s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:43:59 devstack sudo[96140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768 Jul 10 06:43:59 devstack sudo[96140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:59 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-39e7b0b3-f1e0-4570-a34e-e512376b9348 tempest-VolumesCloneTest-589924206 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:43:59 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-39e7b0b3-f1e0-4570-a34e-e512376b9348 tempest-VolumesCloneTest-589924206 None] Deleted volume successfully. Jul 10 06:43:59 devstack sudo[96143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b40721b6-84e4-48c6-8bbc-51a3009adaf1 Jul 10 06:43:59 devstack sudo[96143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:43:59 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-39e7b0b3-f1e0-4570-a34e-e512376b9348 tempest-VolumesCloneTest-589924206 None] Lock "cinder-ea857c41-9248-4251-9ecc-b9e631fce65d-delete_volume" released by "delete_volume" :: held 3.087s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:44:00 devstack sudo[96143]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9c3b5fbc-8277-4367-b981-76af3c0e55f9 tempest-VolumesExtendTest-210033117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b40721b6-84e4-48c6-8bbc-51a3009adaf1" returned: 0 in 0.727s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:00 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-9c3b5fbc-8277-4367-b981-76af3c0e55f9 tempest-VolumesExtendTest-210033117 None] Lock "cinder-quobyte-b40721b6-84e4-48c6-8bbc-51a3009adaf1" released by "delete_volume" :: held 2.890s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:44:00 devstack sudo[96140]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d9a96f0b-9083-4dcf-93a0-8bac0a942d6d tempest-VolumesCloneTest-589924206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768" returned: 0 in 1.020s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d9a96f0b-9083-4dcf-93a0-8bac0a942d6d tempest-VolumesCloneTest-589924206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:00 devstack sudo[96150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768 Jul 10 06:44:00 devstack sudo[96150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:00 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-9c3b5fbc-8277-4367-b981-76af3c0e55f9 tempest-VolumesExtendTest-210033117 None] Created reservations ['1004c434-ee0a-41cc-ad90-81e9dfccd0cb', 'c51da39c-a313-4c3d-9bc4-bd7ff793c290', '5768c2d9-7a0f-43e0-a543-da767d0efa0a', 'fd1019fb-fb44-4f7b-8fff-c2b3dfa49c86'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:44:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9c3b5fbc-8277-4367-b981-76af3c0e55f9 tempest-VolumesExtendTest-210033117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9c3b5fbc-8277-4367-b981-76af3c0e55f9 tempest-VolumesExtendTest-210033117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:00 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9c3b5fbc-8277-4367-b981-76af3c0e55f9 tempest-VolumesExtendTest-210033117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:44:00 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9c3b5fbc-8277-4367-b981-76af3c0e55f9 tempest-VolumesExtendTest-210033117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:44:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9c3b5fbc-8277-4367-b981-76af3c0e55f9 tempest-VolumesExtendTest-210033117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9c3b5fbc-8277-4367-b981-76af3c0e55f9 tempest-VolumesExtendTest-210033117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:00 devstack sudo[96152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:44:00 devstack sudo[96152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:01 devstack sudo[96150]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d9a96f0b-9083-4dcf-93a0-8bac0a942d6d tempest-VolumesCloneTest-589924206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-470e3323-cdb9-4bd2-9aa3-6531af04f768" returned: 0 in 0.905s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:01 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d9a96f0b-9083-4dcf-93a0-8bac0a942d6d tempest-VolumesCloneTest-589924206 None] Lock "cinder-quobyte-470e3323-cdb9-4bd2-9aa3-6531af04f768" released by "delete_volume" :: held 2.058s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:44:01 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-85a388ed-2c5d-4def-9700-e66d8db2910d tempest-VolumesExtendTest-210033117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:44:01 devstack sudo[96152]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-85a388ed-2c5d-4def-9700-e66d8db2910d tempest-VolumesExtendTest-210033117 None] Flow 'volume_create_manager' (af058d1f-d08a-4fa7-b55a-500ad9f1efb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:44:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-85a388ed-2c5d-4def-9700-e66d8db2910d tempest-VolumesExtendTest-210033117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fe3d486-8e52-4979-9d4b-f17df6c00bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9c3b5fbc-8277-4367-b981-76af3c0e55f9 tempest-VolumesExtendTest-210033117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.908s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:01 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-9c3b5fbc-8277-4367-b981-76af3c0e55f9 tempest-VolumesExtendTest-210033117 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:44:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-85a388ed-2c5d-4def-9700-e66d8db2910d tempest-VolumesExtendTest-210033117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fe3d486-8e52-4979-9d4b-f17df6c00bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:44:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1995538372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b4067b8-ecf0-4255-a175-37de5ecb69d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527a9a56bd0049be8dc2fb79806cb171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:44:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:44:01Z,use_quota=True,user_id='db6f39caeef845c6a8ad01923d44e2ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-85a388ed-2c5d-4def-9700-e66d8db2910d tempest-VolumesExtendTest-210033117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1cc8656-bd3d-4c66-9d2d-91ec595ba89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-85a388ed-2c5d-4def-9700-e66d8db2910d tempest-VolumesExtendTest-210033117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1cc8656-bd3d-4c66-9d2d-91ec595ba89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-85a388ed-2c5d-4def-9700-e66d8db2910d tempest-VolumesExtendTest-210033117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21271297-f44f-44b4-b72a-1d481bab2e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-85a388ed-2c5d-4def-9700-e66d8db2910d tempest-VolumesExtendTest-210033117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21271297-f44f-44b4-b72a-1d481bab2e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b4067b8-ecf0-4255-a175-37de5ecb69d4', 'volume_name': 'volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-85a388ed-2c5d-4def-9700-e66d8db2910d tempest-VolumesExtendTest-210033117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (029a933f-5a19-4207-9106-4968a66113bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-85a388ed-2c5d-4def-9700-e66d8db2910d tempest-VolumesExtendTest-210033117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (029a933f-5a19-4207-9106-4968a66113bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-85a388ed-2c5d-4def-9700-e66d8db2910d tempest-VolumesExtendTest-210033117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e726bf5-32d9-4c8b-9fee-99a734d470db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:01 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-85a388ed-2c5d-4def-9700-e66d8db2910d tempest-VolumesExtendTest-210033117 None] Volume 2b4067b8-ecf0-4255-a175-37de5ecb69d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4', 'volume_size': 1} Jul 10 06:44:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-85a388ed-2c5d-4def-9700-e66d8db2910d tempest-VolumesExtendTest-210033117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-85a388ed-2c5d-4def-9700-e66d8db2910d tempest-VolumesExtendTest-210033117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:01 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-85a388ed-2c5d-4def-9700-e66d8db2910d tempest-VolumesExtendTest-210033117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:44:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1995538372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b4067b8-ecf0-4255-a175-37de5ecb69d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527a9a56bd0049be8dc2fb79806cb171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:44:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:44:01Z,use_quota=True,user_id='db6f39caeef845c6a8ad01923d44e2ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:44:01 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-85a388ed-2c5d-4def-9700-e66d8db2910d tempest-VolumesExtendTest-210033117 None] Creating volume 2b4067b8-ecf0-4255-a175-37de5ecb69d4 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:44:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-85a388ed-2c5d-4def-9700-e66d8db2910d tempest-VolumesExtendTest-210033117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-85a388ed-2c5d-4def-9700-e66d8db2910d tempest-VolumesExtendTest-210033117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:01 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-85a388ed-2c5d-4def-9700-e66d8db2910d tempest-VolumesExtendTest-210033117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:44:01 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-85a388ed-2c5d-4def-9700-e66d8db2910d tempest-VolumesExtendTest-210033117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:44:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-85a388ed-2c5d-4def-9700-e66d8db2910d tempest-VolumesExtendTest-210033117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:01 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-85a388ed-2c5d-4def-9700-e66d8db2910d tempest-VolumesExtendTest-210033117 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:44:01 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-85a388ed-2c5d-4def-9700-e66d8db2910d tempest-VolumesExtendTest-210033117 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:44:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-85a388ed-2c5d-4def-9700-e66d8db2910d tempest-VolumesExtendTest-210033117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:01 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-9c3b5fbc-8277-4367-b981-76af3c0e55f9 tempest-VolumesExtendTest-210033117 None] Deleted volume successfully. Jul 10 06:44:01 devstack sudo[96159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4 1073741824 Jul 10 06:44:01 devstack sudo[96159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:01 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-9c3b5fbc-8277-4367-b981-76af3c0e55f9 tempest-VolumesExtendTest-210033117 None] Lock "cinder-b40721b6-84e4-48c6-8bbc-51a3009adaf1-delete_volume" released by "delete_volume" :: held 4.234s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:44:01 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-d9a96f0b-9083-4dcf-93a0-8bac0a942d6d tempest-VolumesCloneTest-589924206 None] Created reservations ['49de9661-24fe-4aff-be5d-e764c34ea727', '9fb35c01-369e-4dd0-8f02-b7e047ea4ec6', 'bd2e09be-ab40-4bf8-90e3-a3626f77e89c', 'd5fa4c20-8231-41a0-9549-91fb7cada0e2'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:44:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d9a96f0b-9083-4dcf-93a0-8bac0a942d6d tempest-VolumesCloneTest-589924206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d9a96f0b-9083-4dcf-93a0-8bac0a942d6d tempest-VolumesCloneTest-589924206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:01 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-d9a96f0b-9083-4dcf-93a0-8bac0a942d6d tempest-VolumesCloneTest-589924206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:44:01 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-d9a96f0b-9083-4dcf-93a0-8bac0a942d6d tempest-VolumesCloneTest-589924206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:44:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d9a96f0b-9083-4dcf-93a0-8bac0a942d6d tempest-VolumesCloneTest-589924206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d9a96f0b-9083-4dcf-93a0-8bac0a942d6d tempest-VolumesCloneTest-589924206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:01 devstack sudo[96161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:44:01 devstack sudo[96161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:02 devstack sudo[96161]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:02 devstack sudo[96159]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d9a96f0b-9083-4dcf-93a0-8bac0a942d6d tempest-VolumesCloneTest-589924206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.892s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:02 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-d9a96f0b-9083-4dcf-93a0-8bac0a942d6d tempest-VolumesCloneTest-589924206 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:44:02 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-d9a96f0b-9083-4dcf-93a0-8bac0a942d6d tempest-VolumesCloneTest-589924206 None] Deleted volume successfully. Jul 10 06:44:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-85a388ed-2c5d-4def-9700-e66d8db2910d tempest-VolumesExtendTest-210033117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4 1073741824" returned: 0 in 1.117s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:02 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d9a96f0b-9083-4dcf-93a0-8bac0a942d6d tempest-VolumesCloneTest-589924206 None] Lock "cinder-470e3323-cdb9-4bd2-9aa3-6531af04f768-delete_volume" released by "delete_volume" :: held 3.550s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:44:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-85a388ed-2c5d-4def-9700-e66d8db2910d tempest-VolumesExtendTest-210033117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:02 devstack sudo[96168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4 Jul 10 06:44:02 devstack sudo[96168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:03 devstack sudo[96168]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-85a388ed-2c5d-4def-9700-e66d8db2910d tempest-VolumesExtendTest-210033117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4" returned: 0 in 0.775s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:03 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-85a388ed-2c5d-4def-9700-e66d8db2910d tempest-VolumesExtendTest-210033117 None] <== create_volume: return (1953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:44:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-85a388ed-2c5d-4def-9700-e66d8db2910d tempest-VolumesExtendTest-210033117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.960s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:03 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-85a388ed-2c5d-4def-9700-e66d8db2910d tempest-VolumesExtendTest-210033117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e726bf5-32d9-4c8b-9fee-99a734d470db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:03 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-85a388ed-2c5d-4def-9700-e66d8db2910d tempest-VolumesExtendTest-210033117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf17bc2-51df-42f3-b4c7-fa644efc4cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:03 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-85a388ed-2c5d-4def-9700-e66d8db2910d tempest-VolumesExtendTest-210033117 None] Volume volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4 (2b4067b8-ecf0-4255-a175-37de5ecb69d4): created successfully Jul 10 06:44:03 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-85a388ed-2c5d-4def-9700-e66d8db2910d tempest-VolumesExtendTest-210033117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf17bc2-51df-42f3-b4c7-fa644efc4cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:03 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-85a388ed-2c5d-4def-9700-e66d8db2910d tempest-VolumesExtendTest-210033117 None] Flow 'volume_create_manager' (af058d1f-d08a-4fa7-b55a-500ad9f1efb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:44:03 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-85a388ed-2c5d-4def-9700-e66d8db2910d tempest-VolumesExtendTest-210033117 None] Created volume successfully. Jul 10 06:44:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-eb0bd263-b259-4156-8117-d81d9edf9a2e tempest-VolumesExtendTest-210033117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-eb0bd263-b259-4156-8117-d81d9edf9a2e tempest-VolumesExtendTest-210033117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:04 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-eb0bd263-b259-4156-8117-d81d9edf9a2e tempest-VolumesExtendTest-210033117 None] Creating offline snapshot 5426b832-5d22-41ac-a7ee-1aa96e6eab0a of volume 2b4067b8-ecf0-4255-a175-37de5ecb69d4 {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:44:04 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d503d2c-93d4-4bdb-a549-a670bc3093cc]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:44:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-eb0bd263-b259-4156-8117-d81d9edf9a2e tempest-VolumesExtendTest-210033117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:05 devstack sudo[96192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4 Jul 10 06:44:05 devstack sudo[96192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:05 devstack sudo[96192]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-eb0bd263-b259-4156-8117-d81d9edf9a2e tempest-VolumesExtendTest-210033117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4" returned: 0 in 1.051s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-eb0bd263-b259-4156-8117-d81d9edf9a2e tempest-VolumesExtendTest-210033117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4.5426b832-5d22-41ac-a7ee-1aa96e6eab0a 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:05 devstack sudo[96200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4.5426b832-5d22-41ac-a7ee-1aa96e6eab0a 1G Jul 10 06:44:05 devstack sudo[96200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:06 devstack sudo[96200]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-eb0bd263-b259-4156-8117-d81d9edf9a2e tempest-VolumesExtendTest-210033117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4.5426b832-5d22-41ac-a7ee-1aa96e6eab0a 1G" returned: 0 in 0.966s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-eb0bd263-b259-4156-8117-d81d9edf9a2e tempest-VolumesExtendTest-210033117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4.5426b832-5d22-41ac-a7ee-1aa96e6eab0a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:06 devstack sudo[96205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4.5426b832-5d22-41ac-a7ee-1aa96e6eab0a Jul 10 06:44:06 devstack sudo[96205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:07 devstack sudo[96205]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-eb0bd263-b259-4156-8117-d81d9edf9a2e tempest-VolumesExtendTest-210033117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4.5426b832-5d22-41ac-a7ee-1aa96e6eab0a" returned: 0 in 0.901s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:07 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-eb0bd263-b259-4156-8117-d81d9edf9a2e tempest-VolumesExtendTest-210033117 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4.5426b832-5d22-41ac-a7ee-1aa96e6eab0a is being set with open permissions: ugo+rw Jul 10 06:44:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-eb0bd263-b259-4156-8117-d81d9edf9a2e tempest-VolumesExtendTest-210033117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4.5426b832-5d22-41ac-a7ee-1aa96e6eab0a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:07 devstack sudo[96212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4.5426b832-5d22-41ac-a7ee-1aa96e6eab0a Jul 10 06:44:07 devstack sudo[96212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:08 devstack sudo[96212]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-eb0bd263-b259-4156-8117-d81d9edf9a2e tempest-VolumesExtendTest-210033117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4.5426b832-5d22-41ac-a7ee-1aa96e6eab0a" returned: 0 in 0.772s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:08 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:UPDATE=119,cinder:SELECT=95,cinder:INSERT=35,cinder:DELETE=8 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:44:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-eb0bd263-b259-4156-8117-d81d9edf9a2e tempest-VolumesExtendTest-210033117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:08 devstack sudo[96215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4.info Jul 10 06:44:08 devstack sudo[96215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:09 devstack sudo[96215]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-eb0bd263-b259-4156-8117-d81d9edf9a2e tempest-VolumesExtendTest-210033117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4.info" returned: 0 in 0.764s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:09 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-eb0bd263-b259-4156-8117-d81d9edf9a2e tempest-VolumesExtendTest-210033117 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4.info is being set with open permissions: ugo+rw Jul 10 06:44:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-eb0bd263-b259-4156-8117-d81d9edf9a2e tempest-VolumesExtendTest-210033117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:09 devstack sudo[96219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4.info Jul 10 06:44:09 devstack sudo[96219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:10 devstack sudo[96219]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-eb0bd263-b259-4156-8117-d81d9edf9a2e tempest-VolumesExtendTest-210033117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4.info" returned: 0 in 0.759s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-eb0bd263-b259-4156-8117-d81d9edf9a2e tempest-VolumesExtendTest-210033117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.357s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:10 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-eb0bd263-b259-4156-8117-d81d9edf9a2e tempest-VolumesExtendTest-210033117 None] Create snapshot completed successfully Jul 10 06:44:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-49c7737f-5ff0-4ffb-87a7-3e883f826db2 tempest-VolumesExtendTest-210033117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-49c7737f-5ff0-4ffb-87a7-3e883f826db2 tempest-VolumesExtendTest-210033117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:11 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f91dac2-8b48-4cd5-a807-6893d3cd195d]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:44:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-49c7737f-5ff0-4ffb-87a7-3e883f826db2 tempest-VolumesExtendTest-210033117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:11 devstack sudo[96222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4 Jul 10 06:44:11 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:12 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-380b6100-9827-41b5-8abe-79b2c36b2686 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:44:12 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-380b6100-9827-41b5-8abe-79b2c36b2686 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Flow 'volume_create_manager' (24f59678-785a-4afb-8639-423e0ada5f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:44:12 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-380b6100-9827-41b5-8abe-79b2c36b2686 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b6dd55-ee5e-4035-ac98-bad3581c09e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:12 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-380b6100-9827-41b5-8abe-79b2c36b2686 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b6dd55-ee5e-4035-ac98-bad3581c09e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:44:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-927752463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73dcf9b8-b12f-487a-a415-e44551b6b4a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9be9f72f8184cc7b8b62543a744a4fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:44:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:44:12Z,use_quota=True,user_id='1b740ec2ce74431d872455357f76f035',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:12 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-380b6100-9827-41b5-8abe-79b2c36b2686 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd552f32-812f-4b92-8284-d3ab28132412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:12 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-380b6100-9827-41b5-8abe-79b2c36b2686 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd552f32-812f-4b92-8284-d3ab28132412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:12 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-380b6100-9827-41b5-8abe-79b2c36b2686 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7bf7671-0f36-4f4f-826b-11f93c931e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:12 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-380b6100-9827-41b5-8abe-79b2c36b2686 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7bf7671-0f36-4f4f-826b-11f93c931e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73dcf9b8-b12f-487a-a415-e44551b6b4a4', 'volume_name': 'volume-73dcf9b8-b12f-487a-a415-e44551b6b4a4', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:12 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-380b6100-9827-41b5-8abe-79b2c36b2686 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ead0255-d1be-406b-b868-1647a029e35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:12 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-380b6100-9827-41b5-8abe-79b2c36b2686 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ead0255-d1be-406b-b868-1647a029e35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:12 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-380b6100-9827-41b5-8abe-79b2c36b2686 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1871aef-977b-4d01-967f-c8c4e55770c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:12 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-380b6100-9827-41b5-8abe-79b2c36b2686 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Volume 73dcf9b8-b12f-487a-a415-e44551b6b4a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73dcf9b8-b12f-487a-a415-e44551b6b4a4', 'volume_size': 1} Jul 10 06:44:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-380b6100-9827-41b5-8abe-79b2c36b2686 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:12 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-49c7737f-5ff0-4ffb-87a7-3e883f826db2 tempest-VolumesExtendTest-210033117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4" returned: 0 in 1.012s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-49c7737f-5ff0-4ffb-87a7-3e883f826db2 tempest-VolumesExtendTest-210033117 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4.5426b832-5d22-41ac-a7ee-1aa96e6eab0a 2G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-49c7737f-5ff0-4ffb-87a7-3e883f826db2 tempest-VolumesExtendTest-210033117 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4.5426b832-5d22-41ac-a7ee-1aa96e6eab0a 2G" returned: 0 in 0.243s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-49c7737f-5ff0-4ffb-87a7-3e883f826db2 tempest-VolumesExtendTest-210033117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.311s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-380b6100-9827-41b5-8abe-79b2c36b2686 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.429s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:12 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-380b6100-9827-41b5-8abe-79b2c36b2686 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:44:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-927752463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73dcf9b8-b12f-487a-a415-e44551b6b4a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9be9f72f8184cc7b8b62543a744a4fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:44:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:44:12Z,use_quota=True,user_id='1b740ec2ce74431d872455357f76f035',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:44:12 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-380b6100-9827-41b5-8abe-79b2c36b2686 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Creating volume 73dcf9b8-b12f-487a-a415-e44551b6b4a4 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:44:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-380b6100-9827-41b5-8abe-79b2c36b2686 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-380b6100-9827-41b5-8abe-79b2c36b2686 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:12 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-380b6100-9827-41b5-8abe-79b2c36b2686 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:44:12 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-380b6100-9827-41b5-8abe-79b2c36b2686 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:44:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-380b6100-9827-41b5-8abe-79b2c36b2686 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:12 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-380b6100-9827-41b5-8abe-79b2c36b2686 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:44:12 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-380b6100-9827-41b5-8abe-79b2c36b2686 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:44:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-380b6100-9827-41b5-8abe-79b2c36b2686 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-73dcf9b8-b12f-487a-a415-e44551b6b4a4 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:12 devstack sudo[96231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-73dcf9b8-b12f-487a-a415-e44551b6b4a4 1073741824 Jul 10 06:44:12 devstack sudo[96231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:12 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-49c7737f-5ff0-4ffb-87a7-3e883f826db2 tempest-VolumesExtendTest-210033117 None] Extend volume completed successfully. Jul 10 06:44:13 devstack sudo[96231]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-380b6100-9827-41b5-8abe-79b2c36b2686 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-73dcf9b8-b12f-487a-a415-e44551b6b4a4 1073741824" returned: 0 in 0.939s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-380b6100-9827-41b5-8abe-79b2c36b2686 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-73dcf9b8-b12f-487a-a415-e44551b6b4a4 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:13 devstack sudo[96237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-73dcf9b8-b12f-487a-a415-e44551b6b4a4 Jul 10 06:44:13 devstack sudo[96237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:13 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f1796ec5-ecb8-4356-8680-0f79b1e9c227 tempest-VolumesExtendTest-210033117 None] Acquiring lock "cinder-5426b832-5d22-41ac-a7ee-1aa96e6eab0a-delete_snapshot" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:44:13 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f1796ec5-ecb8-4356-8680-0f79b1e9c227 tempest-VolumesExtendTest-210033117 None] Lock "cinder-5426b832-5d22-41ac-a7ee-1aa96e6eab0a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:44:13 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f1796ec5-ecb8-4356-8680-0f79b1e9c227 tempest-VolumesExtendTest-210033117 None] Acquiring lock "cinder-quobyte-2b4067b8-ecf0-4255-a175-37de5ecb69d4" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:44:13 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f1796ec5-ecb8-4356-8680-0f79b1e9c227 tempest-VolumesExtendTest-210033117 None] Lock "cinder-quobyte-2b4067b8-ecf0-4255-a175-37de5ecb69d4" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:44:13 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f1796ec5-ecb8-4356-8680-0f79b1e9c227 tempest-VolumesExtendTest-210033117 None] Acquiring lock "cinder-quobyte-5426b832-5d22-41ac-a7ee-1aa96e6eab0a" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:44:13 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f1796ec5-ecb8-4356-8680-0f79b1e9c227 tempest-VolumesExtendTest-210033117 None] Lock "cinder-quobyte-5426b832-5d22-41ac-a7ee-1aa96e6eab0a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:44:13 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-f1796ec5-ecb8-4356-8680-0f79b1e9c227 tempest-VolumesExtendTest-210033117 None] Deleting offline snapshot 5426b832-5d22-41ac-a7ee-1aa96e6eab0a of volume 2b4067b8-ecf0-4255-a175-37de5ecb69d4 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:44:13 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-f1796ec5-ecb8-4356-8680-0f79b1e9c227 tempest-VolumesExtendTest-210033117 None] snapshot_file for this snap is: volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4.5426b832-5d22-41ac-a7ee-1aa96e6eab0a {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:44:13 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1675080-e2d2-43ae-8e65-a3fe85394ea3]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:44:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1796ec5-ecb8-4356-8680-0f79b1e9c227 tempest-VolumesExtendTest-210033117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4.5426b832-5d22-41ac-a7ee-1aa96e6eab0a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:14 devstack sudo[96239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4.5426b832-5d22-41ac-a7ee-1aa96e6eab0a Jul 10 06:44:14 devstack sudo[96239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:14 devstack sudo[96237]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-380b6100-9827-41b5-8abe-79b2c36b2686 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-73dcf9b8-b12f-487a-a415-e44551b6b4a4" returned: 0 in 0.870s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:14 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-380b6100-9827-41b5-8abe-79b2c36b2686 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] <== create_volume: return (1880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:44:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-380b6100-9827-41b5-8abe-79b2c36b2686 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.884s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:14 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-380b6100-9827-41b5-8abe-79b2c36b2686 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1871aef-977b-4d01-967f-c8c4e55770c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73dcf9b8-b12f-487a-a415-e44551b6b4a4', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:14 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-380b6100-9827-41b5-8abe-79b2c36b2686 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (707e316c-8ec1-42db-92af-512f0985023d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:14 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-380b6100-9827-41b5-8abe-79b2c36b2686 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Volume volume-73dcf9b8-b12f-487a-a415-e44551b6b4a4 (73dcf9b8-b12f-487a-a415-e44551b6b4a4): created successfully Jul 10 06:44:14 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-380b6100-9827-41b5-8abe-79b2c36b2686 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (707e316c-8ec1-42db-92af-512f0985023d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:14 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-380b6100-9827-41b5-8abe-79b2c36b2686 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Flow 'volume_create_manager' (24f59678-785a-4afb-8639-423e0ada5f85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:44:14 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-380b6100-9827-41b5-8abe-79b2c36b2686 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Created volume successfully. Jul 10 06:44:14 devstack sudo[96239]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1796ec5-ecb8-4356-8680-0f79b1e9c227 tempest-VolumesExtendTest-210033117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4.5426b832-5d22-41ac-a7ee-1aa96e6eab0a" returned: 0 in 0.975s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:14 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-f1796ec5-ecb8-4356-8680-0f79b1e9c227 tempest-VolumesExtendTest-210033117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:44:14 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2976e0-20c4-431a-8444-de7a0c7f8a5e]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:44:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1796ec5-ecb8-4356-8680-0f79b1e9c227 tempest-VolumesExtendTest-210033117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:15 devstack sudo[96248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4 Jul 10 06:44:15 devstack sudo[96248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:16 devstack sudo[96248]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1796ec5-ecb8-4356-8680-0f79b1e9c227 tempest-VolumesExtendTest-210033117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4" returned: 0 in 1.350s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1796ec5-ecb8-4356-8680-0f79b1e9c227 tempest-VolumesExtendTest-210033117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4.5426b832-5d22-41ac-a7ee-1aa96e6eab0a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:16 devstack sudo[96289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4.5426b832-5d22-41ac-a7ee-1aa96e6eab0a Jul 10 06:44:16 devstack sudo[96289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:17 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a7b43e88-cbce-4a39-ac0c-195ff305c4b6 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Acquiring lock "cinder-73dcf9b8-b12f-487a-a415-e44551b6b4a4-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:44:17 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a7b43e88-cbce-4a39-ac0c-195ff305c4b6 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Lock "cinder-73dcf9b8-b12f-487a-a415-e44551b6b4a4-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:44:17 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a7b43e88-cbce-4a39-ac0c-195ff305c4b6 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Acquiring lock "cinder-quobyte-73dcf9b8-b12f-487a-a415-e44551b6b4a4" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:44:17 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a7b43e88-cbce-4a39-ac0c-195ff305c4b6 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Lock "cinder-quobyte-73dcf9b8-b12f-487a-a415-e44551b6b4a4" acquired by "delete_volume" :: waited 0.023s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:44:17 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[117df123-3054-40a0-a6ff-adb5a0cdafa6]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:44:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a7b43e88-cbce-4a39-ac0c-195ff305c4b6 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-73dcf9b8-b12f-487a-a415-e44551b6b4a4 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:17 devstack sudo[96295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-73dcf9b8-b12f-487a-a415-e44551b6b4a4 Jul 10 06:44:17 devstack sudo[96295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:17 devstack sudo[96289]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1796ec5-ecb8-4356-8680-0f79b1e9c227 tempest-VolumesExtendTest-210033117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4.5426b832-5d22-41ac-a7ee-1aa96e6eab0a" returned: 0 in 1.194s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1796ec5-ecb8-4356-8680-0f79b1e9c227 tempest-VolumesExtendTest-210033117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4.5426b832-5d22-41ac-a7ee-1aa96e6eab0a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:17 devstack sudo[96297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4.5426b832-5d22-41ac-a7ee-1aa96e6eab0a Jul 10 06:44:17 devstack sudo[96297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:18 devstack sudo[96295]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a7b43e88-cbce-4a39-ac0c-195ff305c4b6 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-73dcf9b8-b12f-487a-a415-e44551b6b4a4" returned: 0 in 0.893s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a7b43e88-cbce-4a39-ac0c-195ff305c4b6 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-73dcf9b8-b12f-487a-a415-e44551b6b4a4 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:18 devstack sudo[96303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-73dcf9b8-b12f-487a-a415-e44551b6b4a4 Jul 10 06:44:18 devstack sudo[96303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:18 devstack sudo[96297]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1796ec5-ecb8-4356-8680-0f79b1e9c227 tempest-VolumesExtendTest-210033117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4.5426b832-5d22-41ac-a7ee-1aa96e6eab0a" returned: 0 in 0.809s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:18 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f1796ec5-ecb8-4356-8680-0f79b1e9c227 tempest-VolumesExtendTest-210033117 None] Lock "cinder-quobyte-5426b832-5d22-41ac-a7ee-1aa96e6eab0a" released by "_delete_snapshot" :: held 4.468s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:44:18 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f1796ec5-ecb8-4356-8680-0f79b1e9c227 tempest-VolumesExtendTest-210033117 None] Lock "cinder-quobyte-2b4067b8-ecf0-4255-a175-37de5ecb69d4" released by "delete_snapshot" :: held 4.501s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:44:18 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-f1796ec5-ecb8-4356-8680-0f79b1e9c227 tempest-VolumesExtendTest-210033117 None] Created reservations ['da6aeaa7-642e-4019-a89d-a38396a6bf89', 'b2a50ec5-3817-410f-bc02-9f947c23ce51', '01af3755-cc6a-48aa-90be-3795226b6a20', 'eb88ea61-4cee-4d7d-b51b-5f00af633161'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:44:18 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-f1796ec5-ecb8-4356-8680-0f79b1e9c227 tempest-VolumesExtendTest-210033117 None] Delete snapshot completed successfully. Jul 10 06:44:18 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f1796ec5-ecb8-4356-8680-0f79b1e9c227 tempest-VolumesExtendTest-210033117 None] Lock "cinder-5426b832-5d22-41ac-a7ee-1aa96e6eab0a-delete_snapshot" released by "delete_snapshot" :: held 4.679s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:44:18 devstack sudo[96303]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a7b43e88-cbce-4a39-ac0c-195ff305c4b6 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-73dcf9b8-b12f-487a-a415-e44551b6b4a4" returned: 0 in 0.743s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:18 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a7b43e88-cbce-4a39-ac0c-195ff305c4b6 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Lock "cinder-quobyte-73dcf9b8-b12f-487a-a415-e44551b6b4a4" released by "delete_volume" :: held 1.688s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:44:18 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-a7b43e88-cbce-4a39-ac0c-195ff305c4b6 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Created reservations ['d22db1c3-d47b-4a8e-87c2-aedce0946abc', 'bf11c265-8409-4b55-8067-48056dbd63d3', '2374a3dd-59eb-4c9b-ac95-5a648905d943', '5d99d348-b55e-410c-ac96-1f8e7da0d6cb'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:44:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a7b43e88-cbce-4a39-ac0c-195ff305c4b6 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a7b43e88-cbce-4a39-ac0c-195ff305c4b6 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:19 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-a7b43e88-cbce-4a39-ac0c-195ff305c4b6 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:44:19 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-a7b43e88-cbce-4a39-ac0c-195ff305c4b6 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:44:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a7b43e88-cbce-4a39-ac0c-195ff305c4b6 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a7b43e88-cbce-4a39-ac0c-195ff305c4b6 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:19 devstack sudo[96306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:44:19 devstack sudo[96306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:19 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1d77e97c-cd50-45dd-8c4e-deccfb662ee3 tempest-VolumesExtendTest-210033117 None] Acquiring lock "cinder-2b4067b8-ecf0-4255-a175-37de5ecb69d4-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:44:19 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1d77e97c-cd50-45dd-8c4e-deccfb662ee3 tempest-VolumesExtendTest-210033117 None] Lock "cinder-2b4067b8-ecf0-4255-a175-37de5ecb69d4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:44:19 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1d77e97c-cd50-45dd-8c4e-deccfb662ee3 tempest-VolumesExtendTest-210033117 None] Acquiring lock "cinder-quobyte-2b4067b8-ecf0-4255-a175-37de5ecb69d4" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:44:19 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1d77e97c-cd50-45dd-8c4e-deccfb662ee3 tempest-VolumesExtendTest-210033117 None] Lock "cinder-quobyte-2b4067b8-ecf0-4255-a175-37de5ecb69d4" acquired by "delete_volume" :: waited 0.030s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:44:19 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[472ba39f-3463-456c-98e7-82c30c8dc7f7]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:44:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1d77e97c-cd50-45dd-8c4e-deccfb662ee3 tempest-VolumesExtendTest-210033117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:19 devstack sudo[96309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4 Jul 10 06:44:19 devstack sudo[96309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:19 devstack sudo[96306]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a7b43e88-cbce-4a39-ac0c-195ff305c4b6 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.948s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:19 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-a7b43e88-cbce-4a39-ac0c-195ff305c4b6 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:44:19 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-a7b43e88-cbce-4a39-ac0c-195ff305c4b6 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Deleted volume successfully. Jul 10 06:44:20 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a7b43e88-cbce-4a39-ac0c-195ff305c4b6 tempest-VolumeQuotasNegativeTestJSON-1902904681 None] Lock "cinder-73dcf9b8-b12f-487a-a415-e44551b6b4a4-delete_volume" released by "delete_volume" :: held 2.924s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:44:20 devstack sudo[96309]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1d77e97c-cd50-45dd-8c4e-deccfb662ee3 tempest-VolumesExtendTest-210033117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4" returned: 0 in 1.056s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1d77e97c-cd50-45dd-8c4e-deccfb662ee3 tempest-VolumesExtendTest-210033117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:20 devstack sudo[96318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4 Jul 10 06:44:20 devstack sudo[96318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:21 devstack sudo[96318]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1d77e97c-cd50-45dd-8c4e-deccfb662ee3 tempest-VolumesExtendTest-210033117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b4067b8-ecf0-4255-a175-37de5ecb69d4" returned: 0 in 0.807s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:21 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1d77e97c-cd50-45dd-8c4e-deccfb662ee3 tempest-VolumesExtendTest-210033117 None] Lock "cinder-quobyte-2b4067b8-ecf0-4255-a175-37de5ecb69d4" released by "delete_volume" :: held 1.984s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:44:21 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-1d77e97c-cd50-45dd-8c4e-deccfb662ee3 tempest-VolumesExtendTest-210033117 None] Created reservations ['3fe6f41e-b957-4786-b81a-e6101aee6042', '67a92593-183a-46c5-a707-ad2a01ca691e', '2b222123-2b99-465e-a7a5-5fc18e7db6bc', 'ec653ba2-896a-484d-bf9b-445b4e40bc7b'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:44:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-1d77e97c-cd50-45dd-8c4e-deccfb662ee3 tempest-VolumesExtendTest-210033117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-1d77e97c-cd50-45dd-8c4e-deccfb662ee3 tempest-VolumesExtendTest-210033117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-1d77e97c-cd50-45dd-8c4e-deccfb662ee3 tempest-VolumesExtendTest-210033117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:44:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-1d77e97c-cd50-45dd-8c4e-deccfb662ee3 tempest-VolumesExtendTest-210033117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:44:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-1d77e97c-cd50-45dd-8c4e-deccfb662ee3 tempest-VolumesExtendTest-210033117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1d77e97c-cd50-45dd-8c4e-deccfb662ee3 tempest-VolumesExtendTest-210033117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:21 devstack sudo[96321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:44:21 devstack sudo[96321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:21 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:44:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:44:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:44:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:21 devstack sudo[96324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:44:21 devstack sudo[96324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:22 devstack sudo[96324]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.014s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:22 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:44:22 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager._thread_info {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:44:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread count: 28 {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:44:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread info: [<_MainThread(MainThread, started 139245706264704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:44:22 devstack sudo[96321]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1d77e97c-cd50-45dd-8c4e-deccfb662ee3 tempest-VolumesExtendTest-210033117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.317s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:22 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-1d77e97c-cd50-45dd-8c4e-deccfb662ee3 tempest-VolumesExtendTest-210033117 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:44:22 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-1d77e97c-cd50-45dd-8c4e-deccfb662ee3 tempest-VolumesExtendTest-210033117 None] Deleted volume successfully. Jul 10 06:44:23 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1d77e97c-cd50-45dd-8c4e-deccfb662ee3 tempest-VolumesExtendTest-210033117 None] Lock "cinder-2b4067b8-ecf0-4255-a175-37de5ecb69d4-delete_volume" released by "delete_volume" :: held 3.700s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:44:23 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-a18ea82e-ab9f-4173-bfca-c2d8a5f5b02e tempest-VolumesSnapshotTestJSON-2129310836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:44:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a18ea82e-ab9f-4173-bfca-c2d8a5f5b02e tempest-VolumesSnapshotTestJSON-2129310836 None] Flow 'volume_create_manager' (10beab41-a351-4c89-9c7a-693130e4dcf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:44:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a18ea82e-ab9f-4173-bfca-c2d8a5f5b02e tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5cbfe0c-53c4-4213-b043-577a1e46c563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a18ea82e-ab9f-4173-bfca-c2d8a5f5b02e tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5cbfe0c-53c4-4213-b043-577a1e46c563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1949376248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d1df4cd-f187-43fb-bac8-d733281e130c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d624da3b98c346bab40a859ada5116c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:44:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:44:24Z,use_quota=True,user_id='d4bd965c4f35412b9dea43d58771b551',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a18ea82e-ab9f-4173-bfca-c2d8a5f5b02e tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16147466-f917-4e19-a539-1f22fa914460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a18ea82e-ab9f-4173-bfca-c2d8a5f5b02e tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16147466-f917-4e19-a539-1f22fa914460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a18ea82e-ab9f-4173-bfca-c2d8a5f5b02e tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d64357b9-a637-4290-b386-2268a97f830f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a18ea82e-ab9f-4173-bfca-c2d8a5f5b02e tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d64357b9-a637-4290-b386-2268a97f830f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d1df4cd-f187-43fb-bac8-d733281e130c', 'volume_name': 'volume-9d1df4cd-f187-43fb-bac8-d733281e130c', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a18ea82e-ab9f-4173-bfca-c2d8a5f5b02e tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aef8644-7a7f-433b-920b-a96b3ac068ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a18ea82e-ab9f-4173-bfca-c2d8a5f5b02e tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aef8644-7a7f-433b-920b-a96b3ac068ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a18ea82e-ab9f-4173-bfca-c2d8a5f5b02e tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08b55335-7615-4772-af32-8b9232eba0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:23 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-a18ea82e-ab9f-4173-bfca-c2d8a5f5b02e tempest-VolumesSnapshotTestJSON-2129310836 None] Volume 9d1df4cd-f187-43fb-bac8-d733281e130c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d1df4cd-f187-43fb-bac8-d733281e130c', 'volume_size': 1} Jul 10 06:44:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a18ea82e-ab9f-4173-bfca-c2d8a5f5b02e tempest-VolumesSnapshotTestJSON-2129310836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a18ea82e-ab9f-4173-bfca-c2d8a5f5b02e tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:23 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-a18ea82e-ab9f-4173-bfca-c2d8a5f5b02e tempest-VolumesSnapshotTestJSON-2129310836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1949376248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d1df4cd-f187-43fb-bac8-d733281e130c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d624da3b98c346bab40a859ada5116c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:44:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:44:24Z,use_quota=True,user_id='d4bd965c4f35412b9dea43d58771b551',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:44:23 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-a18ea82e-ab9f-4173-bfca-c2d8a5f5b02e tempest-VolumesSnapshotTestJSON-2129310836 None] Creating volume 9d1df4cd-f187-43fb-bac8-d733281e130c {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:44:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a18ea82e-ab9f-4173-bfca-c2d8a5f5b02e tempest-VolumesSnapshotTestJSON-2129310836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a18ea82e-ab9f-4173-bfca-c2d8a5f5b02e tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:23 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-a18ea82e-ab9f-4173-bfca-c2d8a5f5b02e tempest-VolumesSnapshotTestJSON-2129310836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:44:23 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-a18ea82e-ab9f-4173-bfca-c2d8a5f5b02e tempest-VolumesSnapshotTestJSON-2129310836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:44:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a18ea82e-ab9f-4173-bfca-c2d8a5f5b02e tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:23 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-a18ea82e-ab9f-4173-bfca-c2d8a5f5b02e tempest-VolumesSnapshotTestJSON-2129310836 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:44:23 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-a18ea82e-ab9f-4173-bfca-c2d8a5f5b02e tempest-VolumesSnapshotTestJSON-2129310836 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:44:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a18ea82e-ab9f-4173-bfca-c2d8a5f5b02e tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:23 devstack sudo[96343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c 1073741824 Jul 10 06:44:23 devstack sudo[96343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:24 devstack sudo[96343]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a18ea82e-ab9f-4173-bfca-c2d8a5f5b02e tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c 1073741824" returned: 0 in 1.090s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a18ea82e-ab9f-4173-bfca-c2d8a5f5b02e tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:24 devstack sudo[96350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c Jul 10 06:44:24 devstack sudo[96350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:25 devstack sudo[96350]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a18ea82e-ab9f-4173-bfca-c2d8a5f5b02e tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c" returned: 0 in 0.772s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:25 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-a18ea82e-ab9f-4173-bfca-c2d8a5f5b02e tempest-VolumesSnapshotTestJSON-2129310836 None] <== create_volume: return (1926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:44:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a18ea82e-ab9f-4173-bfca-c2d8a5f5b02e tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.932s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:25 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a18ea82e-ab9f-4173-bfca-c2d8a5f5b02e tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08b55335-7615-4772-af32-8b9232eba0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d1df4cd-f187-43fb-bac8-d733281e130c', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:25 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a18ea82e-ab9f-4173-bfca-c2d8a5f5b02e tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b53bcf80-4df3-47f0-92c2-71c257d310e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:25 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-a18ea82e-ab9f-4173-bfca-c2d8a5f5b02e tempest-VolumesSnapshotTestJSON-2129310836 None] Volume volume-9d1df4cd-f187-43fb-bac8-d733281e130c (9d1df4cd-f187-43fb-bac8-d733281e130c): created successfully Jul 10 06:44:25 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a18ea82e-ab9f-4173-bfca-c2d8a5f5b02e tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b53bcf80-4df3-47f0-92c2-71c257d310e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:25 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a18ea82e-ab9f-4173-bfca-c2d8a5f5b02e tempest-VolumesSnapshotTestJSON-2129310836 None] Flow 'volume_create_manager' (10beab41-a351-4c89-9c7a-693130e4dcf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:44:25 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-a18ea82e-ab9f-4173-bfca-c2d8a5f5b02e tempest-VolumesSnapshotTestJSON-2129310836 None] Created volume successfully. Jul 10 06:44:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5528aeb8-dad3-43b5-8692-adf4026aac22 tempest-VolumesSnapshotTestJSON-2129310836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5528aeb8-dad3-43b5-8692-adf4026aac22 tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:27 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-5528aeb8-dad3-43b5-8692-adf4026aac22 tempest-VolumesSnapshotTestJSON-2129310836 None] Creating offline snapshot 15380a6a-655b-4943-9211-6b12362260bd of volume 9d1df4cd-f187-43fb-bac8-d733281e130c {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:44:27 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cdd8bbe-e650-4e6e-828e-9bb23c17d924 tempest-VolumesGetTest-1773245057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:44:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-4cdd8bbe-e650-4e6e-828e-9bb23c17d924 tempest-VolumesGetTest-1773245057 None] Flow 'volume_create_manager' (d72edace-87d5-42bf-a6ae-587f28ce401e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:44:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-4cdd8bbe-e650-4e6e-828e-9bb23c17d924 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a42e6176-796b-4ed4-b088-08248451722e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:27 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c912e6a-c259-4499-b5cc-5157ff823754]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:44:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5528aeb8-dad3-43b5-8692-adf4026aac22 tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-4cdd8bbe-e650-4e6e-828e-9bb23c17d924 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a42e6176-796b-4ed4-b088-08248451722e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-634897966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad78acbc-2d2a-4e9e-86b6-4ceb023e1a94,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e516fd258b49497d9b6fe259af09b0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:44:27Z,use_quota=True,user_id='3b01103b9e864780af5a6824d10744f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-4cdd8bbe-e650-4e6e-828e-9bb23c17d924 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf689c16-518c-472f-9840-5dc8fe37af83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-4cdd8bbe-e650-4e6e-828e-9bb23c17d924 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf689c16-518c-472f-9840-5dc8fe37af83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-4cdd8bbe-e650-4e6e-828e-9bb23c17d924 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1deef3f-0eab-43ef-8d62-23b66d4839b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-4cdd8bbe-e650-4e6e-828e-9bb23c17d924 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1deef3f-0eab-43ef-8d62-23b66d4839b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad78acbc-2d2a-4e9e-86b6-4ceb023e1a94', 'volume_name': 'volume-ad78acbc-2d2a-4e9e-86b6-4ceb023e1a94', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-4cdd8bbe-e650-4e6e-828e-9bb23c17d924 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45a1d32e-42ef-4db9-81bb-369b6b5d7c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-4cdd8bbe-e650-4e6e-828e-9bb23c17d924 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45a1d32e-42ef-4db9-81bb-369b6b5d7c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-4cdd8bbe-e650-4e6e-828e-9bb23c17d924 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e12c9ee9-6e94-469b-97f8-a66f5faf668e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:27 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-4cdd8bbe-e650-4e6e-828e-9bb23c17d924 tempest-VolumesGetTest-1773245057 None] Volume ad78acbc-2d2a-4e9e-86b6-4ceb023e1a94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad78acbc-2d2a-4e9e-86b6-4ceb023e1a94', 'volume_size': 1} Jul 10 06:44:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-4cdd8bbe-e650-4e6e-828e-9bb23c17d924 tempest-VolumesGetTest-1773245057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:27 devstack sudo[96353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c Jul 10 06:44:27 devstack sudo[96353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:28 devstack sudo[96353]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5528aeb8-dad3-43b5-8692-adf4026aac22 tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c" returned: 0 in 1.132s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5528aeb8-dad3-43b5-8692-adf4026aac22 tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c.15380a6a-655b-4943-9211-6b12362260bd 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:28 devstack sudo[96393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c.15380a6a-655b-4943-9211-6b12362260bd 1G Jul 10 06:44:28 devstack sudo[96393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:29 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc35d9fe-cc3a-4a60-bb50-6f8ad88ab9e1 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:44:29 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-cc35d9fe-cc3a-4a60-bb50-6f8ad88ab9e1 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Flow 'volume_create_manager' (713d83b4-d392-4518-96ce-ba0b34fa2300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:44:29 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-cc35d9fe-cc3a-4a60-bb50-6f8ad88ab9e1 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06f0c269-031b-4a0f-95fa-eb63c161c2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:29 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-cc35d9fe-cc3a-4a60-bb50-6f8ad88ab9e1 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06f0c269-031b-4a0f-95fa-eb63c161c2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1017315841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=336a9799-3c3d-4309-8eb5-e2c5580ea138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8cb257f5abb490fb3053dbcafa69097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:44:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:44:29Z,use_quota=True,user_id='6c44b53fd443497694d1416a80385f55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27faafe6-a500-4df3-889b-bc5c5df39876),volume_type_id=27faafe6-a500-4df3-889b-bc5c5df39876)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:29 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-cc35d9fe-cc3a-4a60-bb50-6f8ad88ab9e1 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2555aae3-9685-4dea-94bd-6039edf51965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:29 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-cc35d9fe-cc3a-4a60-bb50-6f8ad88ab9e1 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2555aae3-9685-4dea-94bd-6039edf51965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:29 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-cc35d9fe-cc3a-4a60-bb50-6f8ad88ab9e1 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6a3dbe2-a660-439e-a129-17f3084406ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:29 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-cc35d9fe-cc3a-4a60-bb50-6f8ad88ab9e1 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6a3dbe2-a660-439e-a129-17f3084406ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '336a9799-3c3d-4309-8eb5-e2c5580ea138', 'volume_name': 'volume-336a9799-3c3d-4309-8eb5-e2c5580ea138', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:29 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-cc35d9fe-cc3a-4a60-bb50-6f8ad88ab9e1 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cab4d193-bdfc-44d0-8c66-1e6080358ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:29 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-cc35d9fe-cc3a-4a60-bb50-6f8ad88ab9e1 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cab4d193-bdfc-44d0-8c66-1e6080358ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:29 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-cc35d9fe-cc3a-4a60-bb50-6f8ad88ab9e1 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cad4c11c-5acd-400b-8480-b65afd1b47fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:29 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-cc35d9fe-cc3a-4a60-bb50-6f8ad88ab9e1 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Volume 336a9799-3c3d-4309-8eb5-e2c5580ea138: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-336a9799-3c3d-4309-8eb5-e2c5580ea138', 'volume_size': 1} Jul 10 06:44:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-cc35d9fe-cc3a-4a60-bb50-6f8ad88ab9e1 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:29 devstack sudo[96393]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5528aeb8-dad3-43b5-8692-adf4026aac22 tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c.15380a6a-655b-4943-9211-6b12362260bd 1G" returned: 0 in 1.028s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5528aeb8-dad3-43b5-8692-adf4026aac22 tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d1df4cd-f187-43fb-bac8-d733281e130c -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c.15380a6a-655b-4943-9211-6b12362260bd {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:29 devstack sudo[96412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d1df4cd-f187-43fb-bac8-d733281e130c -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c.15380a6a-655b-4943-9211-6b12362260bd Jul 10 06:44:29 devstack sudo[96412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:30 devstack sudo[96412]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5528aeb8-dad3-43b5-8692-adf4026aac22 tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d1df4cd-f187-43fb-bac8-d733281e130c -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c.15380a6a-655b-4943-9211-6b12362260bd" returned: 0 in 0.733s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:30 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-5528aeb8-dad3-43b5-8692-adf4026aac22 tempest-VolumesSnapshotTestJSON-2129310836 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c.15380a6a-655b-4943-9211-6b12362260bd is being set with open permissions: ugo+rw Jul 10 06:44:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5528aeb8-dad3-43b5-8692-adf4026aac22 tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c.15380a6a-655b-4943-9211-6b12362260bd {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:30 devstack sudo[96437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c.15380a6a-655b-4943-9211-6b12362260bd Jul 10 06:44:30 devstack sudo[96437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:30 devstack sudo[96437]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5528aeb8-dad3-43b5-8692-adf4026aac22 tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c.15380a6a-655b-4943-9211-6b12362260bd" returned: 0 in 0.708s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5528aeb8-dad3-43b5-8692-adf4026aac22 tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:30 devstack sudo[96448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c.info Jul 10 06:44:30 devstack sudo[96448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:31 devstack sudo[96448]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5528aeb8-dad3-43b5-8692-adf4026aac22 tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c.info" returned: 0 in 0.731s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:31 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-5528aeb8-dad3-43b5-8692-adf4026aac22 tempest-VolumesSnapshotTestJSON-2129310836 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c.info is being set with open permissions: ugo+rw Jul 10 06:44:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5528aeb8-dad3-43b5-8692-adf4026aac22 tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:31 devstack sudo[96451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c.info Jul 10 06:44:31 devstack sudo[96451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:32 devstack sudo[96451]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5528aeb8-dad3-43b5-8692-adf4026aac22 tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c.info" returned: 0 in 0.725s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5528aeb8-dad3-43b5-8692-adf4026aac22 tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.199s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-4cdd8bbe-e650-4e6e-828e-9bb23c17d924 tempest-VolumesGetTest-1773245057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.067s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:32 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-4cdd8bbe-e650-4e6e-828e-9bb23c17d924 tempest-VolumesGetTest-1773245057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-634897966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad78acbc-2d2a-4e9e-86b6-4ceb023e1a94,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e516fd258b49497d9b6fe259af09b0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:44:27Z,use_quota=True,user_id='3b01103b9e864780af5a6824d10744f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:44:32 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-4cdd8bbe-e650-4e6e-828e-9bb23c17d924 tempest-VolumesGetTest-1773245057 None] Creating volume ad78acbc-2d2a-4e9e-86b6-4ceb023e1a94 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:44:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-4cdd8bbe-e650-4e6e-828e-9bb23c17d924 tempest-VolumesGetTest-1773245057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-4cdd8bbe-e650-4e6e-828e-9bb23c17d924 tempest-VolumesGetTest-1773245057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:32 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-4cdd8bbe-e650-4e6e-828e-9bb23c17d924 tempest-VolumesGetTest-1773245057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:44:32 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-4cdd8bbe-e650-4e6e-828e-9bb23c17d924 tempest-VolumesGetTest-1773245057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:44:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-4cdd8bbe-e650-4e6e-828e-9bb23c17d924 tempest-VolumesGetTest-1773245057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:32 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-4cdd8bbe-e650-4e6e-828e-9bb23c17d924 tempest-VolumesGetTest-1773245057 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:44:32 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-4cdd8bbe-e650-4e6e-828e-9bb23c17d924 tempest-VolumesGetTest-1773245057 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:44:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-4cdd8bbe-e650-4e6e-828e-9bb23c17d924 tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ad78acbc-2d2a-4e9e-86b6-4ceb023e1a94 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:32 devstack sudo[96454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ad78acbc-2d2a-4e9e-86b6-4ceb023e1a94 1073741824 Jul 10 06:44:32 devstack sudo[96454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:32 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-5528aeb8-dad3-43b5-8692-adf4026aac22 tempest-VolumesSnapshotTestJSON-2129310836 None] Create snapshot completed successfully Jul 10 06:44:33 devstack sudo[96454]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-4cdd8bbe-e650-4e6e-828e-9bb23c17d924 tempest-VolumesGetTest-1773245057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ad78acbc-2d2a-4e9e-86b6-4ceb023e1a94 1073741824" returned: 0 in 1.064s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-4cdd8bbe-e650-4e6e-828e-9bb23c17d924 tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ad78acbc-2d2a-4e9e-86b6-4ceb023e1a94 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:33 devstack sudo[96461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ad78acbc-2d2a-4e9e-86b6-4ceb023e1a94 Jul 10 06:44:33 devstack sudo[96461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:33 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7d6d3730-bad5-4024-a55f-fc0cb1a16fad tempest-VolumesSnapshotTestJSON-2129310836 None] Acquiring lock "cinder-15380a6a-655b-4943-9211-6b12362260bd-delete_snapshot" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:44:33 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7d6d3730-bad5-4024-a55f-fc0cb1a16fad tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "cinder-15380a6a-655b-4943-9211-6b12362260bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:44:33 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7d6d3730-bad5-4024-a55f-fc0cb1a16fad tempest-VolumesSnapshotTestJSON-2129310836 None] Acquiring lock "cinder-quobyte-9d1df4cd-f187-43fb-bac8-d733281e130c" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:44:33 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7d6d3730-bad5-4024-a55f-fc0cb1a16fad tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "cinder-quobyte-9d1df4cd-f187-43fb-bac8-d733281e130c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:44:33 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7d6d3730-bad5-4024-a55f-fc0cb1a16fad tempest-VolumesSnapshotTestJSON-2129310836 None] Acquiring lock "cinder-quobyte-15380a6a-655b-4943-9211-6b12362260bd" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:44:33 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7d6d3730-bad5-4024-a55f-fc0cb1a16fad tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "cinder-quobyte-15380a6a-655b-4943-9211-6b12362260bd" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:44:33 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-7d6d3730-bad5-4024-a55f-fc0cb1a16fad tempest-VolumesSnapshotTestJSON-2129310836 None] Deleting offline snapshot 15380a6a-655b-4943-9211-6b12362260bd of volume 9d1df4cd-f187-43fb-bac8-d733281e130c {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:44:33 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-7d6d3730-bad5-4024-a55f-fc0cb1a16fad tempest-VolumesSnapshotTestJSON-2129310836 None] snapshot_file for this snap is: volume-9d1df4cd-f187-43fb-bac8-d733281e130c.15380a6a-655b-4943-9211-6b12362260bd {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:44:33 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[78acf306-ed44-4165-add0-edb29c564ea9]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:44:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7d6d3730-bad5-4024-a55f-fc0cb1a16fad tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c.15380a6a-655b-4943-9211-6b12362260bd {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:33 devstack sudo[96463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c.15380a6a-655b-4943-9211-6b12362260bd Jul 10 06:44:33 devstack sudo[96463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:34 devstack sudo[96461]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-4cdd8bbe-e650-4e6e-828e-9bb23c17d924 tempest-VolumesGetTest-1773245057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ad78acbc-2d2a-4e9e-86b6-4ceb023e1a94" returned: 0 in 0.768s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:34 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-4cdd8bbe-e650-4e6e-828e-9bb23c17d924 tempest-VolumesGetTest-1773245057 None] <== create_volume: return (1895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:44:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-4cdd8bbe-e650-4e6e-828e-9bb23c17d924 tempest-VolumesGetTest-1773245057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.899s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-cc35d9fe-cc3a-4a60-bb50-6f8ad88ab9e1 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.178s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:34 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-cc35d9fe-cc3a-4a60-bb50-6f8ad88ab9e1 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1017315841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=336a9799-3c3d-4309-8eb5-e2c5580ea138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8cb257f5abb490fb3053dbcafa69097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:44:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:44:29Z,use_quota=True,user_id='6c44b53fd443497694d1416a80385f55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27faafe6-a500-4df3-889b-bc5c5df39876),volume_type_id=27faafe6-a500-4df3-889b-bc5c5df39876)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:44:34 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-cc35d9fe-cc3a-4a60-bb50-6f8ad88ab9e1 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Creating volume 336a9799-3c3d-4309-8eb5-e2c5580ea138 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:44:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-cc35d9fe-cc3a-4a60-bb50-6f8ad88ab9e1 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-cc35d9fe-cc3a-4a60-bb50-6f8ad88ab9e1 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:34 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-cc35d9fe-cc3a-4a60-bb50-6f8ad88ab9e1 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:44:34 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-cc35d9fe-cc3a-4a60-bb50-6f8ad88ab9e1 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:44:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-cc35d9fe-cc3a-4a60-bb50-6f8ad88ab9e1 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:34 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-cc35d9fe-cc3a-4a60-bb50-6f8ad88ab9e1 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:44:34 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-cc35d9fe-cc3a-4a60-bb50-6f8ad88ab9e1 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:44:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-cc35d9fe-cc3a-4a60-bb50-6f8ad88ab9e1 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-336a9799-3c3d-4309-8eb5-e2c5580ea138 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-4cdd8bbe-e650-4e6e-828e-9bb23c17d924 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e12c9ee9-6e94-469b-97f8-a66f5faf668e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad78acbc-2d2a-4e9e-86b6-4ceb023e1a94', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-4cdd8bbe-e650-4e6e-828e-9bb23c17d924 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (482cc9bf-c5b4-4e9f-889a-d4761c0c9093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:34 devstack sudo[96466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-336a9799-3c3d-4309-8eb5-e2c5580ea138 1073741824 Jul 10 06:44:34 devstack sudo[96466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:34 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-4cdd8bbe-e650-4e6e-828e-9bb23c17d924 tempest-VolumesGetTest-1773245057 None] Volume volume-ad78acbc-2d2a-4e9e-86b6-4ceb023e1a94 (ad78acbc-2d2a-4e9e-86b6-4ceb023e1a94): created successfully Jul 10 06:44:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-4cdd8bbe-e650-4e6e-828e-9bb23c17d924 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (482cc9bf-c5b4-4e9f-889a-d4761c0c9093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-4cdd8bbe-e650-4e6e-828e-9bb23c17d924 tempest-VolumesGetTest-1773245057 None] Flow 'volume_create_manager' (d72edace-87d5-42bf-a6ae-587f28ce401e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:44:34 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-4cdd8bbe-e650-4e6e-828e-9bb23c17d924 tempest-VolumesGetTest-1773245057 None] Created volume successfully. Jul 10 06:44:34 devstack sudo[96463]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7d6d3730-bad5-4024-a55f-fc0cb1a16fad tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c.15380a6a-655b-4943-9211-6b12362260bd" returned: 0 in 0.920s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:34 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-7d6d3730-bad5-4024-a55f-fc0cb1a16fad tempest-VolumesSnapshotTestJSON-2129310836 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d1df4cd-f187-43fb-bac8-d733281e130c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:44:34 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7f84ce-883e-4d9f-a258-48e76acb9366]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:44:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7d6d3730-bad5-4024-a55f-fc0cb1a16fad tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:34 devstack sudo[96471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c Jul 10 06:44:34 devstack sudo[96471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:35 devstack sudo[96466]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-cc35d9fe-cc3a-4a60-bb50-6f8ad88ab9e1 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-336a9799-3c3d-4309-8eb5-e2c5580ea138 1073741824" returned: 0 in 1.249s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:35 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d6243b0-48dd-42b5-8288-2e897b8ab93f tempest-VolumesGetTest-1773245057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:44:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6d6243b0-48dd-42b5-8288-2e897b8ab93f tempest-VolumesGetTest-1773245057 None] Flow 'volume_create_manager' (2fb85b8d-5627-4421-9994-e231bc208a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:44:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6d6243b0-48dd-42b5-8288-2e897b8ab93f tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2957dcb9-4a5f-4933-b023-c03a86c359ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6d6243b0-48dd-42b5-8288-2e897b8ab93f tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2957dcb9-4a5f-4933-b023-c03a86c359ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:44:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1798810504',display_name='tempest-VolumesGetTest-Volume-8131684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63dfd5c2-ca7b-49dd-ab71-ed6de9c18824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e516fd258b49497d9b6fe259af09b0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:44:36Z,use_quota=True,user_id='3b01103b9e864780af5a6824d10744f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6d6243b0-48dd-42b5-8288-2e897b8ab93f tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fe3db7b-0300-439c-8b30-952b839353bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6d6243b0-48dd-42b5-8288-2e897b8ab93f tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fe3db7b-0300-439c-8b30-952b839353bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:35 devstack sudo[96471]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6d6243b0-48dd-42b5-8288-2e897b8ab93f tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa9e2d14-d5c8-4036-96a2-77d43f7c6d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6d6243b0-48dd-42b5-8288-2e897b8ab93f tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa9e2d14-d5c8-4036-96a2-77d43f7c6d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63dfd5c2-ca7b-49dd-ab71-ed6de9c18824', 'volume_name': 'volume-63dfd5c2-ca7b-49dd-ab71-ed6de9c18824', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6d6243b0-48dd-42b5-8288-2e897b8ab93f tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ce51e8f-78ec-4513-968b-a4dc4462ce29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6d6243b0-48dd-42b5-8288-2e897b8ab93f tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ce51e8f-78ec-4513-968b-a4dc4462ce29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6d6243b0-48dd-42b5-8288-2e897b8ab93f tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec4b20e3-cdc5-4c48-8942-cd22a6083bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:35 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-6d6243b0-48dd-42b5-8288-2e897b8ab93f tempest-VolumesGetTest-1773245057 None] Volume 63dfd5c2-ca7b-49dd-ab71-ed6de9c18824: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63dfd5c2-ca7b-49dd-ab71-ed6de9c18824', 'volume_size': 1} Jul 10 06:44:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-6d6243b0-48dd-42b5-8288-2e897b8ab93f tempest-VolumesGetTest-1773245057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-cc35d9fe-cc3a-4a60-bb50-6f8ad88ab9e1 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-336a9799-3c3d-4309-8eb5-e2c5580ea138 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7d6d3730-bad5-4024-a55f-fc0cb1a16fad tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c" returned: 0 in 0.992s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7d6d3730-bad5-4024-a55f-fc0cb1a16fad tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c.15380a6a-655b-4943-9211-6b12362260bd {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:35 devstack sudo[96479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-336a9799-3c3d-4309-8eb5-e2c5580ea138 Jul 10 06:44:35 devstack sudo[96479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:35 devstack sudo[96480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c.15380a6a-655b-4943-9211-6b12362260bd Jul 10 06:44:35 devstack sudo[96480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:36 devstack sudo[96479]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-cc35d9fe-cc3a-4a60-bb50-6f8ad88ab9e1 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-336a9799-3c3d-4309-8eb5-e2c5580ea138" returned: 0 in 0.692s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:36 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-cc35d9fe-cc3a-4a60-bb50-6f8ad88ab9e1 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] <== create_volume: return (2073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:44:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-cc35d9fe-cc3a-4a60-bb50-6f8ad88ab9e1 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.076s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-6d6243b0-48dd-42b5-8288-2e897b8ab93f tempest-VolumesGetTest-1773245057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.705s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:36 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-6d6243b0-48dd-42b5-8288-2e897b8ab93f tempest-VolumesGetTest-1773245057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:44:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1798810504',display_name='tempest-VolumesGetTest-Volume-8131684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63dfd5c2-ca7b-49dd-ab71-ed6de9c18824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e516fd258b49497d9b6fe259af09b0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:44:36Z,use_quota=True,user_id='3b01103b9e864780af5a6824d10744f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:44:36 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-6d6243b0-48dd-42b5-8288-2e897b8ab93f tempest-VolumesGetTest-1773245057 None] Creating volume 63dfd5c2-ca7b-49dd-ab71-ed6de9c18824 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:44:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-6d6243b0-48dd-42b5-8288-2e897b8ab93f tempest-VolumesGetTest-1773245057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-6d6243b0-48dd-42b5-8288-2e897b8ab93f tempest-VolumesGetTest-1773245057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:36 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-6d6243b0-48dd-42b5-8288-2e897b8ab93f tempest-VolumesGetTest-1773245057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:44:36 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-6d6243b0-48dd-42b5-8288-2e897b8ab93f tempest-VolumesGetTest-1773245057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:44:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-6d6243b0-48dd-42b5-8288-2e897b8ab93f tempest-VolumesGetTest-1773245057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:36 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-6d6243b0-48dd-42b5-8288-2e897b8ab93f tempest-VolumesGetTest-1773245057 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:44:36 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-6d6243b0-48dd-42b5-8288-2e897b8ab93f tempest-VolumesGetTest-1773245057 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:44:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6d6243b0-48dd-42b5-8288-2e897b8ab93f tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-63dfd5c2-ca7b-49dd-ab71-ed6de9c18824 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:36 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-cc35d9fe-cc3a-4a60-bb50-6f8ad88ab9e1 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cad4c11c-5acd-400b-8480-b65afd1b47fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-336a9799-3c3d-4309-8eb5-e2c5580ea138', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:36 devstack sudo[96480]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:36 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-cc35d9fe-cc3a-4a60-bb50-6f8ad88ab9e1 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e99a1487-5962-450d-b5fd-3b9670cf6c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7d6d3730-bad5-4024-a55f-fc0cb1a16fad tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c.15380a6a-655b-4943-9211-6b12362260bd" returned: 0 in 0.777s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:36 devstack sudo[96487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-63dfd5c2-ca7b-49dd-ab71-ed6de9c18824 1073741824 Jul 10 06:44:36 devstack sudo[96487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7d6d3730-bad5-4024-a55f-fc0cb1a16fad tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c.15380a6a-655b-4943-9211-6b12362260bd {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:36 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-cc35d9fe-cc3a-4a60-bb50-6f8ad88ab9e1 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Volume volume-336a9799-3c3d-4309-8eb5-e2c5580ea138 (336a9799-3c3d-4309-8eb5-e2c5580ea138): created successfully Jul 10 06:44:36 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-cc35d9fe-cc3a-4a60-bb50-6f8ad88ab9e1 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e99a1487-5962-450d-b5fd-3b9670cf6c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:36 devstack sudo[96489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c.15380a6a-655b-4943-9211-6b12362260bd Jul 10 06:44:36 devstack sudo[96489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:36 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-cc35d9fe-cc3a-4a60-bb50-6f8ad88ab9e1 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Flow 'volume_create_manager' (713d83b4-d392-4518-96ce-ba0b34fa2300) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:44:36 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-cc35d9fe-cc3a-4a60-bb50-6f8ad88ab9e1 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Created volume successfully. Jul 10 06:44:37 devstack sudo[96489]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7d6d3730-bad5-4024-a55f-fc0cb1a16fad tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c.15380a6a-655b-4943-9211-6b12362260bd" returned: 0 in 0.727s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:37 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7d6d3730-bad5-4024-a55f-fc0cb1a16fad tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "cinder-quobyte-15380a6a-655b-4943-9211-6b12362260bd" released by "_delete_snapshot" :: held 3.535s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:44:37 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7d6d3730-bad5-4024-a55f-fc0cb1a16fad tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "cinder-quobyte-9d1df4cd-f187-43fb-bac8-d733281e130c" released by "delete_snapshot" :: held 3.563s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:44:37 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-7d6d3730-bad5-4024-a55f-fc0cb1a16fad tempest-VolumesSnapshotTestJSON-2129310836 None] Created reservations ['51d276bb-6f08-4c82-aa26-4e47e6730e2f', '43374533-7373-48f3-a657-1da4b0618b21', '41299123-7fb9-49cb-9201-1415c0c5c333', 'd85ad42b-05d0-47a3-9e5c-5339d36dd4f4'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:44:37 devstack sudo[96487]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6d6243b0-48dd-42b5-8288-2e897b8ab93f tempest-VolumesGetTest-1773245057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-63dfd5c2-ca7b-49dd-ab71-ed6de9c18824 1073741824" returned: 0 in 0.953s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:37 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-7d6d3730-bad5-4024-a55f-fc0cb1a16fad tempest-VolumesSnapshotTestJSON-2129310836 None] Delete snapshot completed successfully. Jul 10 06:44:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6d6243b0-48dd-42b5-8288-2e897b8ab93f tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-63dfd5c2-ca7b-49dd-ab71-ed6de9c18824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:37 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7d6d3730-bad5-4024-a55f-fc0cb1a16fad tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "cinder-15380a6a-655b-4943-9211-6b12362260bd-delete_snapshot" released by "delete_snapshot" :: held 3.771s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:44:37 devstack sudo[96496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-63dfd5c2-ca7b-49dd-ab71-ed6de9c18824 Jul 10 06:44:37 devstack sudo[96496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c8885eb0-bb8a-4df4-9544-d9196987b419 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c8885eb0-bb8a-4df4-9544-d9196987b419 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:38 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-c8885eb0-bb8a-4df4-9544-d9196987b419 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:44:38 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-c8885eb0-bb8a-4df4-9544-d9196987b419 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:44:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c8885eb0-bb8a-4df4-9544-d9196987b419 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c8885eb0-bb8a-4df4-9544-d9196987b419 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:38 devstack sudo[96496]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6d6243b0-48dd-42b5-8288-2e897b8ab93f tempest-VolumesGetTest-1773245057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-63dfd5c2-ca7b-49dd-ab71-ed6de9c18824" returned: 0 in 0.784s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:38 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-6d6243b0-48dd-42b5-8288-2e897b8ab93f tempest-VolumesGetTest-1773245057 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:44:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-6d6243b0-48dd-42b5-8288-2e897b8ab93f tempest-VolumesGetTest-1773245057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:38 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6d6243b0-48dd-42b5-8288-2e897b8ab93f tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec4b20e3-cdc5-4c48-8942-cd22a6083bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63dfd5c2-ca7b-49dd-ab71-ed6de9c18824', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:38 devstack sudo[96499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:44:38 devstack sudo[96499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:38 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6d6243b0-48dd-42b5-8288-2e897b8ab93f tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (591ade14-bf6c-4a6d-baab-9e03cd51f649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:38 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-6d6243b0-48dd-42b5-8288-2e897b8ab93f tempest-VolumesGetTest-1773245057 None] Volume volume-63dfd5c2-ca7b-49dd-ab71-ed6de9c18824 (63dfd5c2-ca7b-49dd-ab71-ed6de9c18824): created successfully Jul 10 06:44:38 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6d6243b0-48dd-42b5-8288-2e897b8ab93f tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (591ade14-bf6c-4a6d-baab-9e03cd51f649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:38 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6d6243b0-48dd-42b5-8288-2e897b8ab93f tempest-VolumesGetTest-1773245057 None] Flow 'volume_create_manager' (2fb85b8d-5627-4421-9994-e231bc208a05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:44:38 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-6d6243b0-48dd-42b5-8288-2e897b8ab93f tempest-VolumesGetTest-1773245057 None] Created volume successfully. Jul 10 06:44:38 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-5775c9b2-3ca4-4f5a-a1fe-696048dd65a0 tempest-VolumesSnapshotTestJSON-2129310836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:44:38 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5775c9b2-3ca4-4f5a-a1fe-696048dd65a0 tempest-VolumesSnapshotTestJSON-2129310836 None] Flow 'volume_create_manager' (1dd1e934-8632-468f-bed6-a0631670d908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:44:38 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5775c9b2-3ca4-4f5a-a1fe-696048dd65a0 tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e960409-f79e-411f-adc8-651f7244490b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:38 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5775c9b2-3ca4-4f5a-a1fe-696048dd65a0 tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e960409-f79e-411f-adc8-651f7244490b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1033701155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8212d94d-5dfb-463f-9314-195c8e46c90e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d624da3b98c346bab40a859ada5116c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:44:39Z,use_quota=True,user_id='d4bd965c4f35412b9dea43d58771b551',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:38 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5775c9b2-3ca4-4f5a-a1fe-696048dd65a0 tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce9c1e32-98f6-48b3-bead-75d9ed266494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:38 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5775c9b2-3ca4-4f5a-a1fe-696048dd65a0 tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce9c1e32-98f6-48b3-bead-75d9ed266494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:38 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5775c9b2-3ca4-4f5a-a1fe-696048dd65a0 tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87f76060-fd23-4852-9aea-c384183a0403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:38 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5775c9b2-3ca4-4f5a-a1fe-696048dd65a0 tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87f76060-fd23-4852-9aea-c384183a0403) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8212d94d-5dfb-463f-9314-195c8e46c90e', 'volume_name': 'volume-8212d94d-5dfb-463f-9314-195c8e46c90e', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:38 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5775c9b2-3ca4-4f5a-a1fe-696048dd65a0 tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92b71b09-b41e-4c90-a53c-d79c52531893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:38 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5775c9b2-3ca4-4f5a-a1fe-696048dd65a0 tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92b71b09-b41e-4c90-a53c-d79c52531893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:38 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5775c9b2-3ca4-4f5a-a1fe-696048dd65a0 tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfa9406a-0b77-4156-874f-38943b3cb58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:38 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-5775c9b2-3ca4-4f5a-a1fe-696048dd65a0 tempest-VolumesSnapshotTestJSON-2129310836 None] Volume 8212d94d-5dfb-463f-9314-195c8e46c90e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8212d94d-5dfb-463f-9314-195c8e46c90e', 'volume_size': 1} Jul 10 06:44:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5775c9b2-3ca4-4f5a-a1fe-696048dd65a0 tempest-VolumesSnapshotTestJSON-2129310836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5775c9b2-3ca4-4f5a-a1fe-696048dd65a0 tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:38 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5775c9b2-3ca4-4f5a-a1fe-696048dd65a0 tempest-VolumesSnapshotTestJSON-2129310836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:44:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1033701155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8212d94d-5dfb-463f-9314-195c8e46c90e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d624da3b98c346bab40a859ada5116c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:44:39Z,use_quota=True,user_id='d4bd965c4f35412b9dea43d58771b551',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:44:38 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-5775c9b2-3ca4-4f5a-a1fe-696048dd65a0 tempest-VolumesSnapshotTestJSON-2129310836 None] Creating volume 8212d94d-5dfb-463f-9314-195c8e46c90e {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:44:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5775c9b2-3ca4-4f5a-a1fe-696048dd65a0 tempest-VolumesSnapshotTestJSON-2129310836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5775c9b2-3ca4-4f5a-a1fe-696048dd65a0 tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:38 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5775c9b2-3ca4-4f5a-a1fe-696048dd65a0 tempest-VolumesSnapshotTestJSON-2129310836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:44:38 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5775c9b2-3ca4-4f5a-a1fe-696048dd65a0 tempest-VolumesSnapshotTestJSON-2129310836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:44:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5775c9b2-3ca4-4f5a-a1fe-696048dd65a0 tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:38 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5775c9b2-3ca4-4f5a-a1fe-696048dd65a0 tempest-VolumesSnapshotTestJSON-2129310836 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:44:38 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-5775c9b2-3ca4-4f5a-a1fe-696048dd65a0 tempest-VolumesSnapshotTestJSON-2129310836 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:44:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5775c9b2-3ca4-4f5a-a1fe-696048dd65a0 tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:38 devstack sudo[96501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e 1073741824 Jul 10 06:44:38 devstack sudo[96501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:38 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b1b1ef71-1fb7-4eed-8a88-3918a7d1f44f tempest-VolumesGetTest-1773245057 None] Acquiring lock "cinder-63dfd5c2-ca7b-49dd-ab71-ed6de9c18824-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:44:39 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b1b1ef71-1fb7-4eed-8a88-3918a7d1f44f tempest-VolumesGetTest-1773245057 None] Lock "cinder-63dfd5c2-ca7b-49dd-ab71-ed6de9c18824-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:44:39 devstack sudo[96499]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:39 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b1b1ef71-1fb7-4eed-8a88-3918a7d1f44f tempest-VolumesGetTest-1773245057 None] Acquiring lock "cinder-quobyte-63dfd5c2-ca7b-49dd-ab71-ed6de9c18824" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:44:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c8885eb0-bb8a-4df4-9544-d9196987b419 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.905s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:39 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-c8885eb0-bb8a-4df4-9544-d9196987b419 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:44:39 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-c8885eb0-bb8a-4df4-9544-d9196987b419 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Retype volume completed successfully. Jul 10 06:44:39 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b1b1ef71-1fb7-4eed-8a88-3918a7d1f44f tempest-VolumesGetTest-1773245057 None] Lock "cinder-quobyte-63dfd5c2-ca7b-49dd-ab71-ed6de9c18824" acquired by "delete_volume" :: waited 0.030s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:44:39 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb542d3-b66d-4d40-a2e1-fc96949917f2]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:44:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b1b1ef71-1fb7-4eed-8a88-3918a7d1f44f tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-63dfd5c2-ca7b-49dd-ab71-ed6de9c18824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:39 devstack sudo[96504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-63dfd5c2-ca7b-49dd-ab71-ed6de9c18824 Jul 10 06:44:39 devstack sudo[96504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:39 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d7044b79-c0d8-48b1-bb4e-a926eb027064 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Acquiring lock "cinder-336a9799-3c3d-4309-8eb5-e2c5580ea138-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:44:39 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d7044b79-c0d8-48b1-bb4e-a926eb027064 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Lock "cinder-336a9799-3c3d-4309-8eb5-e2c5580ea138-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:44:39 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d7044b79-c0d8-48b1-bb4e-a926eb027064 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Acquiring lock "cinder-quobyte-336a9799-3c3d-4309-8eb5-e2c5580ea138" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:44:39 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d7044b79-c0d8-48b1-bb4e-a926eb027064 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Lock "cinder-quobyte-336a9799-3c3d-4309-8eb5-e2c5580ea138" acquired by "delete_volume" :: waited 0.025s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:44:39 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d9dd5e-ec24-45ed-9920-46f693deecc3]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:44:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d7044b79-c0d8-48b1-bb4e-a926eb027064 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-336a9799-3c3d-4309-8eb5-e2c5580ea138 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:39 devstack sudo[96510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-336a9799-3c3d-4309-8eb5-e2c5580ea138 Jul 10 06:44:39 devstack sudo[96510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:39 devstack sudo[96501]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5775c9b2-3ca4-4f5a-a1fe-696048dd65a0 tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e 1073741824" returned: 0 in 1.027s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5775c9b2-3ca4-4f5a-a1fe-696048dd65a0 tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:39 devstack sudo[96513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e Jul 10 06:44:39 devstack sudo[96513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:40 devstack sudo[96504]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b1b1ef71-1fb7-4eed-8a88-3918a7d1f44f tempest-VolumesGetTest-1773245057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-63dfd5c2-ca7b-49dd-ab71-ed6de9c18824" returned: 0 in 1.093s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b1b1ef71-1fb7-4eed-8a88-3918a7d1f44f tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-63dfd5c2-ca7b-49dd-ab71-ed6de9c18824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:40 devstack sudo[96518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-63dfd5c2-ca7b-49dd-ab71-ed6de9c18824 Jul 10 06:44:40 devstack sudo[96518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:40 devstack sudo[96510]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d7044b79-c0d8-48b1-bb4e-a926eb027064 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-336a9799-3c3d-4309-8eb5-e2c5580ea138" returned: 0 in 0.933s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d7044b79-c0d8-48b1-bb4e-a926eb027064 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-336a9799-3c3d-4309-8eb5-e2c5580ea138 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:40 devstack sudo[96524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-336a9799-3c3d-4309-8eb5-e2c5580ea138 Jul 10 06:44:40 devstack sudo[96524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:40 devstack sudo[96513]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5775c9b2-3ca4-4f5a-a1fe-696048dd65a0 tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e" returned: 0 in 0.963s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:40 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5775c9b2-3ca4-4f5a-a1fe-696048dd65a0 tempest-VolumesSnapshotTestJSON-2129310836 None] <== create_volume: return (2048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:44:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5775c9b2-3ca4-4f5a-a1fe-696048dd65a0 tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.057s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:40 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5775c9b2-3ca4-4f5a-a1fe-696048dd65a0 tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfa9406a-0b77-4156-874f-38943b3cb58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8212d94d-5dfb-463f-9314-195c8e46c90e', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:40 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5775c9b2-3ca4-4f5a-a1fe-696048dd65a0 tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c321d80a-9142-46b7-9017-8bca62104517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:40 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-5775c9b2-3ca4-4f5a-a1fe-696048dd65a0 tempest-VolumesSnapshotTestJSON-2129310836 None] Volume volume-8212d94d-5dfb-463f-9314-195c8e46c90e (8212d94d-5dfb-463f-9314-195c8e46c90e): created successfully Jul 10 06:44:40 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5775c9b2-3ca4-4f5a-a1fe-696048dd65a0 tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c321d80a-9142-46b7-9017-8bca62104517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:40 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5775c9b2-3ca4-4f5a-a1fe-696048dd65a0 tempest-VolumesSnapshotTestJSON-2129310836 None] Flow 'volume_create_manager' (1dd1e934-8632-468f-bed6-a0631670d908) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:44:40 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-5775c9b2-3ca4-4f5a-a1fe-696048dd65a0 tempest-VolumesSnapshotTestJSON-2129310836 None] Created volume successfully. Jul 10 06:44:41 devstack sudo[96518]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b1b1ef71-1fb7-4eed-8a88-3918a7d1f44f tempest-VolumesGetTest-1773245057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-63dfd5c2-ca7b-49dd-ab71-ed6de9c18824" returned: 0 in 0.798s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b1b1ef71-1fb7-4eed-8a88-3918a7d1f44f tempest-VolumesGetTest-1773245057 None] Lock "cinder-quobyte-63dfd5c2-ca7b-49dd-ab71-ed6de9c18824" released by "delete_volume" :: held 1.951s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:44:41 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-b1b1ef71-1fb7-4eed-8a88-3918a7d1f44f tempest-VolumesGetTest-1773245057 None] Created reservations ['396a2778-3052-4308-a91e-b1c49132ba7f', 'c95b6943-740e-4b75-a2e5-bcdcc6ccf157', 'ba404bf9-2db9-434f-b470-f9b0b13c2e14', 'eb3c45ba-130b-4cfe-bfd4-dbae20845bfb'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:44:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b1b1ef71-1fb7-4eed-8a88-3918a7d1f44f tempest-VolumesGetTest-1773245057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b1b1ef71-1fb7-4eed-8a88-3918a7d1f44f tempest-VolumesGetTest-1773245057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:41 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b1b1ef71-1fb7-4eed-8a88-3918a7d1f44f tempest-VolumesGetTest-1773245057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:44:41 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b1b1ef71-1fb7-4eed-8a88-3918a7d1f44f tempest-VolumesGetTest-1773245057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:44:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b1b1ef71-1fb7-4eed-8a88-3918a7d1f44f tempest-VolumesGetTest-1773245057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b1b1ef71-1fb7-4eed-8a88-3918a7d1f44f tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:41 devstack sudo[96529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:44:41 devstack sudo[96529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:41 devstack sudo[96524]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d7044b79-c0d8-48b1-bb4e-a926eb027064 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-336a9799-3c3d-4309-8eb5-e2c5580ea138" returned: 0 in 0.772s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d7044b79-c0d8-48b1-bb4e-a926eb027064 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Lock "cinder-quobyte-336a9799-3c3d-4309-8eb5-e2c5580ea138" released by "delete_volume" :: held 1.764s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:44:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-8527a80d-ff8d-4106-9dbf-de8e0bae7876 tempest-VolumesGetTest-1773245057 None] Acquiring lock "cinder-ad78acbc-2d2a-4e9e-86b6-4ceb023e1a94-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:44:41 devstack cinder-volume[87294]: WARNING cinder.quota [None req-d7044b79-c0d8-48b1-bb4e-a926eb027064 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:44:41 devstack cinder-volume[87294]: WARNING cinder.quota [None req-d7044b79-c0d8-48b1-bb4e-a926eb027064 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:44:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-8527a80d-ff8d-4106-9dbf-de8e0bae7876 tempest-VolumesGetTest-1773245057 None] Lock "cinder-ad78acbc-2d2a-4e9e-86b6-4ceb023e1a94-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:44:41 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-d7044b79-c0d8-48b1-bb4e-a926eb027064 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Created reservations ['e8970ee9-20dc-4496-9489-a01bb6b803cd', '250c4acb-2544-4abc-9cb9-8af8f2694c16', '5a411b14-ff0f-4a73-b4d2-92576d1d2e42', 'ae8da405-d382-4426-ab23-ff6fa1c7ea3b'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:44:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-8527a80d-ff8d-4106-9dbf-de8e0bae7876 tempest-VolumesGetTest-1773245057 None] Acquiring lock "cinder-quobyte-ad78acbc-2d2a-4e9e-86b6-4ceb023e1a94" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:44:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-8527a80d-ff8d-4106-9dbf-de8e0bae7876 tempest-VolumesGetTest-1773245057 None] Lock "cinder-quobyte-ad78acbc-2d2a-4e9e-86b6-4ceb023e1a94" acquired by "delete_volume" :: waited 0.028s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:44:41 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[5574027c-f11e-449c-80f1-f59abfb65eff]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:44:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8527a80d-ff8d-4106-9dbf-de8e0bae7876 tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ad78acbc-2d2a-4e9e-86b6-4ceb023e1a94 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d7044b79-c0d8-48b1-bb4e-a926eb027064 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d7044b79-c0d8-48b1-bb4e-a926eb027064 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:41 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-d7044b79-c0d8-48b1-bb4e-a926eb027064 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:44:41 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-d7044b79-c0d8-48b1-bb4e-a926eb027064 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:44:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d7044b79-c0d8-48b1-bb4e-a926eb027064 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d7044b79-c0d8-48b1-bb4e-a926eb027064 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:41 devstack sudo[96532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:44:41 devstack sudo[96532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:41 devstack sudo[96531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ad78acbc-2d2a-4e9e-86b6-4ceb023e1a94 Jul 10 06:44:41 devstack sudo[96531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-23dc5259-3235-471b-bd93-3f0bf7e458c0 tempest-VolumesSnapshotTestJSON-2129310836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-23dc5259-3235-471b-bd93-3f0bf7e458c0 tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:42 devstack sudo[96529]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b1b1ef71-1fb7-4eed-8a88-3918a7d1f44f tempest-VolumesGetTest-1773245057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.350s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:42 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-b1b1ef71-1fb7-4eed-8a88-3918a7d1f44f tempest-VolumesGetTest-1773245057 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:44:42 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-b1b1ef71-1fb7-4eed-8a88-3918a7d1f44f tempest-VolumesGetTest-1773245057 None] Deleted volume successfully. Jul 10 06:44:42 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-23dc5259-3235-471b-bd93-3f0bf7e458c0 tempest-VolumesSnapshotTestJSON-2129310836 None] Creating offline snapshot 8c5e53a1-a6ba-431f-8deb-19680663be0b of volume 8212d94d-5dfb-463f-9314-195c8e46c90e {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:44:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b1b1ef71-1fb7-4eed-8a88-3918a7d1f44f tempest-VolumesGetTest-1773245057 None] Lock "cinder-63dfd5c2-ca7b-49dd-ab71-ed6de9c18824-delete_volume" released by "delete_volume" :: held 3.647s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:44:42 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[09184bff-2197-41f9-bfde-f9da4b4a9e34]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:44:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-23dc5259-3235-471b-bd93-3f0bf7e458c0 tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:42 devstack sudo[96531]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8527a80d-ff8d-4106-9dbf-de8e0bae7876 tempest-VolumesGetTest-1773245057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ad78acbc-2d2a-4e9e-86b6-4ceb023e1a94" returned: 0 in 1.119s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8527a80d-ff8d-4106-9dbf-de8e0bae7876 tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ad78acbc-2d2a-4e9e-86b6-4ceb023e1a94 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:42 devstack sudo[96579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ad78acbc-2d2a-4e9e-86b6-4ceb023e1a94 Jul 10 06:44:42 devstack sudo[96579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:42 devstack sudo[96578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e Jul 10 06:44:42 devstack sudo[96578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:43 devstack sudo[96532]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d7044b79-c0d8-48b1-bb4e-a926eb027064 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.384s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:43 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-d7044b79-c0d8-48b1-bb4e-a926eb027064 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:44:43 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-d7044b79-c0d8-48b1-bb4e-a926eb027064 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Deleted volume successfully. Jul 10 06:44:43 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d7044b79-c0d8-48b1-bb4e-a926eb027064 tempest-VolumeRetypeWithoutMigrationTest-680754756 None] Lock "cinder-336a9799-3c3d-4309-8eb5-e2c5580ea138-delete_volume" released by "delete_volume" :: held 3.610s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:44:43 devstack sudo[96579]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8527a80d-ff8d-4106-9dbf-de8e0bae7876 tempest-VolumesGetTest-1773245057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ad78acbc-2d2a-4e9e-86b6-4ceb023e1a94" returned: 0 in 0.855s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:43 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-8527a80d-ff8d-4106-9dbf-de8e0bae7876 tempest-VolumesGetTest-1773245057 None] Lock "cinder-quobyte-ad78acbc-2d2a-4e9e-86b6-4ceb023e1a94" released by "delete_volume" :: held 2.022s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:44:43 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-8527a80d-ff8d-4106-9dbf-de8e0bae7876 tempest-VolumesGetTest-1773245057 None] Created reservations ['494af431-29d7-4a7f-a090-871fc0373421', '57b21016-ff29-4978-8852-3fa81db19ae0', '124cd902-145b-498c-8224-8cd5699dbe4e', '3d6c4fbf-95fb-49ec-bb47-7fcdd8c6fa72'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:44:43 devstack sudo[96578]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-23dc5259-3235-471b-bd93-3f0bf7e458c0 tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e" returned: 0 in 1.013s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-23dc5259-3235-471b-bd93-3f0bf7e458c0 tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e.8c5e53a1-a6ba-431f-8deb-19680663be0b 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:43 devstack sudo[96588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e.8c5e53a1-a6ba-431f-8deb-19680663be0b 1G Jul 10 06:44:43 devstack sudo[96588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-8527a80d-ff8d-4106-9dbf-de8e0bae7876 tempest-VolumesGetTest-1773245057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-8527a80d-ff8d-4106-9dbf-de8e0bae7876 tempest-VolumesGetTest-1773245057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:43 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-8527a80d-ff8d-4106-9dbf-de8e0bae7876 tempest-VolumesGetTest-1773245057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:44:43 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-8527a80d-ff8d-4106-9dbf-de8e0bae7876 tempest-VolumesGetTest-1773245057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:44:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-8527a80d-ff8d-4106-9dbf-de8e0bae7876 tempest-VolumesGetTest-1773245057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8527a80d-ff8d-4106-9dbf-de8e0bae7876 tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:43 devstack sudo[96590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:44:43 devstack sudo[96590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:44 devstack sudo[96590]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8527a80d-ff8d-4106-9dbf-de8e0bae7876 tempest-VolumesGetTest-1773245057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.724s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:44 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-8527a80d-ff8d-4106-9dbf-de8e0bae7876 tempest-VolumesGetTest-1773245057 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:44:44 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-8527a80d-ff8d-4106-9dbf-de8e0bae7876 tempest-VolumesGetTest-1773245057 None] Deleted volume successfully. Jul 10 06:44:44 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-8527a80d-ff8d-4106-9dbf-de8e0bae7876 tempest-VolumesGetTest-1773245057 None] Lock "cinder-ad78acbc-2d2a-4e9e-86b6-4ceb023e1a94-delete_volume" released by "delete_volume" :: held 3.102s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:44:44 devstack sudo[96588]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-23dc5259-3235-471b-bd93-3f0bf7e458c0 tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e.8c5e53a1-a6ba-431f-8deb-19680663be0b 1G" returned: 0 in 0.929s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-23dc5259-3235-471b-bd93-3f0bf7e458c0 tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8212d94d-5dfb-463f-9314-195c8e46c90e -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e.8c5e53a1-a6ba-431f-8deb-19680663be0b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:44 devstack sudo[96597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8212d94d-5dfb-463f-9314-195c8e46c90e -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e.8c5e53a1-a6ba-431f-8deb-19680663be0b Jul 10 06:44:44 devstack sudo[96597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:45 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-4681122b-f846-42b3-a705-7d8f3f6ffc68 tempest-VolumesGetTest-1773245057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:44:45 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-4681122b-f846-42b3-a705-7d8f3f6ffc68 tempest-VolumesGetTest-1773245057 None] Flow 'volume_create_manager' (19e3e1a0-4d95-4318-abf4-99bf5a7bbab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:44:45 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-4681122b-f846-42b3-a705-7d8f3f6ffc68 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af1723af-0e19-49d6-b1ab-ed4fd9b0aa81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:45 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-4681122b-f846-42b3-a705-7d8f3f6ffc68 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af1723af-0e19-49d6-b1ab-ed4fd9b0aa81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:44:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1754176695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba34c08f-e322-4721-9427-1797666bde3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e516fd258b49497d9b6fe259af09b0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:44:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:44:45Z,use_quota=True,user_id='3b01103b9e864780af5a6824d10744f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:45 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-4681122b-f846-42b3-a705-7d8f3f6ffc68 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01edeb8b-98b9-43eb-9be8-01b47ad7c113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:45 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-4681122b-f846-42b3-a705-7d8f3f6ffc68 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01edeb8b-98b9-43eb-9be8-01b47ad7c113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:45 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-4681122b-f846-42b3-a705-7d8f3f6ffc68 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b219980d-f517-462d-8456-9a67895876a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:45 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-4681122b-f846-42b3-a705-7d8f3f6ffc68 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b219980d-f517-462d-8456-9a67895876a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba34c08f-e322-4721-9427-1797666bde3f', 'volume_name': 'volume-ba34c08f-e322-4721-9427-1797666bde3f', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:45 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-4681122b-f846-42b3-a705-7d8f3f6ffc68 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27b24d7a-0a32-4f93-a053-02447af4293c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:45 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-4681122b-f846-42b3-a705-7d8f3f6ffc68 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27b24d7a-0a32-4f93-a053-02447af4293c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:45 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-4681122b-f846-42b3-a705-7d8f3f6ffc68 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86449c64-db43-49f6-ba3d-08a388dccfaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:45 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-4681122b-f846-42b3-a705-7d8f3f6ffc68 tempest-VolumesGetTest-1773245057 None] Volume ba34c08f-e322-4721-9427-1797666bde3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba34c08f-e322-4721-9427-1797666bde3f', 'volume_size': 1} Jul 10 06:44:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-4681122b-f846-42b3-a705-7d8f3f6ffc68 tempest-VolumesGetTest-1773245057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:45 devstack sudo[96597]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-23dc5259-3235-471b-bd93-3f0bf7e458c0 tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8212d94d-5dfb-463f-9314-195c8e46c90e -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e.8c5e53a1-a6ba-431f-8deb-19680663be0b" returned: 0 in 0.865s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:45 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-23dc5259-3235-471b-bd93-3f0bf7e458c0 tempest-VolumesSnapshotTestJSON-2129310836 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e.8c5e53a1-a6ba-431f-8deb-19680663be0b is being set with open permissions: ugo+rw Jul 10 06:44:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-23dc5259-3235-471b-bd93-3f0bf7e458c0 tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e.8c5e53a1-a6ba-431f-8deb-19680663be0b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:45 devstack sudo[96602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e.8c5e53a1-a6ba-431f-8deb-19680663be0b Jul 10 06:44:45 devstack sudo[96602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:46 devstack sudo[96602]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-23dc5259-3235-471b-bd93-3f0bf7e458c0 tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e.8c5e53a1-a6ba-431f-8deb-19680663be0b" returned: 0 in 0.676s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-23dc5259-3235-471b-bd93-3f0bf7e458c0 tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:46 devstack sudo[96605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e.info Jul 10 06:44:46 devstack sudo[96605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:46 devstack sudo[96605]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-23dc5259-3235-471b-bd93-3f0bf7e458c0 tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e.info" returned: 0 in 0.673s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:46 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-23dc5259-3235-471b-bd93-3f0bf7e458c0 tempest-VolumesSnapshotTestJSON-2129310836 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e.info is being set with open permissions: ugo+rw Jul 10 06:44:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-23dc5259-3235-471b-bd93-3f0bf7e458c0 tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:46 devstack sudo[96608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e.info Jul 10 06:44:46 devstack sudo[96608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:47 devstack sudo[96608]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-23dc5259-3235-471b-bd93-3f0bf7e458c0 tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e.info" returned: 0 in 0.659s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-23dc5259-3235-471b-bd93-3f0bf7e458c0 tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.003s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-4681122b-f846-42b3-a705-7d8f3f6ffc68 tempest-VolumesGetTest-1773245057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.141s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:47 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-4681122b-f846-42b3-a705-7d8f3f6ffc68 tempest-VolumesGetTest-1773245057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:44:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1754176695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba34c08f-e322-4721-9427-1797666bde3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e516fd258b49497d9b6fe259af09b0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:44:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:44:45Z,use_quota=True,user_id='3b01103b9e864780af5a6824d10744f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:44:47 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-4681122b-f846-42b3-a705-7d8f3f6ffc68 tempest-VolumesGetTest-1773245057 None] Creating volume ba34c08f-e322-4721-9427-1797666bde3f {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:44:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-4681122b-f846-42b3-a705-7d8f3f6ffc68 tempest-VolumesGetTest-1773245057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-4681122b-f846-42b3-a705-7d8f3f6ffc68 tempest-VolumesGetTest-1773245057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:47 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-4681122b-f846-42b3-a705-7d8f3f6ffc68 tempest-VolumesGetTest-1773245057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:44:47 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-4681122b-f846-42b3-a705-7d8f3f6ffc68 tempest-VolumesGetTest-1773245057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:44:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-4681122b-f846-42b3-a705-7d8f3f6ffc68 tempest-VolumesGetTest-1773245057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:47 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-4681122b-f846-42b3-a705-7d8f3f6ffc68 tempest-VolumesGetTest-1773245057 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:44:47 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-4681122b-f846-42b3-a705-7d8f3f6ffc68 tempest-VolumesGetTest-1773245057 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:44:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-4681122b-f846-42b3-a705-7d8f3f6ffc68 tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:47 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f 1073741824 Jul 10 06:44:47 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:47 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-23dc5259-3235-471b-bd93-3f0bf7e458c0 tempest-VolumesSnapshotTestJSON-2129310836 None] Create snapshot completed successfully Jul 10 06:44:48 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:44:48 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Flow 'volume_create_manager' (ee8d9977-900c-4adc-a310-7bf86d36086b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:44:48 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daa09230-7cb6-484e-a67f-c2dd152e15e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:48 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daa09230-7cb6-484e-a67f-c2dd152e15e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:44:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-867746226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b23ee356-c806-4f86-a3e1-3fbb6fb91502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d624da3b98c346bab40a859ada5116c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:44:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=8c5e53a1-a6ba-431f-8deb-19680663be0b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:44:48Z,use_quota=True,user_id='d4bd965c4f35412b9dea43d58771b551',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:48 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f8b745a-9e23-49be-84b9-b255259530b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:48 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f8b745a-9e23-49be-84b9-b255259530b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:48 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0cc7bec-87dc-42a8-81ea-b93949360303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:48 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0cc7bec-87dc-42a8-81ea-b93949360303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b23ee356-c806-4f86-a3e1-3fbb6fb91502', 'volume_name': 'volume-b23ee356-c806-4f86-a3e1-3fbb6fb91502', 'volume_size': 2, 'snapshot_id': '8c5e53a1-a6ba-431f-8deb-19680663be0b'}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:48 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6f8ee87-4e8d-4746-b584-6784be1dbc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:48 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6f8ee87-4e8d-4746-b584-6784be1dbc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:48 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (735874d0-de44-48c2-b05d-b494f6f21cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:48 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Volume b23ee356-c806-4f86-a3e1-3fbb6fb91502: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b23ee356-c806-4f86-a3e1-3fbb6fb91502', 'volume_size': 2, 'snapshot_id': '8c5e53a1-a6ba-431f-8deb-19680663be0b'} Jul 10 06:44:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:48 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-4681122b-f846-42b3-a705-7d8f3f6ffc68 tempest-VolumesGetTest-1773245057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f 1073741824" returned: 0 in 1.028s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-4681122b-f846-42b3-a705-7d8f3f6ffc68 tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:48 devstack sudo[96617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f Jul 10 06:44:48 devstack sudo[96617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:49 devstack sudo[96617]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-4681122b-f846-42b3-a705-7d8f3f6ffc68 tempest-VolumesGetTest-1773245057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f" returned: 0 in 0.786s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:49 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-4681122b-f846-42b3-a705-7d8f3f6ffc68 tempest-VolumesGetTest-1773245057 None] <== create_volume: return (1907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:44:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-4681122b-f846-42b3-a705-7d8f3f6ffc68 tempest-VolumesGetTest-1773245057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.912s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.975s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:49 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Acquiring lock "cinder-quobyte-8c5e53a1-a6ba-431f-8deb-19680663be0b-b23ee356-c806-4f86-a3e1-3fbb6fb91502" by "_create_volume_from_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:44:49 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-4681122b-f846-42b3-a705-7d8f3f6ffc68 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86449c64-db43-49f6-ba3d-08a388dccfaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba34c08f-e322-4721-9427-1797666bde3f', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:49 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-4681122b-f846-42b3-a705-7d8f3f6ffc68 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (570bb3b0-81fd-4ff5-bd8c-1eb34f90165b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:49 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "cinder-quobyte-8c5e53a1-a6ba-431f-8deb-19680663be0b-b23ee356-c806-4f86-a3e1-3fbb6fb91502" acquired by "_create_volume_from_snapshot" :: waited 0.055s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:44:49 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Creating volume b23ee356-c806-4f86-a3e1-3fbb6fb91502 from snapshot 8c5e53a1-a6ba-431f-8deb-19680663be0b {{(pid=87294) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 06:44:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:49 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:44:49 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:44:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:49 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:44:49 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Acquiring lock "cinder-quobyte-b23ee356-c806-4f86-a3e1-3fbb6fb91502" by "_copy_volume_from_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:44:49 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-4681122b-f846-42b3-a705-7d8f3f6ffc68 tempest-VolumesGetTest-1773245057 None] Volume volume-ba34c08f-e322-4721-9427-1797666bde3f (ba34c08f-e322-4721-9427-1797666bde3f): created successfully Jul 10 06:44:49 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-4681122b-f846-42b3-a705-7d8f3f6ffc68 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (570bb3b0-81fd-4ff5-bd8c-1eb34f90165b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:49 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-4681122b-f846-42b3-a705-7d8f3f6ffc68 tempest-VolumesGetTest-1773245057 None] Flow 'volume_create_manager' (19e3e1a0-4d95-4318-abf4-99bf5a7bbab6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:44:49 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "cinder-quobyte-b23ee356-c806-4f86-a3e1-3fbb6fb91502" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:44:49 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] snapshot: 8c5e53a1-a6ba-431f-8deb-19680663be0b, volume: b23ee356-c806-4f86-a3e1-3fbb6fb91502, {{(pid=87294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 06:44:49 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-4681122b-f846-42b3-a705-7d8f3f6ffc68 tempest-VolumesGetTest-1773245057 None] Created volume successfully. Jul 10 06:44:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:49 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:44:49 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:44:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:49 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[2020ef63-e21f-456c-8c01-96a6a4d0a2fb]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:44:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e.8c5e53a1-a6ba-431f-8deb-19680663be0b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:49 devstack sudo[96621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e.8c5e53a1-a6ba-431f-8deb-19680663be0b Jul 10 06:44:49 devstack sudo[96621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:50 devstack sudo[96621]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e.8c5e53a1-a6ba-431f-8deb-19680663be0b" returned: 0 in 0.836s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:50 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8212d94d-5dfb-463f-9314-195c8e46c90e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:44:50 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e {{(pid=87294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 06:44:50 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Creating direct copy from snapshot {{(pid=87294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 06:44:50 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cdc308-867d-43c7-8522-81edcdf42045]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:44:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:50 devstack sudo[96626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e Jul 10 06:44:50 devstack sudo[96626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:51 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:44:51 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Flow 'volume_create_manager' (33b491d7-bab3-4471-a8ea-e4f4b03a7c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:44:51 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e74b624-fc1c-4a3e-9961-d25222ffcde5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:51 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e74b624-fc1c-4a3e-9961-d25222ffcde5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1205408116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0129266-c72c-463d-b746-2b71fb0ebab1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e516fd258b49497d9b6fe259af09b0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=ba34c08f-e322-4721-9427-1797666bde3f,status='creating',terminated_at=None,updated_at=2026-07-10T04:44:51Z,use_quota=True,user_id='3b01103b9e864780af5a6824d10744f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:51 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cddbbdcf-1523-4c7a-81a2-aab6569e5102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:51 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cddbbdcf-1523-4c7a-81a2-aab6569e5102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:51 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c8516bf-e2d1-4a80-9423-47400289c666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:51 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c8516bf-e2d1-4a80-9423-47400289c666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e0129266-c72c-463d-b746-2b71fb0ebab1', 'volume_name': 'volume-e0129266-c72c-463d-b746-2b71fb0ebab1', 'volume_size': 1, 'source_volid': 'ba34c08f-e322-4721-9427-1797666bde3f', 'source_volstatus': 'available'}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:51 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d60b079f-7ef9-4b76-82b9-b6571a452ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:51 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d60b079f-7ef9-4b76-82b9-b6571a452ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:51 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4d1380d-1cd5-4899-b9db-9130e441b565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:51 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Volume e0129266-c72c-463d-b746-2b71fb0ebab1: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e0129266-c72c-463d-b746-2b71fb0ebab1', 'volume_size': 1, 'source_volid': 'ba34c08f-e322-4721-9427-1797666bde3f', 'source_volstatus': 'available'} Jul 10 06:44:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:51 devstack sudo[96626]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e" returned: 0 in 0.883s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:51 devstack cinder-volume[87294]: DEBUG cinder.utils [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Path /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b23ee356-c806-4f86-a3e1-3fbb6fb91502 not found in is_blk_device check {{(pid=87294) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 06:44:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b23ee356-c806-4f86-a3e1-3fbb6fb91502 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:51 devstack sudo[96632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b23ee356-c806-4f86-a3e1-3fbb6fb91502 Jul 10 06:44:51 devstack sudo[96632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:52 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e116804-6999-4915-a939-ce03400ec627 tempest-VolumesListTestJSON-2135069663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:44:52 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-8e116804-6999-4915-a939-ce03400ec627 tempest-VolumesListTestJSON-2135069663 None] Flow 'volume_create_manager' (d36cb445-f7d1-40a8-aaf4-fac489db955c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:44:52 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-8e116804-6999-4915-a939-ce03400ec627 tempest-VolumesListTestJSON-2135069663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9c85eb4-0d3c-4212-b710-7f167b92140b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:52 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-8e116804-6999-4915-a939-ce03400ec627 tempest-VolumesListTestJSON-2135069663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9c85eb4-0d3c-4212-b710-7f167b92140b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-287118530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71a6b200-8790-48c5-940d-d7505666ac5b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='75a4eba11ddb42f590fddad3727226b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:44:52Z,use_quota=True,user_id='5611bf15d0bd473ebc157310a2c9a580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:52 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-8e116804-6999-4915-a939-ce03400ec627 tempest-VolumesListTestJSON-2135069663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2497e936-78c6-4147-8bf9-73c33d231d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:52 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-8e116804-6999-4915-a939-ce03400ec627 tempest-VolumesListTestJSON-2135069663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2497e936-78c6-4147-8bf9-73c33d231d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:52 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-8e116804-6999-4915-a939-ce03400ec627 tempest-VolumesListTestJSON-2135069663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35bf2b25-82cc-4b2e-815b-55ff8a1a9c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:52 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-8e116804-6999-4915-a939-ce03400ec627 tempest-VolumesListTestJSON-2135069663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35bf2b25-82cc-4b2e-815b-55ff8a1a9c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71a6b200-8790-48c5-940d-d7505666ac5b', 'volume_name': 'volume-71a6b200-8790-48c5-940d-d7505666ac5b', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:52 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-8e116804-6999-4915-a939-ce03400ec627 tempest-VolumesListTestJSON-2135069663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a4050d8-f0aa-4b8d-bf15-dc23f7a0c6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:52 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-8e116804-6999-4915-a939-ce03400ec627 tempest-VolumesListTestJSON-2135069663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a4050d8-f0aa-4b8d-bf15-dc23f7a0c6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:52 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-8e116804-6999-4915-a939-ce03400ec627 tempest-VolumesListTestJSON-2135069663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6ba426f-9977-4a00-9332-efefd30b243f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:52 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-8e116804-6999-4915-a939-ce03400ec627 tempest-VolumesListTestJSON-2135069663 None] Volume 71a6b200-8790-48c5-940d-d7505666ac5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71a6b200-8790-48c5-940d-d7505666ac5b', 'volume_size': 1} Jul 10 06:44:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-8e116804-6999-4915-a939-ce03400ec627 tempest-VolumesListTestJSON-2135069663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:54 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0b44f9d-b3d9-4bbe-aad0-1d83e78cc534 tempest-AttachVolumeTestJSON-1155117856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:44:54 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b0b44f9d-b3d9-4bbe-aad0-1d83e78cc534 tempest-AttachVolumeTestJSON-1155117856 None] Flow 'volume_create_manager' (fbcc9cee-9814-4e0a-9d57-0de0712aa90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:44:54 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b0b44f9d-b3d9-4bbe-aad0-1d83e78cc534 tempest-AttachVolumeTestJSON-1155117856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6c7384d-6d91-4a8d-82b8-9e0a6a22f121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:54 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b0b44f9d-b3d9-4bbe-aad0-1d83e78cc534 tempest-AttachVolumeTestJSON-1155117856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6c7384d-6d91-4a8d-82b8-9e0a6a22f121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2120173333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=783a9ec5-ae87-4fc3-a758-283c172ee2ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbc42550af72433497aac3c1eb3b6741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:44:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:44:55Z,use_quota=True,user_id='6d0a6c06d30f4c2b9b4de6a4dc322e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:54 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b0b44f9d-b3d9-4bbe-aad0-1d83e78cc534 tempest-AttachVolumeTestJSON-1155117856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53d89717-d5da-4cc9-938d-5b365b1b7a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:54 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b0b44f9d-b3d9-4bbe-aad0-1d83e78cc534 tempest-AttachVolumeTestJSON-1155117856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53d89717-d5da-4cc9-938d-5b365b1b7a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:54 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b0b44f9d-b3d9-4bbe-aad0-1d83e78cc534 tempest-AttachVolumeTestJSON-1155117856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8075f3e1-5817-4c29-9f1d-849dcf502b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:54 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b0b44f9d-b3d9-4bbe-aad0-1d83e78cc534 tempest-AttachVolumeTestJSON-1155117856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8075f3e1-5817-4c29-9f1d-849dcf502b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '783a9ec5-ae87-4fc3-a758-283c172ee2ee', 'volume_name': 'volume-783a9ec5-ae87-4fc3-a758-283c172ee2ee', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:54 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b0b44f9d-b3d9-4bbe-aad0-1d83e78cc534 tempest-AttachVolumeTestJSON-1155117856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccacfaa3-10cf-45ea-8895-86f0d9cbe969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:54 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b0b44f9d-b3d9-4bbe-aad0-1d83e78cc534 tempest-AttachVolumeTestJSON-1155117856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccacfaa3-10cf-45ea-8895-86f0d9cbe969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:54 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b0b44f9d-b3d9-4bbe-aad0-1d83e78cc534 tempest-AttachVolumeTestJSON-1155117856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e238d74-5511-40dc-be8b-62306f13d5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:54 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-b0b44f9d-b3d9-4bbe-aad0-1d83e78cc534 tempest-AttachVolumeTestJSON-1155117856 None] Volume 783a9ec5-ae87-4fc3-a758-283c172ee2ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-783a9ec5-ae87-4fc3-a758-283c172ee2ee', 'volume_size': 1} Jul 10 06:44:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b0b44f9d-b3d9-4bbe-aad0-1d83e78cc534 tempest-AttachVolumeTestJSON-1155117856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:56 devstack sudo[96632]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b23ee356-c806-4f86-a3e1-3fbb6fb91502" returned: 0 in 4.920s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:56 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[794c2e10-5aaf-49e1-8aac-33bf43cde2d3]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:44:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:56 devstack sudo[96648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e Jul 10 06:44:56 devstack sudo[96648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:57 devstack sudo[96648]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e" returned: 0 in 0.892s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:57 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e, size 1024.00 MB, duration 4.92 sec, destination /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b23ee356-c806-4f86-a3e1-3fbb6fb91502 {{(pid=87294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 06:44:57 devstack cinder-volume[87294]: INFO cinder.image.image_utils [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Converted 1024.00 MB image at 208.10 MB/s Jul 10 06:44:57 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b23ee356-c806-4f86-a3e1-3fbb6fb91502 is being set with open permissions: ugo+rw Jul 10 06:44:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b23ee356-c806-4f86-a3e1-3fbb6fb91502 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:57 devstack sudo[96655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b23ee356-c806-4f86-a3e1-3fbb6fb91502 Jul 10 06:44:57 devstack sudo[96655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:57 devstack sudo[96655]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b23ee356-c806-4f86-a3e1-3fbb6fb91502" returned: 0 in 0.634s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:57 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "cinder-quobyte-b23ee356-c806-4f86-a3e1-3fbb6fb91502" released by "_copy_volume_from_snapshot" :: held 8.270s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:44:57 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "cinder-quobyte-8c5e53a1-a6ba-431f-8deb-19680663be0b-b23ee356-c806-4f86-a3e1-3fbb6fb91502" released by "_create_volume_from_snapshot" :: held 8.317s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:44:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.375s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 6.496s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:57 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Cloning volume ba34c08f-e322-4721-9427-1797666bde3f to volume e0129266-c72c-463d-b746-2b71fb0ebab1 Jul 10 06:44:57 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:SELECT=95,cinder:INSERT=24,cinder:UPDATE=111,cinder:DELETE=10 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:44:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (735874d0-de44-48c2-b05d-b494f6f21cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b23ee356-c806-4f86-a3e1-3fbb6fb91502', 'volume_size': 2, 'snapshot_id': '8c5e53a1-a6ba-431f-8deb-19680663be0b'}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db150fb2-62eb-496f-87cb-b3186a2b6de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:44:57 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Creating offline snapshot c3cd90b5-890c-4e28-b9db-2651b9b9d7ca of volume ba34c08f-e322-4721-9427-1797666bde3f {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:44:57 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Volume volume-b23ee356-c806-4f86-a3e1-3fbb6fb91502 (b23ee356-c806-4f86-a3e1-3fbb6fb91502): created successfully Jul 10 06:44:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db150fb2-62eb-496f-87cb-b3186a2b6de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:44:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Flow 'volume_create_manager' (ee8d9977-900c-4adc-a310-7bf86d36086b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:44:57 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42c8f7b-de86-437c-95bd-08411017044a]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:44:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:57 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-2c02a239-6eb0-497e-babe-28a5ca2041d1 tempest-VolumesSnapshotTestJSON-2129310836 None] Created volume successfully. Jul 10 06:44:58 devstack sudo[96658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f Jul 10 06:44:58 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:58 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-3a2b2015-712d-4c62-a073-757574c19d83 tempest-VolumesSnapshotTestJSON-2129310836 None] Acquiring lock "cinder-b23ee356-c806-4f86-a3e1-3fbb6fb91502-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:44:58 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-3a2b2015-712d-4c62-a073-757574c19d83 tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "cinder-b23ee356-c806-4f86-a3e1-3fbb6fb91502-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:44:58 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-3a2b2015-712d-4c62-a073-757574c19d83 tempest-VolumesSnapshotTestJSON-2129310836 None] Acquiring lock "cinder-quobyte-b23ee356-c806-4f86-a3e1-3fbb6fb91502" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:44:58 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-3a2b2015-712d-4c62-a073-757574c19d83 tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "cinder-quobyte-b23ee356-c806-4f86-a3e1-3fbb6fb91502" acquired by "delete_volume" :: waited 0.018s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:44:58 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0e4dbb-f605-44cc-b492-15218c26481f]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:44:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3a2b2015-712d-4c62-a073-757574c19d83 tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b23ee356-c806-4f86-a3e1-3fbb6fb91502 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:58 devstack sudo[96660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b23ee356-c806-4f86-a3e1-3fbb6fb91502 Jul 10 06:44:58 devstack sudo[96660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:58 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f" returned: 0 in 0.768s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f.c3cd90b5-890c-4e28-b9db-2651b9b9d7ca 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:58 devstack sudo[96665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f.c3cd90b5-890c-4e28-b9db-2651b9b9d7ca 1G Jul 10 06:44:58 devstack sudo[96665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:59 devstack sudo[96660]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3a2b2015-712d-4c62-a073-757574c19d83 tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b23ee356-c806-4f86-a3e1-3fbb6fb91502" returned: 0 in 0.816s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3a2b2015-712d-4c62-a073-757574c19d83 tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b23ee356-c806-4f86-a3e1-3fbb6fb91502 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:59 devstack sudo[96670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b23ee356-c806-4f86-a3e1-3fbb6fb91502 Jul 10 06:44:59 devstack sudo[96670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:59 devstack sudo[96665]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f.c3cd90b5-890c-4e28-b9db-2651b9b9d7ca 1G" returned: 0 in 0.841s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba34c08f-e322-4721-9427-1797666bde3f -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f.c3cd90b5-890c-4e28-b9db-2651b9b9d7ca {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:59 devstack sudo[96677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba34c08f-e322-4721-9427-1797666bde3f -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f.c3cd90b5-890c-4e28-b9db-2651b9b9d7ca Jul 10 06:44:59 devstack sudo[96677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:44:59 devstack sudo[96670]: pam_unix(sudo:session): session closed for user root Jul 10 06:44:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3a2b2015-712d-4c62-a073-757574c19d83 tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b23ee356-c806-4f86-a3e1-3fbb6fb91502" returned: 0 in 0.651s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:44:59 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-3a2b2015-712d-4c62-a073-757574c19d83 tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "cinder-quobyte-b23ee356-c806-4f86-a3e1-3fbb6fb91502" released by "delete_volume" :: held 1.520s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:44:59 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-3a2b2015-712d-4c62-a073-757574c19d83 tempest-VolumesSnapshotTestJSON-2129310836 None] Created reservations ['cb998391-c40a-411e-b1c4-52fc343e6686', 'ef275cd6-76e3-468a-bf74-17e1c320bf49', 'e22fa84b-80a4-4991-b8b9-55c38379398c', '3c822b93-5359-4ac7-981e-749f56a545c6'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:44:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-3a2b2015-712d-4c62-a073-757574c19d83 tempest-VolumesSnapshotTestJSON-2129310836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:44:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-3a2b2015-712d-4c62-a073-757574c19d83 tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:44:59 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-3a2b2015-712d-4c62-a073-757574c19d83 tempest-VolumesSnapshotTestJSON-2129310836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:44:59 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-3a2b2015-712d-4c62-a073-757574c19d83 tempest-VolumesSnapshotTestJSON-2129310836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:44:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-3a2b2015-712d-4c62-a073-757574c19d83 tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:44:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3a2b2015-712d-4c62-a073-757574c19d83 tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:44:59 devstack sudo[96680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:44:59 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:00 devstack sudo[96677]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba34c08f-e322-4721-9427-1797666bde3f -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f.c3cd90b5-890c-4e28-b9db-2651b9b9d7ca" returned: 0 in 0.803s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:00 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f.c3cd90b5-890c-4e28-b9db-2651b9b9d7ca is being set with open permissions: ugo+rw Jul 10 06:45:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f.c3cd90b5-890c-4e28-b9db-2651b9b9d7ca {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:00 devstack sudo[96685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f.c3cd90b5-890c-4e28-b9db-2651b9b9d7ca Jul 10 06:45:00 devstack sudo[96685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:00 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7e51966b-e353-4466-b193-d57895720efc tempest-VolumesSnapshotTestJSON-2129310836 None] Acquiring lock "cinder-8c5e53a1-a6ba-431f-8deb-19680663be0b-delete_snapshot" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:00 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7e51966b-e353-4466-b193-d57895720efc tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "cinder-8c5e53a1-a6ba-431f-8deb-19680663be0b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:00 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7e51966b-e353-4466-b193-d57895720efc tempest-VolumesSnapshotTestJSON-2129310836 None] Acquiring lock "cinder-quobyte-8212d94d-5dfb-463f-9314-195c8e46c90e" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:00 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7e51966b-e353-4466-b193-d57895720efc tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "cinder-quobyte-8212d94d-5dfb-463f-9314-195c8e46c90e" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:00 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7e51966b-e353-4466-b193-d57895720efc tempest-VolumesSnapshotTestJSON-2129310836 None] Acquiring lock "cinder-quobyte-8c5e53a1-a6ba-431f-8deb-19680663be0b" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:00 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7e51966b-e353-4466-b193-d57895720efc tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "cinder-quobyte-8c5e53a1-a6ba-431f-8deb-19680663be0b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:00 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-7e51966b-e353-4466-b193-d57895720efc tempest-VolumesSnapshotTestJSON-2129310836 None] Deleting offline snapshot 8c5e53a1-a6ba-431f-8deb-19680663be0b of volume 8212d94d-5dfb-463f-9314-195c8e46c90e {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:45:00 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-7e51966b-e353-4466-b193-d57895720efc tempest-VolumesSnapshotTestJSON-2129310836 None] snapshot_file for this snap is: volume-8212d94d-5dfb-463f-9314-195c8e46c90e.8c5e53a1-a6ba-431f-8deb-19680663be0b {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:45:00 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[e019c29e-b001-45da-893e-d874912e5346]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:45:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7e51966b-e353-4466-b193-d57895720efc tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e.8c5e53a1-a6ba-431f-8deb-19680663be0b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:00 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3a2b2015-712d-4c62-a073-757574c19d83 tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.714s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:00 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-3a2b2015-712d-4c62-a073-757574c19d83 tempest-VolumesSnapshotTestJSON-2129310836 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:45:00 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-3a2b2015-712d-4c62-a073-757574c19d83 tempest-VolumesSnapshotTestJSON-2129310836 None] Deleted volume successfully. Jul 10 06:45:00 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-3a2b2015-712d-4c62-a073-757574c19d83 tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "cinder-b23ee356-c806-4f86-a3e1-3fbb6fb91502-delete_volume" released by "delete_volume" :: held 2.441s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:00 devstack sudo[96688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e.8c5e53a1-a6ba-431f-8deb-19680663be0b Jul 10 06:45:00 devstack sudo[96688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:01 devstack sudo[96685]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f.c3cd90b5-890c-4e28-b9db-2651b9b9d7ca" returned: 0 in 0.733s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:01 devstack sudo[96691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f.info Jul 10 06:45:01 devstack sudo[96691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:01 devstack sudo[96688]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7e51966b-e353-4466-b193-d57895720efc tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e.8c5e53a1-a6ba-431f-8deb-19680663be0b" returned: 0 in 0.838s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:01 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-7e51966b-e353-4466-b193-d57895720efc tempest-VolumesSnapshotTestJSON-2129310836 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8212d94d-5dfb-463f-9314-195c8e46c90e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:45:01 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d79f4e6-04fb-44c0-b887-eb8d450816c2]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:45:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7e51966b-e353-4466-b193-d57895720efc tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:01 devstack sudo[96699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e Jul 10 06:45:01 devstack sudo[96699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:01 devstack sudo[96691]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f.info" returned: 0 in 0.694s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:01 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f.info is being set with open permissions: ugo+rw Jul 10 06:45:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:01 devstack sudo[96702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f.info Jul 10 06:45:01 devstack sudo[96702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:02 devstack sudo[96699]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7e51966b-e353-4466-b193-d57895720efc tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e" returned: 0 in 0.778s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7e51966b-e353-4466-b193-d57895720efc tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e.8c5e53a1-a6ba-431f-8deb-19680663be0b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:02 devstack sudo[96707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e.8c5e53a1-a6ba-431f-8deb-19680663be0b Jul 10 06:45:02 devstack sudo[96707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:02 devstack sudo[96702]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f.info" returned: 0 in 0.687s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:02 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Acquiring lock "cinder-quobyte-e0129266-c72c-463d-b746-2b71fb0ebab1" by "_copy_volume_from_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:02 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Lock "cinder-quobyte-e0129266-c72c-463d-b746-2b71fb0ebab1" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:02 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] snapshot: c3cd90b5-890c-4e28-b9db-2651b9b9d7ca, volume: e0129266-c72c-463d-b746-2b71fb0ebab1, {{(pid=87294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 06:45:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:02 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:45:02 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:45:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:02 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bdf337b-e93d-4c67-9c7f-5b99e0913fa6]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:45:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f.c3cd90b5-890c-4e28-b9db-2651b9b9d7ca {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:02 devstack sudo[96710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f.c3cd90b5-890c-4e28-b9db-2651b9b9d7ca Jul 10 06:45:02 devstack sudo[96710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:03 devstack sudo[96707]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7e51966b-e353-4466-b193-d57895720efc tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e.8c5e53a1-a6ba-431f-8deb-19680663be0b" returned: 0 in 0.727s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7e51966b-e353-4466-b193-d57895720efc tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e.8c5e53a1-a6ba-431f-8deb-19680663be0b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:03 devstack sudo[96715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e.8c5e53a1-a6ba-431f-8deb-19680663be0b Jul 10 06:45:03 devstack sudo[96715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:03 devstack sudo[96710]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f.c3cd90b5-890c-4e28-b9db-2651b9b9d7ca" returned: 0 in 0.832s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:03 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba34c08f-e322-4721-9427-1797666bde3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:45:03 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f {{(pid=87294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 06:45:03 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Creating direct copy from snapshot {{(pid=87294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 06:45:03 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[e603a91e-7d7c-47bf-8b4e-4027284968f1]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:45:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:03 devstack sudo[96720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f Jul 10 06:45:03 devstack sudo[96720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:03 devstack sudo[96715]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7e51966b-e353-4466-b193-d57895720efc tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e.8c5e53a1-a6ba-431f-8deb-19680663be0b" returned: 0 in 0.662s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:03 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7e51966b-e353-4466-b193-d57895720efc tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "cinder-quobyte-8c5e53a1-a6ba-431f-8deb-19680663be0b" released by "_delete_snapshot" :: held 3.122s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:03 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7e51966b-e353-4466-b193-d57895720efc tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "cinder-quobyte-8212d94d-5dfb-463f-9314-195c8e46c90e" released by "delete_snapshot" :: held 3.147s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:03 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-7e51966b-e353-4466-b193-d57895720efc tempest-VolumesSnapshotTestJSON-2129310836 None] Created reservations ['226523ae-ed1b-4d1d-a681-b4fcb198548a', '23fc5314-993e-47d4-97d1-d00d720d93a1', 'b9ed204f-c160-4aac-b40f-bbbe229c89a1', '2d6d7ad3-2dff-4f11-8109-cc3eb3c1cc7c'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:45:03 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-7e51966b-e353-4466-b193-d57895720efc tempest-VolumesSnapshotTestJSON-2129310836 None] Delete snapshot completed successfully. Jul 10 06:45:03 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7e51966b-e353-4466-b193-d57895720efc tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "cinder-8c5e53a1-a6ba-431f-8deb-19680663be0b-delete_snapshot" released by "delete_snapshot" :: held 3.310s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:04 devstack sudo[96720]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f" returned: 0 in 0.798s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:04 devstack cinder-volume[87294]: DEBUG cinder.utils [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Path /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e0129266-c72c-463d-b746-2b71fb0ebab1 not found in is_blk_device check {{(pid=87294) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 06:45:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e0129266-c72c-463d-b746-2b71fb0ebab1 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:04 devstack sudo[96726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e0129266-c72c-463d-b746-2b71fb0ebab1 Jul 10 06:45:04 devstack sudo[96726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:04 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b09a0d0b-a2cd-46f0-9223-fef8f8ebadad tempest-VolumesSnapshotTestJSON-2129310836 None] Acquiring lock "cinder-8212d94d-5dfb-463f-9314-195c8e46c90e-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:04 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b09a0d0b-a2cd-46f0-9223-fef8f8ebadad tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "cinder-8212d94d-5dfb-463f-9314-195c8e46c90e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:04 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b09a0d0b-a2cd-46f0-9223-fef8f8ebadad tempest-VolumesSnapshotTestJSON-2129310836 None] Acquiring lock "cinder-quobyte-8212d94d-5dfb-463f-9314-195c8e46c90e" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:04 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b09a0d0b-a2cd-46f0-9223-fef8f8ebadad tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "cinder-quobyte-8212d94d-5dfb-463f-9314-195c8e46c90e" acquired by "delete_volume" :: waited 0.021s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:04 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b147e7-fb81-4437-a8a4-423131bb9a4c]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:45:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b09a0d0b-a2cd-46f0-9223-fef8f8ebadad tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:05 devstack sudo[96732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e Jul 10 06:45:05 devstack sudo[96732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:06 devstack sudo[96732]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b09a0d0b-a2cd-46f0-9223-fef8f8ebadad tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e" returned: 0 in 1.457s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b09a0d0b-a2cd-46f0-9223-fef8f8ebadad tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:06 devstack sudo[96743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e Jul 10 06:45:06 devstack sudo[96743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:07 devstack sudo[96743]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b09a0d0b-a2cd-46f0-9223-fef8f8ebadad tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8212d94d-5dfb-463f-9314-195c8e46c90e" returned: 0 in 1.237s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:07 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b09a0d0b-a2cd-46f0-9223-fef8f8ebadad tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "cinder-quobyte-8212d94d-5dfb-463f-9314-195c8e46c90e" released by "delete_volume" :: held 2.785s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:07 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-b09a0d0b-a2cd-46f0-9223-fef8f8ebadad tempest-VolumesSnapshotTestJSON-2129310836 None] Created reservations ['a9eebc5e-6d74-48ec-8a71-6bf762273df8', '235254da-6c15-4a60-85de-f3121ec61719', '32cab7cf-e6df-472f-a930-2ad65c9fc597', '8a066bad-2c65-4992-aed1-7e2ff421953e'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:45:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b09a0d0b-a2cd-46f0-9223-fef8f8ebadad tempest-VolumesSnapshotTestJSON-2129310836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b09a0d0b-a2cd-46f0-9223-fef8f8ebadad tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:07 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b09a0d0b-a2cd-46f0-9223-fef8f8ebadad tempest-VolumesSnapshotTestJSON-2129310836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:45:07 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b09a0d0b-a2cd-46f0-9223-fef8f8ebadad tempest-VolumesSnapshotTestJSON-2129310836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:45:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b09a0d0b-a2cd-46f0-9223-fef8f8ebadad tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b09a0d0b-a2cd-46f0-9223-fef8f8ebadad tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:08 devstack sudo[96747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:45:08 devstack sudo[96747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:09 devstack sudo[96747]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b09a0d0b-a2cd-46f0-9223-fef8f8ebadad tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.103s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:09 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-b09a0d0b-a2cd-46f0-9223-fef8f8ebadad tempest-VolumesSnapshotTestJSON-2129310836 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:45:09 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-b09a0d0b-a2cd-46f0-9223-fef8f8ebadad tempest-VolumesSnapshotTestJSON-2129310836 None] Deleted volume successfully. Jul 10 06:45:09 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b09a0d0b-a2cd-46f0-9223-fef8f8ebadad tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "cinder-8212d94d-5dfb-463f-9314-195c8e46c90e-delete_volume" released by "delete_volume" :: held 4.323s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:09 devstack sudo[96726]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e0129266-c72c-463d-b746-2b71fb0ebab1" returned: 0 in 5.338s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:09 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf60883-b228-4c0a-9ff9-a9b41459c12e]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:45:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:09 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:SELECT=102,cinder:DELETE=8,cinder:UPDATE=111,cinder:INSERT=28 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:45:09 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcd4c013-d7ca-433a-b58d-c9f9c14c24b7 tempest-VolumesSnapshotTestJSON-2129310836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:45:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dcd4c013-d7ca-433a-b58d-c9f9c14c24b7 tempest-VolumesSnapshotTestJSON-2129310836 None] Flow 'volume_create_manager' (f18f8468-af97-4287-9811-14fd6e9db08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:45:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dcd4c013-d7ca-433a-b58d-c9f9c14c24b7 tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f14f2188-1c5f-4b3e-b48a-1291f317242e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dcd4c013-d7ca-433a-b58d-c9f9c14c24b7 tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f14f2188-1c5f-4b3e-b48a-1291f317242e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1554987270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ededd08-11bd-410c-9296-42a307f8f184,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d624da3b98c346bab40a859ada5116c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:45:10Z,use_quota=True,user_id='d4bd965c4f35412b9dea43d58771b551',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dcd4c013-d7ca-433a-b58d-c9f9c14c24b7 tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1b56e17-0cef-4f28-a230-3f20d0626838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dcd4c013-d7ca-433a-b58d-c9f9c14c24b7 tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1b56e17-0cef-4f28-a230-3f20d0626838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dcd4c013-d7ca-433a-b58d-c9f9c14c24b7 tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (740b5ee3-dda0-4dae-a884-233fab3737cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dcd4c013-d7ca-433a-b58d-c9f9c14c24b7 tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (740b5ee3-dda0-4dae-a884-233fab3737cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ededd08-11bd-410c-9296-42a307f8f184', 'volume_name': 'volume-7ededd08-11bd-410c-9296-42a307f8f184', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:09 devstack sudo[96751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f Jul 10 06:45:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dcd4c013-d7ca-433a-b58d-c9f9c14c24b7 tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb1549bd-86fc-4ce5-9249-be0170f511cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:09 devstack sudo[96751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dcd4c013-d7ca-433a-b58d-c9f9c14c24b7 tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb1549bd-86fc-4ce5-9249-be0170f511cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dcd4c013-d7ca-433a-b58d-c9f9c14c24b7 tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72b49e32-bc0a-45ed-bca8-29945cc6ff06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:09 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-dcd4c013-d7ca-433a-b58d-c9f9c14c24b7 tempest-VolumesSnapshotTestJSON-2129310836 None] Volume 7ededd08-11bd-410c-9296-42a307f8f184: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ededd08-11bd-410c-9296-42a307f8f184', 'volume_size': 1} Jul 10 06:45:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-dcd4c013-d7ca-433a-b58d-c9f9c14c24b7 tempest-VolumesSnapshotTestJSON-2129310836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:10 devstack sudo[96751]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f" returned: 0 in 0.882s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:10 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f, size 1024.00 MB, duration 5.34 sec, destination /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e0129266-c72c-463d-b746-2b71fb0ebab1 {{(pid=87294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 06:45:10 devstack cinder-volume[87294]: INFO cinder.image.image_utils [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Converted 1024.00 MB image at 191.78 MB/s Jul 10 06:45:10 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e0129266-c72c-463d-b746-2b71fb0ebab1 is being set with open permissions: ugo+rw Jul 10 06:45:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e0129266-c72c-463d-b746-2b71fb0ebab1 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:10 devstack sudo[96756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e0129266-c72c-463d-b746-2b71fb0ebab1 Jul 10 06:45:10 devstack sudo[96756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:11 devstack sudo[96756]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e0129266-c72c-463d-b746-2b71fb0ebab1" returned: 0 in 0.602s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:11 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Lock "cinder-quobyte-e0129266-c72c-463d-b746-2b71fb0ebab1" released by "_copy_volume_from_snapshot" :: held 8.540s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:11 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Acquiring lock "cinder-quobyte-c3cd90b5-890c-4e28-b9db-2651b9b9d7ca" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:11 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Lock "cinder-quobyte-c3cd90b5-890c-4e28-b9db-2651b9b9d7ca" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:11 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Deleting offline snapshot c3cd90b5-890c-4e28-b9db-2651b9b9d7ca of volume ba34c08f-e322-4721-9427-1797666bde3f {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:45:11 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] snapshot_file for this snap is: volume-ba34c08f-e322-4721-9427-1797666bde3f.c3cd90b5-890c-4e28-b9db-2651b9b9d7ca {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:45:11 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[de094598-1062-4a42-bf52-3bce484ad088]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:45:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f.c3cd90b5-890c-4e28-b9db-2651b9b9d7ca {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:11 devstack sudo[96759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f.c3cd90b5-890c-4e28-b9db-2651b9b9d7ca Jul 10 06:45:11 devstack sudo[96759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:11 devstack sudo[96759]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f.c3cd90b5-890c-4e28-b9db-2651b9b9d7ca" returned: 0 in 0.721s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:11 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba34c08f-e322-4721-9427-1797666bde3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:45:11 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cc7886-878b-4a15-adee-b7902fb02da9]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:45:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:11 devstack sudo[96764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f Jul 10 06:45:11 devstack sudo[96764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:12 devstack sudo[96764]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f" returned: 0 in 0.734s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f.c3cd90b5-890c-4e28-b9db-2651b9b9d7ca {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:12 devstack sudo[96769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f.c3cd90b5-890c-4e28-b9db-2651b9b9d7ca Jul 10 06:45:12 devstack sudo[96769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:13 devstack sudo[96769]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f.c3cd90b5-890c-4e28-b9db-2651b9b9d7ca" returned: 0 in 0.681s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f.c3cd90b5-890c-4e28-b9db-2651b9b9d7ca {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:13 devstack sudo[96774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f.c3cd90b5-890c-4e28-b9db-2651b9b9d7ca Jul 10 06:45:13 devstack sudo[96774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:13 devstack sudo[96774]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f.c3cd90b5-890c-4e28-b9db-2651b9b9d7ca" returned: 0 in 0.617s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:13 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Lock "cinder-quobyte-c3cd90b5-890c-4e28-b9db-2651b9b9d7ca" released by "_delete_snapshot" :: held 2.850s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.150s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-8e116804-6999-4915-a939-ce03400ec627 tempest-VolumesListTestJSON-2135069663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.443s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:13 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-8e116804-6999-4915-a939-ce03400ec627 tempest-VolumesListTestJSON-2135069663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-287118530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71a6b200-8790-48c5-940d-d7505666ac5b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='75a4eba11ddb42f590fddad3727226b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:44:52Z,use_quota=True,user_id='5611bf15d0bd473ebc157310a2c9a580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:45:13 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-8e116804-6999-4915-a939-ce03400ec627 tempest-VolumesListTestJSON-2135069663 None] Creating volume 71a6b200-8790-48c5-940d-d7505666ac5b {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:45:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-8e116804-6999-4915-a939-ce03400ec627 tempest-VolumesListTestJSON-2135069663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-8e116804-6999-4915-a939-ce03400ec627 tempest-VolumesListTestJSON-2135069663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:13 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-8e116804-6999-4915-a939-ce03400ec627 tempest-VolumesListTestJSON-2135069663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:45:13 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-8e116804-6999-4915-a939-ce03400ec627 tempest-VolumesListTestJSON-2135069663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:45:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-8e116804-6999-4915-a939-ce03400ec627 tempest-VolumesListTestJSON-2135069663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:13 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-8e116804-6999-4915-a939-ce03400ec627 tempest-VolumesListTestJSON-2135069663 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:45:13 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-8e116804-6999-4915-a939-ce03400ec627 tempest-VolumesListTestJSON-2135069663 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:45:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8e116804-6999-4915-a939-ce03400ec627 tempest-VolumesListTestJSON-2135069663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-71a6b200-8790-48c5-940d-d7505666ac5b 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:14 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4d1380d-1cd5-4899-b9db-9130e441b565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0129266-c72c-463d-b746-2b71fb0ebab1', 'volume_size': 1, 'source_volid': 'ba34c08f-e322-4721-9427-1797666bde3f', 'source_volstatus': 'available'}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:14 devstack sudo[96777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-71a6b200-8790-48c5-940d-d7505666ac5b 1073741824 Jul 10 06:45:14 devstack sudo[96777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:14 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e459842-716e-4ae2-a375-368245f22e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:14 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Volume volume-e0129266-c72c-463d-b746-2b71fb0ebab1 (e0129266-c72c-463d-b746-2b71fb0ebab1): created successfully Jul 10 06:45:14 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e459842-716e-4ae2-a375-368245f22e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:14 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Flow 'volume_create_manager' (33b491d7-bab3-4471-a8ea-e4f4b03a7c43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:45:14 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-f51ba498-7209-4ae7-bde2-f6e33d412ab7 tempest-VolumesGetTest-1773245057 None] Created volume successfully. Jul 10 06:45:14 devstack sudo[96777]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8e116804-6999-4915-a939-ce03400ec627 tempest-VolumesListTestJSON-2135069663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-71a6b200-8790-48c5-940d-d7505666ac5b 1073741824" returned: 0 in 0.787s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8e116804-6999-4915-a939-ce03400ec627 tempest-VolumesListTestJSON-2135069663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-71a6b200-8790-48c5-940d-d7505666ac5b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:14 devstack sudo[96782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-71a6b200-8790-48c5-940d-d7505666ac5b Jul 10 06:45:14 devstack sudo[96782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:15 devstack sudo[96782]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8e116804-6999-4915-a939-ce03400ec627 tempest-VolumesListTestJSON-2135069663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-71a6b200-8790-48c5-940d-d7505666ac5b" returned: 0 in 0.639s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:15 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-8e116804-6999-4915-a939-ce03400ec627 tempest-VolumesListTestJSON-2135069663 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:45:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-8e116804-6999-4915-a939-ce03400ec627 tempest-VolumesListTestJSON-2135069663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b0b44f9d-b3d9-4bbe-aad0-1d83e78cc534 tempest-AttachVolumeTestJSON-1155117856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.670s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:15 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b0b44f9d-b3d9-4bbe-aad0-1d83e78cc534 tempest-AttachVolumeTestJSON-1155117856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2120173333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=783a9ec5-ae87-4fc3-a758-283c172ee2ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbc42550af72433497aac3c1eb3b6741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:44:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:44:55Z,use_quota=True,user_id='6d0a6c06d30f4c2b9b4de6a4dc322e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:45:15 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-b0b44f9d-b3d9-4bbe-aad0-1d83e78cc534 tempest-AttachVolumeTestJSON-1155117856 None] Creating volume 783a9ec5-ae87-4fc3-a758-283c172ee2ee {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:45:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b0b44f9d-b3d9-4bbe-aad0-1d83e78cc534 tempest-AttachVolumeTestJSON-1155117856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b0b44f9d-b3d9-4bbe-aad0-1d83e78cc534 tempest-AttachVolumeTestJSON-1155117856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:15 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b0b44f9d-b3d9-4bbe-aad0-1d83e78cc534 tempest-AttachVolumeTestJSON-1155117856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:45:15 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b0b44f9d-b3d9-4bbe-aad0-1d83e78cc534 tempest-AttachVolumeTestJSON-1155117856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:45:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b0b44f9d-b3d9-4bbe-aad0-1d83e78cc534 tempest-AttachVolumeTestJSON-1155117856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:15 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b0b44f9d-b3d9-4bbe-aad0-1d83e78cc534 tempest-AttachVolumeTestJSON-1155117856 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:45:15 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-b0b44f9d-b3d9-4bbe-aad0-1d83e78cc534 tempest-AttachVolumeTestJSON-1155117856 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:45:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b0b44f9d-b3d9-4bbe-aad0-1d83e78cc534 tempest-AttachVolumeTestJSON-1155117856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-783a9ec5-ae87-4fc3-a758-283c172ee2ee 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-8e116804-6999-4915-a939-ce03400ec627 tempest-VolumesListTestJSON-2135069663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6ba426f-9977-4a00-9332-efefd30b243f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71a6b200-8790-48c5-940d-d7505666ac5b', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:15 devstack sudo[96785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-783a9ec5-ae87-4fc3-a758-283c172ee2ee 1073741824 Jul 10 06:45:15 devstack sudo[96785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-8e116804-6999-4915-a939-ce03400ec627 tempest-VolumesListTestJSON-2135069663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bcafbc4-2f22-44aa-bb97-87422300a4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:15 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-8e116804-6999-4915-a939-ce03400ec627 tempest-VolumesListTestJSON-2135069663 None] Volume volume-71a6b200-8790-48c5-940d-d7505666ac5b (71a6b200-8790-48c5-940d-d7505666ac5b): created successfully Jul 10 06:45:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-8e116804-6999-4915-a939-ce03400ec627 tempest-VolumesListTestJSON-2135069663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bcafbc4-2f22-44aa-bb97-87422300a4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-8e116804-6999-4915-a939-ce03400ec627 tempest-VolumesListTestJSON-2135069663 None] Flow 'volume_create_manager' (d36cb445-f7d1-40a8-aaf4-fac489db955c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:45:15 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-8e116804-6999-4915-a939-ce03400ec627 tempest-VolumesListTestJSON-2135069663 None] Created volume successfully. Jul 10 06:45:15 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-87ad291f-686f-436e-a216-a733c032e6be tempest-VolumesGetTest-1773245057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:45:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-87ad291f-686f-436e-a216-a733c032e6be tempest-VolumesGetTest-1773245057 None] Flow 'volume_create_manager' (cb57ae4a-7738-4220-a169-abb549ef7654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:45:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-87ad291f-686f-436e-a216-a733c032e6be tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a512ca97-5769-458b-8cb0-e7ed3c70f03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-87ad291f-686f-436e-a216-a733c032e6be tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a512ca97-5769-458b-8cb0-e7ed3c70f03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:45:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-70506572',display_name='tempest-VolumesGetTest-Volume-1181330909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acd72fd0-3d28-46dd-9943-8010936ce41a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e516fd258b49497d9b6fe259af09b0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:45:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:45:16Z,use_quota=True,user_id='3b01103b9e864780af5a6824d10744f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-87ad291f-686f-436e-a216-a733c032e6be tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2483039f-dd4c-4856-9d6e-fcab3104ace1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-87ad291f-686f-436e-a216-a733c032e6be tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2483039f-dd4c-4856-9d6e-fcab3104ace1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-87ad291f-686f-436e-a216-a733c032e6be tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (401f7dbf-c4ec-4d6f-95d7-0c74a5a54c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-87ad291f-686f-436e-a216-a733c032e6be tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (401f7dbf-c4ec-4d6f-95d7-0c74a5a54c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acd72fd0-3d28-46dd-9943-8010936ce41a', 'volume_name': 'volume-acd72fd0-3d28-46dd-9943-8010936ce41a', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-87ad291f-686f-436e-a216-a733c032e6be tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8f4a1a8-f18d-402c-91e6-1daddb1473f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-87ad291f-686f-436e-a216-a733c032e6be tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8f4a1a8-f18d-402c-91e6-1daddb1473f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-87ad291f-686f-436e-a216-a733c032e6be tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68eb18b6-4435-44d9-8b70-0bc9529f5851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:16 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-87ad291f-686f-436e-a216-a733c032e6be tempest-VolumesGetTest-1773245057 None] Volume acd72fd0-3d28-46dd-9943-8010936ce41a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acd72fd0-3d28-46dd-9943-8010936ce41a', 'volume_size': 1} Jul 10 06:45:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-87ad291f-686f-436e-a216-a733c032e6be tempest-VolumesGetTest-1773245057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:16 devstack sudo[96785]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b0b44f9d-b3d9-4bbe-aad0-1d83e78cc534 tempest-AttachVolumeTestJSON-1155117856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-783a9ec5-ae87-4fc3-a758-283c172ee2ee 1073741824" returned: 0 in 0.878s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b0b44f9d-b3d9-4bbe-aad0-1d83e78cc534 tempest-AttachVolumeTestJSON-1155117856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-783a9ec5-ae87-4fc3-a758-283c172ee2ee {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:16 devstack sudo[96791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-783a9ec5-ae87-4fc3-a758-283c172ee2ee Jul 10 06:45:16 devstack sudo[96791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:16 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-93b1aa00-c854-46e0-96d8-7e3235c547bb tempest-VolumesListTestJSON-2135069663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:45:16 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-93b1aa00-c854-46e0-96d8-7e3235c547bb tempest-VolumesListTestJSON-2135069663 None] Flow 'volume_create_manager' (f7646ea0-985f-45ca-b9bc-d25af2b8d80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:45:16 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-93b1aa00-c854-46e0-96d8-7e3235c547bb tempest-VolumesListTestJSON-2135069663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be2e8971-3885-4f0c-a534-c15f5a6f2a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:16 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-93b1aa00-c854-46e0-96d8-7e3235c547bb tempest-VolumesListTestJSON-2135069663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be2e8971-3885-4f0c-a534-c15f5a6f2a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-606526349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2be82d89-e3b4-47d2-9ef7-2b8a78ebb687,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='75a4eba11ddb42f590fddad3727226b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:45:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:45:17Z,use_quota=True,user_id='5611bf15d0bd473ebc157310a2c9a580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:16 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-93b1aa00-c854-46e0-96d8-7e3235c547bb tempest-VolumesListTestJSON-2135069663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f523477-d340-45e3-8b5f-dcc071c2a789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-93b1aa00-c854-46e0-96d8-7e3235c547bb tempest-VolumesListTestJSON-2135069663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f523477-d340-45e3-8b5f-dcc071c2a789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-93b1aa00-c854-46e0-96d8-7e3235c547bb tempest-VolumesListTestJSON-2135069663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acf3fa29-3841-4fc3-869d-4d7e6c06bd8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-93b1aa00-c854-46e0-96d8-7e3235c547bb tempest-VolumesListTestJSON-2135069663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acf3fa29-3841-4fc3-869d-4d7e6c06bd8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2be82d89-e3b4-47d2-9ef7-2b8a78ebb687', 'volume_name': 'volume-2be82d89-e3b4-47d2-9ef7-2b8a78ebb687', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-93b1aa00-c854-46e0-96d8-7e3235c547bb tempest-VolumesListTestJSON-2135069663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aeea6b6-57c1-4a17-8f82-bfe810f55d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-93b1aa00-c854-46e0-96d8-7e3235c547bb tempest-VolumesListTestJSON-2135069663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aeea6b6-57c1-4a17-8f82-bfe810f55d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-93b1aa00-c854-46e0-96d8-7e3235c547bb tempest-VolumesListTestJSON-2135069663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbeefd93-47c0-4e34-91df-732fd3941e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:17 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-93b1aa00-c854-46e0-96d8-7e3235c547bb tempest-VolumesListTestJSON-2135069663 None] Volume 2be82d89-e3b4-47d2-9ef7-2b8a78ebb687: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2be82d89-e3b4-47d2-9ef7-2b8a78ebb687', 'volume_size': 1} Jul 10 06:45:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-93b1aa00-c854-46e0-96d8-7e3235c547bb tempest-VolumesListTestJSON-2135069663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:17 devstack sudo[96791]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b0b44f9d-b3d9-4bbe-aad0-1d83e78cc534 tempest-AttachVolumeTestJSON-1155117856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-783a9ec5-ae87-4fc3-a758-283c172ee2ee" returned: 0 in 0.810s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:17 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b0b44f9d-b3d9-4bbe-aad0-1d83e78cc534 tempest-AttachVolumeTestJSON-1155117856 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:45:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b0b44f9d-b3d9-4bbe-aad0-1d83e78cc534 tempest-AttachVolumeTestJSON-1155117856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.732s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-dcd4c013-d7ca-433a-b58d-c9f9c14c24b7 tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.503s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:17 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-dcd4c013-d7ca-433a-b58d-c9f9c14c24b7 tempest-VolumesSnapshotTestJSON-2129310836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:45:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1554987270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ededd08-11bd-410c-9296-42a307f8f184,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d624da3b98c346bab40a859ada5116c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:45:10Z,use_quota=True,user_id='d4bd965c4f35412b9dea43d58771b551',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:45:17 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-dcd4c013-d7ca-433a-b58d-c9f9c14c24b7 tempest-VolumesSnapshotTestJSON-2129310836 None] Creating volume 7ededd08-11bd-410c-9296-42a307f8f184 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:45:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-dcd4c013-d7ca-433a-b58d-c9f9c14c24b7 tempest-VolumesSnapshotTestJSON-2129310836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-dcd4c013-d7ca-433a-b58d-c9f9c14c24b7 tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:17 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-dcd4c013-d7ca-433a-b58d-c9f9c14c24b7 tempest-VolumesSnapshotTestJSON-2129310836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:45:17 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-dcd4c013-d7ca-433a-b58d-c9f9c14c24b7 tempest-VolumesSnapshotTestJSON-2129310836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:45:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-dcd4c013-d7ca-433a-b58d-c9f9c14c24b7 tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:17 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-dcd4c013-d7ca-433a-b58d-c9f9c14c24b7 tempest-VolumesSnapshotTestJSON-2129310836 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:45:17 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-dcd4c013-d7ca-433a-b58d-c9f9c14c24b7 tempest-VolumesSnapshotTestJSON-2129310836 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:45:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-dcd4c013-d7ca-433a-b58d-c9f9c14c24b7 tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b0b44f9d-b3d9-4bbe-aad0-1d83e78cc534 tempest-AttachVolumeTestJSON-1155117856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e238d74-5511-40dc-be8b-62306f13d5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-783a9ec5-ae87-4fc3-a758-283c172ee2ee', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:17 devstack sudo[96830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184 1073741824 Jul 10 06:45:17 devstack sudo[96830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b0b44f9d-b3d9-4bbe-aad0-1d83e78cc534 tempest-AttachVolumeTestJSON-1155117856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79240471-6760-4140-a475-eb8e32c6572d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:17 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-b0b44f9d-b3d9-4bbe-aad0-1d83e78cc534 tempest-AttachVolumeTestJSON-1155117856 None] Volume volume-783a9ec5-ae87-4fc3-a758-283c172ee2ee (783a9ec5-ae87-4fc3-a758-283c172ee2ee): created successfully Jul 10 06:45:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b0b44f9d-b3d9-4bbe-aad0-1d83e78cc534 tempest-AttachVolumeTestJSON-1155117856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79240471-6760-4140-a475-eb8e32c6572d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b0b44f9d-b3d9-4bbe-aad0-1d83e78cc534 tempest-AttachVolumeTestJSON-1155117856 None] Flow 'volume_create_manager' (fbcc9cee-9814-4e0a-9d57-0de0712aa90e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:45:17 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-b0b44f9d-b3d9-4bbe-aad0-1d83e78cc534 tempest-AttachVolumeTestJSON-1155117856 None] Created volume successfully. Jul 10 06:45:18 devstack sudo[96830]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-dcd4c013-d7ca-433a-b58d-c9f9c14c24b7 tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184 1073741824" returned: 0 in 0.809s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-dcd4c013-d7ca-433a-b58d-c9f9c14c24b7 tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:18 devstack sudo[96835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184 Jul 10 06:45:18 devstack sudo[96835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:18 devstack sudo[96835]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-dcd4c013-d7ca-433a-b58d-c9f9c14c24b7 tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184" returned: 0 in 0.725s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:18 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-dcd4c013-d7ca-433a-b58d-c9f9c14c24b7 tempest-VolumesSnapshotTestJSON-2129310836 None] <== create_volume: return (1579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:45:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-dcd4c013-d7ca-433a-b58d-c9f9c14c24b7 tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-87ad291f-686f-436e-a216-a733c032e6be tempest-VolumesGetTest-1773245057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.784s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:18 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-87ad291f-686f-436e-a216-a733c032e6be tempest-VolumesGetTest-1773245057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:45:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-70506572',display_name='tempest-VolumesGetTest-Volume-1181330909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acd72fd0-3d28-46dd-9943-8010936ce41a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e516fd258b49497d9b6fe259af09b0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:45:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:45:16Z,use_quota=True,user_id='3b01103b9e864780af5a6824d10744f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:45:18 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-87ad291f-686f-436e-a216-a733c032e6be tempest-VolumesGetTest-1773245057 None] Creating volume acd72fd0-3d28-46dd-9943-8010936ce41a {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:45:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-87ad291f-686f-436e-a216-a733c032e6be tempest-VolumesGetTest-1773245057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-87ad291f-686f-436e-a216-a733c032e6be tempest-VolumesGetTest-1773245057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:18 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-87ad291f-686f-436e-a216-a733c032e6be tempest-VolumesGetTest-1773245057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:45:18 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-87ad291f-686f-436e-a216-a733c032e6be tempest-VolumesGetTest-1773245057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:45:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-87ad291f-686f-436e-a216-a733c032e6be tempest-VolumesGetTest-1773245057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:18 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-87ad291f-686f-436e-a216-a733c032e6be tempest-VolumesGetTest-1773245057 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:45:18 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-87ad291f-686f-436e-a216-a733c032e6be tempest-VolumesGetTest-1773245057 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:45:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-87ad291f-686f-436e-a216-a733c032e6be tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-acd72fd0-3d28-46dd-9943-8010936ce41a 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:18 devstack sudo[96841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-acd72fd0-3d28-46dd-9943-8010936ce41a 1073741824 Jul 10 06:45:18 devstack sudo[96841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dcd4c013-d7ca-433a-b58d-c9f9c14c24b7 tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72b49e32-bc0a-45ed-bca8-29945cc6ff06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ededd08-11bd-410c-9296-42a307f8f184', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dcd4c013-d7ca-433a-b58d-c9f9c14c24b7 tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a37b4cb-eb7e-4c7d-810a-4d3ae75c7bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:18 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-dcd4c013-d7ca-433a-b58d-c9f9c14c24b7 tempest-VolumesSnapshotTestJSON-2129310836 None] Volume volume-7ededd08-11bd-410c-9296-42a307f8f184 (7ededd08-11bd-410c-9296-42a307f8f184): created successfully Jul 10 06:45:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dcd4c013-d7ca-433a-b58d-c9f9c14c24b7 tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a37b4cb-eb7e-4c7d-810a-4d3ae75c7bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dcd4c013-d7ca-433a-b58d-c9f9c14c24b7 tempest-VolumesSnapshotTestJSON-2129310836 None] Flow 'volume_create_manager' (f18f8468-af97-4287-9811-14fd6e9db08d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:45:18 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-dcd4c013-d7ca-433a-b58d-c9f9c14c24b7 tempest-VolumesSnapshotTestJSON-2129310836 None] Created volume successfully. Jul 10 06:45:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-bd01a7d5-79c6-4411-81ed-28997d77ac21 tempest-VolumesSnapshotTestJSON-2129310836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:19 devstack sudo[96841]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-87ad291f-686f-436e-a216-a733c032e6be tempest-VolumesGetTest-1773245057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-acd72fd0-3d28-46dd-9943-8010936ce41a 1073741824" returned: 0 in 0.839s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-87ad291f-686f-436e-a216-a733c032e6be tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-acd72fd0-3d28-46dd-9943-8010936ce41a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:19 devstack sudo[96849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-acd72fd0-3d28-46dd-9943-8010936ce41a Jul 10 06:45:19 devstack sudo[96849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:20 devstack sudo[96849]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-87ad291f-686f-436e-a216-a733c032e6be tempest-VolumesGetTest-1773245057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-acd72fd0-3d28-46dd-9943-8010936ce41a" returned: 0 in 0.630s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:20 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-87ad291f-686f-436e-a216-a733c032e6be tempest-VolumesGetTest-1773245057 None] <== create_volume: return (1510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:45:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-87ad291f-686f-436e-a216-a733c032e6be tempest-VolumesGetTest-1773245057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-93b1aa00-c854-46e0-96d8-7e3235c547bb tempest-VolumesListTestJSON-2135069663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.251s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:20 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-93b1aa00-c854-46e0-96d8-7e3235c547bb tempest-VolumesListTestJSON-2135069663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-606526349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2be82d89-e3b4-47d2-9ef7-2b8a78ebb687,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='75a4eba11ddb42f590fddad3727226b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:45:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:45:17Z,use_quota=True,user_id='5611bf15d0bd473ebc157310a2c9a580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:45:20 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-93b1aa00-c854-46e0-96d8-7e3235c547bb tempest-VolumesListTestJSON-2135069663 None] Creating volume 2be82d89-e3b4-47d2-9ef7-2b8a78ebb687 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:45:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-93b1aa00-c854-46e0-96d8-7e3235c547bb tempest-VolumesListTestJSON-2135069663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-93b1aa00-c854-46e0-96d8-7e3235c547bb tempest-VolumesListTestJSON-2135069663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:20 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-93b1aa00-c854-46e0-96d8-7e3235c547bb tempest-VolumesListTestJSON-2135069663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:45:20 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-93b1aa00-c854-46e0-96d8-7e3235c547bb tempest-VolumesListTestJSON-2135069663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:45:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-93b1aa00-c854-46e0-96d8-7e3235c547bb tempest-VolumesListTestJSON-2135069663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:20 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-93b1aa00-c854-46e0-96d8-7e3235c547bb tempest-VolumesListTestJSON-2135069663 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:45:20 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-93b1aa00-c854-46e0-96d8-7e3235c547bb tempest-VolumesListTestJSON-2135069663 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:45:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-93b1aa00-c854-46e0-96d8-7e3235c547bb tempest-VolumesListTestJSON-2135069663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2be82d89-e3b4-47d2-9ef7-2b8a78ebb687 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:20 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-87ad291f-686f-436e-a216-a733c032e6be tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68eb18b6-4435-44d9-8b70-0bc9529f5851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acd72fd0-3d28-46dd-9943-8010936ce41a', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:20 devstack sudo[96852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2be82d89-e3b4-47d2-9ef7-2b8a78ebb687 1073741824 Jul 10 06:45:20 devstack sudo[96852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:20 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-87ad291f-686f-436e-a216-a733c032e6be tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (805cf1a6-9b4b-4e3c-a9cb-20cc5fbe35f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:20 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-87ad291f-686f-436e-a216-a733c032e6be tempest-VolumesGetTest-1773245057 None] Volume volume-acd72fd0-3d28-46dd-9943-8010936ce41a (acd72fd0-3d28-46dd-9943-8010936ce41a): created successfully Jul 10 06:45:20 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-87ad291f-686f-436e-a216-a733c032e6be tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (805cf1a6-9b4b-4e3c-a9cb-20cc5fbe35f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:20 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-87ad291f-686f-436e-a216-a733c032e6be tempest-VolumesGetTest-1773245057 None] Flow 'volume_create_manager' (cb57ae4a-7738-4220-a169-abb549ef7654) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:45:20 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-87ad291f-686f-436e-a216-a733c032e6be tempest-VolumesGetTest-1773245057 None] Created volume successfully. Jul 10 06:45:21 devstack sudo[96852]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-93b1aa00-c854-46e0-96d8-7e3235c547bb tempest-VolumesListTestJSON-2135069663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2be82d89-e3b4-47d2-9ef7-2b8a78ebb687 1073741824" returned: 0 in 0.891s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-93b1aa00-c854-46e0-96d8-7e3235c547bb tempest-VolumesListTestJSON-2135069663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2be82d89-e3b4-47d2-9ef7-2b8a78ebb687 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:21 devstack sudo[96873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2be82d89-e3b4-47d2-9ef7-2b8a78ebb687 Jul 10 06:45:21 devstack sudo[96873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:21 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f4ae2aba-77bc-4973-ae9f-2def5a039125 tempest-VolumesGetTest-1773245057 None] Acquiring lock "cinder-acd72fd0-3d28-46dd-9943-8010936ce41a-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:21 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f4ae2aba-77bc-4973-ae9f-2def5a039125 tempest-VolumesGetTest-1773245057 None] Lock "cinder-acd72fd0-3d28-46dd-9943-8010936ce41a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-02f95d73-56ad-4bae-aec9-1ca70d433e95 req-937f69f1-6594-46ec-8960-023222e9f36b tempest-AttachVolumeTestJSON-1155117856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:21 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f4ae2aba-77bc-4973-ae9f-2def5a039125 tempest-VolumesGetTest-1773245057 None] Acquiring lock "cinder-quobyte-acd72fd0-3d28-46dd-9943-8010936ce41a" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:21 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f4ae2aba-77bc-4973-ae9f-2def5a039125 tempest-VolumesGetTest-1773245057 None] Lock "cinder-quobyte-acd72fd0-3d28-46dd-9943-8010936ce41a" acquired by "delete_volume" :: waited 0.016s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:21 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38cda87-30d7-4790-b52c-348c61047b87]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:45:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f4ae2aba-77bc-4973-ae9f-2def5a039125 tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-acd72fd0-3d28-46dd-9943-8010936ce41a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:21 devstack sudo[96876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-acd72fd0-3d28-46dd-9943-8010936ce41a Jul 10 06:45:21 devstack sudo[96876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:21 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:45:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:45:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:45:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:21 devstack sudo[96879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:45:21 devstack sudo[96879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:21 devstack sudo[96873]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-93b1aa00-c854-46e0-96d8-7e3235c547bb tempest-VolumesListTestJSON-2135069663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2be82d89-e3b4-47d2-9ef7-2b8a78ebb687" returned: 0 in 0.668s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-93b1aa00-c854-46e0-96d8-7e3235c547bb tempest-VolumesListTestJSON-2135069663 None] <== create_volume: return (1601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:45:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-93b1aa00-c854-46e0-96d8-7e3235c547bb tempest-VolumesListTestJSON-2135069663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-bd01a7d5-79c6-4411-81ed-28997d77ac21 tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.513s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-bd01a7d5-79c6-4411-81ed-28997d77ac21 tempest-VolumesSnapshotTestJSON-2129310836 None] Creating offline snapshot 54277910-7649-4785-9b66-3b281b784f12 of volume 7ededd08-11bd-410c-9296-42a307f8f184 {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:45:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-93b1aa00-c854-46e0-96d8-7e3235c547bb tempest-VolumesListTestJSON-2135069663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbeefd93-47c0-4e34-91df-732fd3941e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2be82d89-e3b4-47d2-9ef7-2b8a78ebb687', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-93b1aa00-c854-46e0-96d8-7e3235c547bb tempest-VolumesListTestJSON-2135069663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86120f5e-d9db-4c46-a785-08bb2e7915e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:21 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[455db6ab-62db-4aa5-8195-d021ddaf5042]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:45:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bd01a7d5-79c6-4411-81ed-28997d77ac21 tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:21 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-93b1aa00-c854-46e0-96d8-7e3235c547bb tempest-VolumesListTestJSON-2135069663 None] Volume volume-2be82d89-e3b4-47d2-9ef7-2b8a78ebb687 (2be82d89-e3b4-47d2-9ef7-2b8a78ebb687): created successfully Jul 10 06:45:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-93b1aa00-c854-46e0-96d8-7e3235c547bb tempest-VolumesListTestJSON-2135069663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86120f5e-d9db-4c46-a785-08bb2e7915e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-93b1aa00-c854-46e0-96d8-7e3235c547bb tempest-VolumesListTestJSON-2135069663 None] Flow 'volume_create_manager' (f7646ea0-985f-45ca-b9bc-d25af2b8d80f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:45:22 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-93b1aa00-c854-46e0-96d8-7e3235c547bb tempest-VolumesListTestJSON-2135069663 None] Created volume successfully. Jul 10 06:45:22 devstack sudo[96881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184 Jul 10 06:45:22 devstack sudo[96881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:22 devstack sudo[96876]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f4ae2aba-77bc-4973-ae9f-2def5a039125 tempest-VolumesGetTest-1773245057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-acd72fd0-3d28-46dd-9943-8010936ce41a" returned: 0 in 0.962s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f4ae2aba-77bc-4973-ae9f-2def5a039125 tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-acd72fd0-3d28-46dd-9943-8010936ce41a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:22 devstack sudo[96886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-acd72fd0-3d28-46dd-9943-8010936ce41a Jul 10 06:45:22 devstack sudo[96886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:22 devstack sudo[96879]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.750s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:22 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:45:22 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager._thread_info {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:45:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread count: 28 {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:45:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread info: [<_MainThread(MainThread, started 139245706264704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:45:22 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc6931c7-e8f2-4ca0-957d-5bc401847bac tempest-VolumesListTestJSON-2135069663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:45:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-cc6931c7-e8f2-4ca0-957d-5bc401847bac tempest-VolumesListTestJSON-2135069663 None] Flow 'volume_create_manager' (f7e60e66-39dc-435c-8a71-21e50e615630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:45:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-cc6931c7-e8f2-4ca0-957d-5bc401847bac tempest-VolumesListTestJSON-2135069663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (237d915d-e3d9-4bd3-9a24-ca2bd8639b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-cc6931c7-e8f2-4ca0-957d-5bc401847bac tempest-VolumesListTestJSON-2135069663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (237d915d-e3d9-4bd3-9a24-ca2bd8639b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1764093032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09315e59-b010-4da9-a4ba-2119554786d1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='75a4eba11ddb42f590fddad3727226b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:45:23Z,use_quota=True,user_id='5611bf15d0bd473ebc157310a2c9a580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-cc6931c7-e8f2-4ca0-957d-5bc401847bac tempest-VolumesListTestJSON-2135069663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6a9211c-c401-42dc-b5c2-3c5ee833f690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-cc6931c7-e8f2-4ca0-957d-5bc401847bac tempest-VolumesListTestJSON-2135069663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6a9211c-c401-42dc-b5c2-3c5ee833f690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-cc6931c7-e8f2-4ca0-957d-5bc401847bac tempest-VolumesListTestJSON-2135069663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f033d909-8d37-419f-8b96-54e144b69c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-cc6931c7-e8f2-4ca0-957d-5bc401847bac tempest-VolumesListTestJSON-2135069663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f033d909-8d37-419f-8b96-54e144b69c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09315e59-b010-4da9-a4ba-2119554786d1', 'volume_name': 'volume-09315e59-b010-4da9-a4ba-2119554786d1', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-cc6931c7-e8f2-4ca0-957d-5bc401847bac tempest-VolumesListTestJSON-2135069663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10cd6da3-e0dd-4d55-8911-4bdaf1a61e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-cc6931c7-e8f2-4ca0-957d-5bc401847bac tempest-VolumesListTestJSON-2135069663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10cd6da3-e0dd-4d55-8911-4bdaf1a61e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-cc6931c7-e8f2-4ca0-957d-5bc401847bac tempest-VolumesListTestJSON-2135069663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c727d9d-1ef8-41a3-910b-e2e4b71a05b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:22 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-cc6931c7-e8f2-4ca0-957d-5bc401847bac tempest-VolumesListTestJSON-2135069663 None] Volume 09315e59-b010-4da9-a4ba-2119554786d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09315e59-b010-4da9-a4ba-2119554786d1', 'volume_size': 1} Jul 10 06:45:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-cc6931c7-e8f2-4ca0-957d-5bc401847bac tempest-VolumesListTestJSON-2135069663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:22 devstack sudo[96881]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bd01a7d5-79c6-4411-81ed-28997d77ac21 tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184" returned: 0 in 1.027s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bd01a7d5-79c6-4411-81ed-28997d77ac21 tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184.54277910-7649-4785-9b66-3b281b784f12 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:23 devstack sudo[96892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184.54277910-7649-4785-9b66-3b281b784f12 1G Jul 10 06:45:23 devstack sudo[96892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:23 devstack sudo[96886]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f4ae2aba-77bc-4973-ae9f-2def5a039125 tempest-VolumesGetTest-1773245057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-acd72fd0-3d28-46dd-9943-8010936ce41a" returned: 0 in 0.754s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:23 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f4ae2aba-77bc-4973-ae9f-2def5a039125 tempest-VolumesGetTest-1773245057 None] Lock "cinder-quobyte-acd72fd0-3d28-46dd-9943-8010936ce41a" released by "delete_volume" :: held 1.773s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:23 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-f4ae2aba-77bc-4973-ae9f-2def5a039125 tempest-VolumesGetTest-1773245057 None] Created reservations ['6134765e-67cc-41af-9b37-7cb01da8ddbd', 'ea6eb6ef-b948-44a6-8907-b313caea3930', 'ab7dd8c0-574c-49bd-81d6-cb9a068d945f', '1aebc43d-472e-486e-a5fd-f4677fd71c56'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:45:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f4ae2aba-77bc-4973-ae9f-2def5a039125 tempest-VolumesGetTest-1773245057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f4ae2aba-77bc-4973-ae9f-2def5a039125 tempest-VolumesGetTest-1773245057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:23 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f4ae2aba-77bc-4973-ae9f-2def5a039125 tempest-VolumesGetTest-1773245057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:45:23 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f4ae2aba-77bc-4973-ae9f-2def5a039125 tempest-VolumesGetTest-1773245057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:45:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f4ae2aba-77bc-4973-ae9f-2def5a039125 tempest-VolumesGetTest-1773245057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f4ae2aba-77bc-4973-ae9f-2def5a039125 tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:23 devstack sudo[96895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:45:23 devstack sudo[96895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:23 devstack sudo[96892]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bd01a7d5-79c6-4411-81ed-28997d77ac21 tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184.54277910-7649-4785-9b66-3b281b784f12 1G" returned: 0 in 0.867s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bd01a7d5-79c6-4411-81ed-28997d77ac21 tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ededd08-11bd-410c-9296-42a307f8f184 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184.54277910-7649-4785-9b66-3b281b784f12 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:23 devstack sudo[96900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ededd08-11bd-410c-9296-42a307f8f184 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184.54277910-7649-4785-9b66-3b281b784f12 Jul 10 06:45:23 devstack sudo[96900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:23 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-cfb28b2b-4356-45c6-8cf3-87040575e488 tempest-VolumesGetTest-1773245057 None] Acquiring lock "cinder-e0129266-c72c-463d-b746-2b71fb0ebab1-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:23 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-cfb28b2b-4356-45c6-8cf3-87040575e488 tempest-VolumesGetTest-1773245057 None] Lock "cinder-e0129266-c72c-463d-b746-2b71fb0ebab1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:23 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-cfb28b2b-4356-45c6-8cf3-87040575e488 tempest-VolumesGetTest-1773245057 None] Acquiring lock "cinder-quobyte-e0129266-c72c-463d-b746-2b71fb0ebab1" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:23 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-cfb28b2b-4356-45c6-8cf3-87040575e488 tempest-VolumesGetTest-1773245057 None] Lock "cinder-quobyte-e0129266-c72c-463d-b746-2b71fb0ebab1" acquired by "delete_volume" :: waited 0.017s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:24 devstack sudo[96895]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f4ae2aba-77bc-4973-ae9f-2def5a039125 tempest-VolumesGetTest-1773245057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.685s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:24 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-f4ae2aba-77bc-4973-ae9f-2def5a039125 tempest-VolumesGetTest-1773245057 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:45:24 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-f4ae2aba-77bc-4973-ae9f-2def5a039125 tempest-VolumesGetTest-1773245057 None] Deleted volume successfully. Jul 10 06:45:24 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1837ef-f2dd-4a83-a75c-4b9be2a14ad2]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:45:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-cfb28b2b-4356-45c6-8cf3-87040575e488 tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e0129266-c72c-463d-b746-2b71fb0ebab1 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:24 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f4ae2aba-77bc-4973-ae9f-2def5a039125 tempest-VolumesGetTest-1773245057 None] Lock "cinder-acd72fd0-3d28-46dd-9943-8010936ce41a-delete_volume" released by "delete_volume" :: held 2.673s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:24 devstack sudo[96903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e0129266-c72c-463d-b746-2b71fb0ebab1 Jul 10 06:45:24 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:24 devstack sudo[96900]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bd01a7d5-79c6-4411-81ed-28997d77ac21 tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ededd08-11bd-410c-9296-42a307f8f184 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184.54277910-7649-4785-9b66-3b281b784f12" returned: 0 in 0.739s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:24 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-bd01a7d5-79c6-4411-81ed-28997d77ac21 tempest-VolumesSnapshotTestJSON-2129310836 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184.54277910-7649-4785-9b66-3b281b784f12 is being set with open permissions: ugo+rw Jul 10 06:45:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bd01a7d5-79c6-4411-81ed-28997d77ac21 tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184.54277910-7649-4785-9b66-3b281b784f12 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:24 devstack sudo[96909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184.54277910-7649-4785-9b66-3b281b784f12 Jul 10 06:45:24 devstack sudo[96909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:24 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-cfb28b2b-4356-45c6-8cf3-87040575e488 tempest-VolumesGetTest-1773245057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e0129266-c72c-463d-b746-2b71fb0ebab1" returned: 0 in 0.799s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-cfb28b2b-4356-45c6-8cf3-87040575e488 tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e0129266-c72c-463d-b746-2b71fb0ebab1 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:24 devstack sudo[96915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e0129266-c72c-463d-b746-2b71fb0ebab1 Jul 10 06:45:24 devstack sudo[96915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:25 devstack sudo[96909]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bd01a7d5-79c6-4411-81ed-28997d77ac21 tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184.54277910-7649-4785-9b66-3b281b784f12" returned: 0 in 0.718s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bd01a7d5-79c6-4411-81ed-28997d77ac21 tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:25 devstack sudo[96918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184.info Jul 10 06:45:25 devstack sudo[96918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:25 devstack sudo[96915]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-cfb28b2b-4356-45c6-8cf3-87040575e488 tempest-VolumesGetTest-1773245057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e0129266-c72c-463d-b746-2b71fb0ebab1" returned: 0 in 0.645s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:25 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-cfb28b2b-4356-45c6-8cf3-87040575e488 tempest-VolumesGetTest-1773245057 None] Lock "cinder-quobyte-e0129266-c72c-463d-b746-2b71fb0ebab1" released by "delete_volume" :: held 1.504s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:25 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-cfb28b2b-4356-45c6-8cf3-87040575e488 tempest-VolumesGetTest-1773245057 None] Created reservations ['44db624a-43f1-416e-a3ee-d3ea51896f4d', '6361d543-5218-406e-a720-9898402a657d', 'a81e5d3d-e25a-4fe0-924c-9cf9d366242a', '6f522bab-4628-4a15-96d8-5597182b0e23'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:45:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-cfb28b2b-4356-45c6-8cf3-87040575e488 tempest-VolumesGetTest-1773245057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-cfb28b2b-4356-45c6-8cf3-87040575e488 tempest-VolumesGetTest-1773245057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:25 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-cfb28b2b-4356-45c6-8cf3-87040575e488 tempest-VolumesGetTest-1773245057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:45:25 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-cfb28b2b-4356-45c6-8cf3-87040575e488 tempest-VolumesGetTest-1773245057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:45:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-cfb28b2b-4356-45c6-8cf3-87040575e488 tempest-VolumesGetTest-1773245057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-cfb28b2b-4356-45c6-8cf3-87040575e488 tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:25 devstack sudo[96921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:45:25 devstack sudo[96921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:26 devstack sudo[96918]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bd01a7d5-79c6-4411-81ed-28997d77ac21 tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184.info" returned: 0 in 0.657s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:26 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-bd01a7d5-79c6-4411-81ed-28997d77ac21 tempest-VolumesSnapshotTestJSON-2129310836 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184.info is being set with open permissions: ugo+rw Jul 10 06:45:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bd01a7d5-79c6-4411-81ed-28997d77ac21 tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:26 devstack sudo[96924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184.info Jul 10 06:45:26 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:26 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-750e0c46-3f2e-4147-8690-4161931c23e2 tempest-VolumesGetTest-1773245057 None] Acquiring lock "cinder-ba34c08f-e322-4721-9427-1797666bde3f-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:26 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-750e0c46-3f2e-4147-8690-4161931c23e2 tempest-VolumesGetTest-1773245057 None] Lock "cinder-ba34c08f-e322-4721-9427-1797666bde3f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:26 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-750e0c46-3f2e-4147-8690-4161931c23e2 tempest-VolumesGetTest-1773245057 None] Acquiring lock "cinder-quobyte-ba34c08f-e322-4721-9427-1797666bde3f" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:26 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-750e0c46-3f2e-4147-8690-4161931c23e2 tempest-VolumesGetTest-1773245057 None] Lock "cinder-quobyte-ba34c08f-e322-4721-9427-1797666bde3f" acquired by "delete_volume" :: waited 0.024s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:26 devstack sudo[96921]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-cfb28b2b-4356-45c6-8cf3-87040575e488 tempest-VolumesGetTest-1773245057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.707s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:26 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-cfb28b2b-4356-45c6-8cf3-87040575e488 tempest-VolumesGetTest-1773245057 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:45:26 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5b5ef8-4388-4038-b5aa-ad4c10b699a5]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:45:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-750e0c46-3f2e-4147-8690-4161931c23e2 tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:26 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-cfb28b2b-4356-45c6-8cf3-87040575e488 tempest-VolumesGetTest-1773245057 None] Deleted volume successfully. Jul 10 06:45:26 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-cfb28b2b-4356-45c6-8cf3-87040575e488 tempest-VolumesGetTest-1773245057 None] Lock "cinder-e0129266-c72c-463d-b746-2b71fb0ebab1-delete_volume" released by "delete_volume" :: held 2.439s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:26 devstack sudo[96927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f Jul 10 06:45:26 devstack sudo[96927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:26 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bd01a7d5-79c6-4411-81ed-28997d77ac21 tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184.info" returned: 0 in 0.705s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-bd01a7d5-79c6-4411-81ed-28997d77ac21 tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.820s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-02f95d73-56ad-4bae-aec9-1ca70d433e95 req-937f69f1-6594-46ec-8960-023222e9f36b tempest-AttachVolumeTestJSON-1155117856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.337s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:26 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1a1a01-7b12-4d0c-98eb-b6da45d0dbac]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:45:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-02f95d73-56ad-4bae-aec9-1ca70d433e95 req-937f69f1-6594-46ec-8960-023222e9f36b tempest-AttachVolumeTestJSON-1155117856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-783a9ec5-ae87-4fc3-a758-283c172ee2ee {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:26 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-bd01a7d5-79c6-4411-81ed-28997d77ac21 tempest-VolumesSnapshotTestJSON-2129310836 None] Create snapshot completed successfully Jul 10 06:45:26 devstack sudo[96930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-783a9ec5-ae87-4fc3-a758-283c172ee2ee Jul 10 06:45:26 devstack sudo[96930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:27 devstack sudo[96927]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-750e0c46-3f2e-4147-8690-4161931c23e2 tempest-VolumesGetTest-1773245057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f" returned: 0 in 0.793s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-750e0c46-3f2e-4147-8690-4161931c23e2 tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:27 devstack sudo[96935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f Jul 10 06:45:27 devstack sudo[96935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:27 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:45:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Flow 'volume_create_manager' (528fb92a-30f3-4036-9992-3b51e10b66c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:45:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fc8d7e4-a573-4c5c-a968-3f23cafd5242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fc8d7e4-a573-4c5c-a968-3f23cafd5242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-708329368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f76da262-9fa5-449d-8ca5-58bf1625201c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d624da3b98c346bab40a859ada5116c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=54277910-7649-4785-9b66-3b281b784f12,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:45:28Z,use_quota=True,user_id='d4bd965c4f35412b9dea43d58771b551',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:27 devstack sudo[96930]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53099e81-e738-47c7-a7ad-a14fba592890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53099e81-e738-47c7-a7ad-a14fba592890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a08e6c8d-4932-40e3-9059-60701dc09589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a08e6c8d-4932-40e3-9059-60701dc09589) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f76da262-9fa5-449d-8ca5-58bf1625201c', 'volume_name': 'volume-f76da262-9fa5-449d-8ca5-58bf1625201c', 'volume_size': 1, 'snapshot_id': '54277910-7649-4785-9b66-3b281b784f12'}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e29ffc77-5074-4147-b9c9-f4660322e332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e29ffc77-5074-4147-b9c9-f4660322e332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1666fcdf-0f11-4937-8eb5-c80cda118d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:27 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Volume f76da262-9fa5-449d-8ca5-58bf1625201c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f76da262-9fa5-449d-8ca5-58bf1625201c', 'volume_size': 1, 'snapshot_id': '54277910-7649-4785-9b66-3b281b784f12'} Jul 10 06:45:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-02f95d73-56ad-4bae-aec9-1ca70d433e95 req-937f69f1-6594-46ec-8960-023222e9f36b tempest-AttachVolumeTestJSON-1155117856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-783a9ec5-ae87-4fc3-a758-283c172ee2ee" returned: 0 in 0.924s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-02f95d73-56ad-4bae-aec9-1ca70d433e95 req-937f69f1-6594-46ec-8960-023222e9f36b tempest-AttachVolumeTestJSON-1155117856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.950s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-cc6931c7-e8f2-4ca0-957d-5bc401847bac tempest-VolumesListTestJSON-2135069663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.710s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:27 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-cc6931c7-e8f2-4ca0-957d-5bc401847bac tempest-VolumesListTestJSON-2135069663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1764093032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09315e59-b010-4da9-a4ba-2119554786d1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='75a4eba11ddb42f590fddad3727226b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:45:23Z,use_quota=True,user_id='5611bf15d0bd473ebc157310a2c9a580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:45:27 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-cc6931c7-e8f2-4ca0-957d-5bc401847bac tempest-VolumesListTestJSON-2135069663 None] Creating volume 09315e59-b010-4da9-a4ba-2119554786d1 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:45:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-cc6931c7-e8f2-4ca0-957d-5bc401847bac tempest-VolumesListTestJSON-2135069663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-cc6931c7-e8f2-4ca0-957d-5bc401847bac tempest-VolumesListTestJSON-2135069663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:27 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-cc6931c7-e8f2-4ca0-957d-5bc401847bac tempest-VolumesListTestJSON-2135069663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:45:27 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-cc6931c7-e8f2-4ca0-957d-5bc401847bac tempest-VolumesListTestJSON-2135069663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:45:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-cc6931c7-e8f2-4ca0-957d-5bc401847bac tempest-VolumesListTestJSON-2135069663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:27 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-cc6931c7-e8f2-4ca0-957d-5bc401847bac tempest-VolumesListTestJSON-2135069663 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:45:27 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-cc6931c7-e8f2-4ca0-957d-5bc401847bac tempest-VolumesListTestJSON-2135069663 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:45:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-cc6931c7-e8f2-4ca0-957d-5bc401847bac tempest-VolumesListTestJSON-2135069663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-09315e59-b010-4da9-a4ba-2119554786d1 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:27 devstack sudo[96940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-09315e59-b010-4da9-a4ba-2119554786d1 1073741824 Jul 10 06:45:27 devstack sudo[96940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-02f95d73-56ad-4bae-aec9-1ca70d433e95 req-937f69f1-6594-46ec-8960-023222e9f36b tempest-AttachVolumeTestJSON-1155117856 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804', 'name': 'volume-783a9ec5-ae87-4fc3-a758-283c172ee2ee', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd989faae-85e1-46a0-8566-b51fcfbb8b4f', 'enforce_multipath': True} {{(pid=87294) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:45:27 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-02f95d73-56ad-4bae-aec9-1ca70d433e95 req-937f69f1-6594-46ec-8960-023222e9f36b tempest-AttachVolumeTestJSON-1155117856 None] attachment_update completed successfully. Jul 10 06:45:27 devstack sudo[96935]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-750e0c46-3f2e-4147-8690-4161931c23e2 tempest-VolumesGetTest-1773245057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ba34c08f-e322-4721-9427-1797666bde3f" returned: 0 in 0.736s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:27 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-750e0c46-3f2e-4147-8690-4161931c23e2 tempest-VolumesGetTest-1773245057 None] Lock "cinder-quobyte-ba34c08f-e322-4721-9427-1797666bde3f" released by "delete_volume" :: held 1.612s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:27 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-750e0c46-3f2e-4147-8690-4161931c23e2 tempest-VolumesGetTest-1773245057 None] Created reservations ['cd0708c5-ef67-4fe5-b346-62214a0ad96b', '85a0ffd1-6fc0-4d88-895a-47ae0988eee3', 'd237081c-bcc0-49d4-8b38-dfd1e628bd7c', '7a40bacf-6701-4f83-ada9-582afae12743'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:45:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-750e0c46-3f2e-4147-8690-4161931c23e2 tempest-VolumesGetTest-1773245057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-750e0c46-3f2e-4147-8690-4161931c23e2 tempest-VolumesGetTest-1773245057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:28 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-750e0c46-3f2e-4147-8690-4161931c23e2 tempest-VolumesGetTest-1773245057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:45:28 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-750e0c46-3f2e-4147-8690-4161931c23e2 tempest-VolumesGetTest-1773245057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:45:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-750e0c46-3f2e-4147-8690-4161931c23e2 tempest-VolumesGetTest-1773245057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-750e0c46-3f2e-4147-8690-4161931c23e2 tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:28 devstack sudo[96989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:45:28 devstack sudo[96989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:28 devstack sudo[96940]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-cc6931c7-e8f2-4ca0-957d-5bc401847bac tempest-VolumesListTestJSON-2135069663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-09315e59-b010-4da9-a4ba-2119554786d1 1073741824" returned: 0 in 0.987s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-cc6931c7-e8f2-4ca0-957d-5bc401847bac tempest-VolumesListTestJSON-2135069663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-09315e59-b010-4da9-a4ba-2119554786d1 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:28 devstack sudo[96989]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-750e0c46-3f2e-4147-8690-4161931c23e2 tempest-VolumesGetTest-1773245057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.709s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:28 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-750e0c46-3f2e-4147-8690-4161931c23e2 tempest-VolumesGetTest-1773245057 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:45:28 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-750e0c46-3f2e-4147-8690-4161931c23e2 tempest-VolumesGetTest-1773245057 None] Deleted volume successfully. Jul 10 06:45:28 devstack sudo[97331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-09315e59-b010-4da9-a4ba-2119554786d1 Jul 10 06:45:28 devstack sudo[97331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:28 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-750e0c46-3f2e-4147-8690-4161931c23e2 tempest-VolumesGetTest-1773245057 None] Lock "cinder-ba34c08f-e322-4721-9427-1797666bde3f-delete_volume" released by "delete_volume" :: held 2.579s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:29 devstack sudo[97331]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-cc6931c7-e8f2-4ca0-957d-5bc401847bac tempest-VolumesListTestJSON-2135069663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-09315e59-b010-4da9-a4ba-2119554786d1" returned: 0 in 0.698s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:29 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-cc6931c7-e8f2-4ca0-957d-5bc401847bac tempest-VolumesListTestJSON-2135069663 None] <== create_volume: return (1734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:45:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-cc6931c7-e8f2-4ca0-957d-5bc401847bac tempest-VolumesListTestJSON-2135069663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.737s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.711s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:29 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Acquiring lock "cinder-quobyte-54277910-7649-4785-9b66-3b281b784f12-f76da262-9fa5-449d-8ca5-58bf1625201c" by "_create_volume_from_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:29 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-cc6931c7-e8f2-4ca0-957d-5bc401847bac tempest-VolumesListTestJSON-2135069663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c727d9d-1ef8-41a3-910b-e2e4b71a05b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09315e59-b010-4da9-a4ba-2119554786d1', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:29 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-cc6931c7-e8f2-4ca0-957d-5bc401847bac tempest-VolumesListTestJSON-2135069663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34112515-c44f-40c2-b83c-03da17c1de5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:29 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "cinder-quobyte-54277910-7649-4785-9b66-3b281b784f12-f76da262-9fa5-449d-8ca5-58bf1625201c" acquired by "_create_volume_from_snapshot" :: waited 0.048s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:29 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Creating volume f76da262-9fa5-449d-8ca5-58bf1625201c from snapshot 54277910-7649-4785-9b66-3b281b784f12 {{(pid=87294) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 06:45:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:29 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:45:29 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:45:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:29 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:45:29 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Acquiring lock "cinder-quobyte-f76da262-9fa5-449d-8ca5-58bf1625201c" by "_copy_volume_from_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:29 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-cc6931c7-e8f2-4ca0-957d-5bc401847bac tempest-VolumesListTestJSON-2135069663 None] Volume volume-09315e59-b010-4da9-a4ba-2119554786d1 (09315e59-b010-4da9-a4ba-2119554786d1): created successfully Jul 10 06:45:29 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-cc6931c7-e8f2-4ca0-957d-5bc401847bac tempest-VolumesListTestJSON-2135069663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34112515-c44f-40c2-b83c-03da17c1de5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:29 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-cc6931c7-e8f2-4ca0-957d-5bc401847bac tempest-VolumesListTestJSON-2135069663 None] Flow 'volume_create_manager' (f7e60e66-39dc-435c-8a71-21e50e615630) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:45:29 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "cinder-quobyte-f76da262-9fa5-449d-8ca5-58bf1625201c" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:29 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] snapshot: 54277910-7649-4785-9b66-3b281b784f12, volume: f76da262-9fa5-449d-8ca5-58bf1625201c, {{(pid=87294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 06:45:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:29 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:45:29 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:45:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:29 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-cc6931c7-e8f2-4ca0-957d-5bc401847bac tempest-VolumesListTestJSON-2135069663 None] Created volume successfully. Jul 10 06:45:29 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e59269-6437-4c96-970d-63e8d83b8d32]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:45:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184.54277910-7649-4785-9b66-3b281b784f12 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:29 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:45:29 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Flow 'volume_create_manager' (324e2bd4-6e4f-4da4-a221-be427a0f713c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:45:29 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47e9d7cc-6e41-4bd1-9aa9-0616acc0396e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:29 devstack sudo[97336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184.54277910-7649-4785-9b66-3b281b784f12 Jul 10 06:45:29 devstack sudo[97336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:29 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47e9d7cc-6e41-4bd1-9aa9-0616acc0396e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:45:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2079714875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e516fd258b49497d9b6fe259af09b0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:45:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:45:30Z,use_quota=True,user_id='3b01103b9e864780af5a6824d10744f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:29 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b87de07e-306c-4954-abb9-233e5ca379b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:29 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b87de07e-306c-4954-abb9-233e5ca379b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:29 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffaa0d7d-488a-4214-a2ae-57cd678c1934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:29 devstack cinder-volume[87294]: DEBUG cinder.image.glance [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Creating Keystone auth plugin from conf {{(pid=87294) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 06:45:30 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffaa0d7d-488a-4214-a2ae-57cd678c1934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd', 'volume_name': 'volume-1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd', 'volume_size': 1, 'image_id': 'fce564e0-408f-448f-b73c-5fae94549898', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fce564e0-408f-448f-b73c-5fae94549898', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '62db6635aac548658dfcc55ac904ccde', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fce564e0-408f-448f-b73c-5fae94549898', 'created_at': datetime.datetime(2026, 7, 10, 4, 29, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 29, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fce564e0-408f-448f-b73c-5fae94549898/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:30 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a194c9b-6004-474a-a3dd-27d38cc78527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:30 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a194c9b-6004-474a-a3dd-27d38cc78527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:30 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a36dd4ba-9687-4c35-8f2c-97fdb2c156b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:30 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Volume 1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd', 'volume_size': 1, 'image_id': 'fce564e0-408f-448f-b73c-5fae94549898', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fce564e0-408f-448f-b73c-5fae94549898', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '62db6635aac548658dfcc55ac904ccde', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fce564e0-408f-448f-b73c-5fae94549898', 'created_at': datetime.datetime(2026, 7, 10, 4, 29, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 29, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fce564e0-408f-448f-b73c-5fae94549898/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 06:45:30 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Trying to clone 1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd from image fce564e0-408f-448f-b73c-5fae94549898 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fce564e0-408f-448f-b73c-5fae94549898', 'metadata': {}}]). {{(pid=87294) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 06:45:30 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_jz3xv415devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87294) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 06:45:30 devstack cinder-volume[87294]: INFO cinder.image.image_utils [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Image download 20.69 MB at 20.69 MB/s Jul 10 06:45:30 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df33b4f-9634-4739-b01d-a260e79217d0]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:45:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_jz3xv415devstack@QuobyteHD {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:30 devstack sudo[97336]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184.54277910-7649-4785-9b66-3b281b784f12" returned: 0 in 1.009s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:30 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ededd08-11bd-410c-9296-42a307f8f184(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:45:30 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184 {{(pid=87294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 06:45:30 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Creating direct copy from snapshot {{(pid=87294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 06:45:30 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[34de9bcc-0ef7-454d-8097-31d31c21d0dd]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:45:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:30 devstack sudo[97342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_jz3xv415devstack@QuobyteHD Jul 10 06:45:30 devstack sudo[97342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:30 devstack sudo[97343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184 Jul 10 06:45:30 devstack sudo[97343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:31 devstack sudo[97342]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_jz3xv415devstack@QuobyteHD" returned: 0 in 0.796s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:31 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Temporary image fce564e0-408f-448f-b73c-5fae94549898 is fetched for user 3b01103b9e864780af5a6824d10744f3. {{(pid=87294) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 06:45:31 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[64528590-8975-4709-88ff-adb0805068b9]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:45:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_jz3xv415devstack@QuobyteHD {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:31 devstack sudo[97343]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184" returned: 0 in 0.884s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:31 devstack cinder-volume[87294]: DEBUG cinder.utils [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Path /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f76da262-9fa5-449d-8ca5-58bf1625201c not found in is_blk_device check {{(pid=87294) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 06:45:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f76da262-9fa5-449d-8ca5-58bf1625201c {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:31 devstack sudo[97358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_jz3xv415devstack@QuobyteHD Jul 10 06:45:31 devstack sudo[97358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:31 devstack sudo[97359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f76da262-9fa5-449d-8ca5-58bf1625201c Jul 10 06:45:31 devstack sudo[97359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:32 devstack sudo[97358]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_jz3xv415devstack@QuobyteHD" returned: 0 in 0.806s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:32 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-25774603-9bb8-4359-8ae7-39b5c6e1e24c tempest-VolumesListTestJSON-2135069663 None] Acquiring lock "cinder-09315e59-b010-4da9-a4ba-2119554786d1-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:32 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-25774603-9bb8-4359-8ae7-39b5c6e1e24c tempest-VolumesListTestJSON-2135069663 None] Lock "cinder-09315e59-b010-4da9-a4ba-2119554786d1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:32 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-25774603-9bb8-4359-8ae7-39b5c6e1e24c tempest-VolumesListTestJSON-2135069663 None] Acquiring lock "cinder-quobyte-09315e59-b010-4da9-a4ba-2119554786d1" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:32 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-25774603-9bb8-4359-8ae7-39b5c6e1e24c tempest-VolumesListTestJSON-2135069663 None] Lock "cinder-quobyte-09315e59-b010-4da9-a4ba-2119554786d1" acquired by "delete_volume" :: waited 0.018s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:32 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb34336-d5f5-425f-a02d-9be4b8b2a62e]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:45:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-25774603-9bb8-4359-8ae7-39b5c6e1e24c tempest-VolumesListTestJSON-2135069663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-09315e59-b010-4da9-a4ba-2119554786d1 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:32 devstack sudo[97368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-09315e59-b010-4da9-a4ba-2119554786d1 Jul 10 06:45:32 devstack sudo[97368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:33 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-45d0b990-ba32-4273-a956-0cab01270f1c tempest-AttachVolumeTestJSON-1155117856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:45:33 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-45d0b990-ba32-4273-a956-0cab01270f1c tempest-AttachVolumeTestJSON-1155117856 None] Flow 'volume_create_manager' (bc2b0734-00a6-4e33-ba07-c4cd43ce51ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:45:33 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-45d0b990-ba32-4273-a956-0cab01270f1c tempest-AttachVolumeTestJSON-1155117856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (557534aa-a6f8-45ed-a1b5-ef858154b730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:33 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-45d0b990-ba32-4273-a956-0cab01270f1c tempest-AttachVolumeTestJSON-1155117856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (557534aa-a6f8-45ed-a1b5-ef858154b730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-635209202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=813f563f-4836-489f-9f9d-32969c8f02a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbc42550af72433497aac3c1eb3b6741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:45:33Z,use_quota=True,user_id='6d0a6c06d30f4c2b9b4de6a4dc322e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:33 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-45d0b990-ba32-4273-a956-0cab01270f1c tempest-AttachVolumeTestJSON-1155117856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd944d6-ad61-4fe0-9275-d3e72bff6a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:33 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-45d0b990-ba32-4273-a956-0cab01270f1c tempest-AttachVolumeTestJSON-1155117856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd944d6-ad61-4fe0-9275-d3e72bff6a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:33 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-45d0b990-ba32-4273-a956-0cab01270f1c tempest-AttachVolumeTestJSON-1155117856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f614d3b-8b06-4649-8b07-eefe54462e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:33 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-45d0b990-ba32-4273-a956-0cab01270f1c tempest-AttachVolumeTestJSON-1155117856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f614d3b-8b06-4649-8b07-eefe54462e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '813f563f-4836-489f-9f9d-32969c8f02a4', 'volume_name': 'volume-813f563f-4836-489f-9f9d-32969c8f02a4', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:33 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-45d0b990-ba32-4273-a956-0cab01270f1c tempest-AttachVolumeTestJSON-1155117856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b847d817-5884-4021-ac1f-299ba4434db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:33 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-45d0b990-ba32-4273-a956-0cab01270f1c tempest-AttachVolumeTestJSON-1155117856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b847d817-5884-4021-ac1f-299ba4434db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:33 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-45d0b990-ba32-4273-a956-0cab01270f1c tempest-AttachVolumeTestJSON-1155117856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38243479-47f6-4db3-9d5e-065abce4aeb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:33 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-45d0b990-ba32-4273-a956-0cab01270f1c tempest-AttachVolumeTestJSON-1155117856 None] Volume 813f563f-4836-489f-9f9d-32969c8f02a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-813f563f-4836-489f-9f9d-32969c8f02a4', 'volume_size': 1} Jul 10 06:45:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-45d0b990-ba32-4273-a956-0cab01270f1c tempest-AttachVolumeTestJSON-1155117856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:33 devstack sudo[97368]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-25774603-9bb8-4359-8ae7-39b5c6e1e24c tempest-VolumesListTestJSON-2135069663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-09315e59-b010-4da9-a4ba-2119554786d1" returned: 0 in 1.543s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-25774603-9bb8-4359-8ae7-39b5c6e1e24c tempest-VolumesListTestJSON-2135069663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-09315e59-b010-4da9-a4ba-2119554786d1 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:34 devstack sudo[97381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-09315e59-b010-4da9-a4ba-2119554786d1 Jul 10 06:45:34 devstack sudo[97381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:35 devstack sudo[97381]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-25774603-9bb8-4359-8ae7-39b5c6e1e24c tempest-VolumesListTestJSON-2135069663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-09315e59-b010-4da9-a4ba-2119554786d1" returned: 0 in 1.377s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:35 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-25774603-9bb8-4359-8ae7-39b5c6e1e24c tempest-VolumesListTestJSON-2135069663 None] Lock "cinder-quobyte-09315e59-b010-4da9-a4ba-2119554786d1" released by "delete_volume" :: held 2.995s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:35 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-25774603-9bb8-4359-8ae7-39b5c6e1e24c tempest-VolumesListTestJSON-2135069663 None] Created reservations ['883b233c-a734-4c6c-961a-8db8c3456754', 'ec8e8fd1-95a6-49d8-af33-c7b2059acff9', 'de41848a-8a50-4045-ba26-7c9a9cd74ddc', '222a9dfe-7d69-4301-ae61-6a4ab8e748a7'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:45:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-25774603-9bb8-4359-8ae7-39b5c6e1e24c tempest-VolumesListTestJSON-2135069663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-25774603-9bb8-4359-8ae7-39b5c6e1e24c tempest-VolumesListTestJSON-2135069663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:35 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-25774603-9bb8-4359-8ae7-39b5c6e1e24c tempest-VolumesListTestJSON-2135069663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:45:35 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-25774603-9bb8-4359-8ae7-39b5c6e1e24c tempest-VolumesListTestJSON-2135069663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:45:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-25774603-9bb8-4359-8ae7-39b5c6e1e24c tempest-VolumesListTestJSON-2135069663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-25774603-9bb8-4359-8ae7-39b5c6e1e24c tempest-VolumesListTestJSON-2135069663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:35 devstack sudo[97384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:45:35 devstack sudo[97384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:36 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-5151feae-3e72-4c28-a05d-6a5b99fe8d13 tempest-VolumesListTestJSON-2135069663 None] Acquiring lock "cinder-2be82d89-e3b4-47d2-9ef7-2b8a78ebb687-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:36 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-5151feae-3e72-4c28-a05d-6a5b99fe8d13 tempest-VolumesListTestJSON-2135069663 None] Lock "cinder-2be82d89-e3b4-47d2-9ef7-2b8a78ebb687-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:36 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-5151feae-3e72-4c28-a05d-6a5b99fe8d13 tempest-VolumesListTestJSON-2135069663 None] Acquiring lock "cinder-quobyte-2be82d89-e3b4-47d2-9ef7-2b8a78ebb687" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:36 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-5151feae-3e72-4c28-a05d-6a5b99fe8d13 tempest-VolumesListTestJSON-2135069663 None] Lock "cinder-quobyte-2be82d89-e3b4-47d2-9ef7-2b8a78ebb687" acquired by "delete_volume" :: waited 0.044s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:36 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec4ba8b-0f1b-43ed-bb0b-a6041969c757]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:45:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5151feae-3e72-4c28-a05d-6a5b99fe8d13 tempest-VolumesListTestJSON-2135069663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2be82d89-e3b4-47d2-9ef7-2b8a78ebb687 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:36 devstack sudo[97386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2be82d89-e3b4-47d2-9ef7-2b8a78ebb687 Jul 10 06:45:36 devstack sudo[97386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:37 devstack sudo[97384]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-25774603-9bb8-4359-8ae7-39b5c6e1e24c tempest-VolumesListTestJSON-2135069663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.498s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:37 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-25774603-9bb8-4359-8ae7-39b5c6e1e24c tempest-VolumesListTestJSON-2135069663 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:45:37 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-25774603-9bb8-4359-8ae7-39b5c6e1e24c tempest-VolumesListTestJSON-2135069663 None] Deleted volume successfully. Jul 10 06:45:37 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-25774603-9bb8-4359-8ae7-39b5c6e1e24c tempest-VolumesListTestJSON-2135069663 None] Lock "cinder-09315e59-b010-4da9-a4ba-2119554786d1-delete_volume" released by "delete_volume" :: held 5.079s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:37 devstack sudo[97359]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f76da262-9fa5-449d-8ca5-58bf1625201c" returned: 0 in 5.860s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:37 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc54a37-3447-4178-a909-f31ff1b73f64]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:45:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:37 devstack sudo[97389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184 Jul 10 06:45:37 devstack sudo[97389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:37 devstack sudo[97386]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5151feae-3e72-4c28-a05d-6a5b99fe8d13 tempest-VolumesListTestJSON-2135069663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2be82d89-e3b4-47d2-9ef7-2b8a78ebb687" returned: 0 in 1.239s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5151feae-3e72-4c28-a05d-6a5b99fe8d13 tempest-VolumesListTestJSON-2135069663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2be82d89-e3b4-47d2-9ef7-2b8a78ebb687 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:37 devstack sudo[97394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2be82d89-e3b4-47d2-9ef7-2b8a78ebb687 Jul 10 06:45:37 devstack sudo[97394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:38 devstack sudo[97389]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184" returned: 0 in 0.913s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:38 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184, size 1024.00 MB, duration 5.86 sec, destination /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f76da262-9fa5-449d-8ca5-58bf1625201c {{(pid=87294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 06:45:38 devstack cinder-volume[87294]: INFO cinder.image.image_utils [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Converted 1024.00 MB image at 174.73 MB/s Jul 10 06:45:38 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f76da262-9fa5-449d-8ca5-58bf1625201c is being set with open permissions: ugo+rw Jul 10 06:45:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f76da262-9fa5-449d-8ca5-58bf1625201c {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:38 devstack sudo[97394]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:38 devstack sudo[97400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f76da262-9fa5-449d-8ca5-58bf1625201c Jul 10 06:45:38 devstack sudo[97400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5151feae-3e72-4c28-a05d-6a5b99fe8d13 tempest-VolumesListTestJSON-2135069663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2be82d89-e3b4-47d2-9ef7-2b8a78ebb687" returned: 0 in 0.705s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:38 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-5151feae-3e72-4c28-a05d-6a5b99fe8d13 tempest-VolumesListTestJSON-2135069663 None] Lock "cinder-quobyte-2be82d89-e3b4-47d2-9ef7-2b8a78ebb687" released by "delete_volume" :: held 2.058s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:38 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-5151feae-3e72-4c28-a05d-6a5b99fe8d13 tempest-VolumesListTestJSON-2135069663 None] Created reservations ['97185558-c2db-4ec4-899f-2f2230243af8', '1e5ea9ed-d9da-4db1-8f8d-4ba1e04f69d4', '86d4ba1a-891f-4a02-9941-ed165daad3db', '25ab2bd7-9aee-4ff7-bb9e-6530a0cdb2fa'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:45:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5151feae-3e72-4c28-a05d-6a5b99fe8d13 tempest-VolumesListTestJSON-2135069663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5151feae-3e72-4c28-a05d-6a5b99fe8d13 tempest-VolumesListTestJSON-2135069663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:38 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5151feae-3e72-4c28-a05d-6a5b99fe8d13 tempest-VolumesListTestJSON-2135069663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:45:38 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5151feae-3e72-4c28-a05d-6a5b99fe8d13 tempest-VolumesListTestJSON-2135069663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:45:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5151feae-3e72-4c28-a05d-6a5b99fe8d13 tempest-VolumesListTestJSON-2135069663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5151feae-3e72-4c28-a05d-6a5b99fe8d13 tempest-VolumesListTestJSON-2135069663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:38 devstack sudo[97402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:45:38 devstack sudo[97402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:39 devstack sudo[97400]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f76da262-9fa5-449d-8ca5-58bf1625201c" returned: 0 in 0.701s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:39 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "cinder-quobyte-f76da262-9fa5-449d-8ca5-58bf1625201c" released by "_copy_volume_from_snapshot" :: held 9.528s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:39 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "cinder-quobyte-54277910-7649-4785-9b66-3b281b784f12-f76da262-9fa5-449d-8ca5-58bf1625201c" released by "_create_volume_from_snapshot" :: held 9.595s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.645s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.802s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:39 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:45:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2079714875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e516fd258b49497d9b6fe259af09b0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:45:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:45:30Z,use_quota=True,user_id='3b01103b9e864780af5a6824d10744f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:45:39 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Creating volume 1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:45:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:39 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:45:39 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:45:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:39 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:45:39 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:45:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:39 devstack sudo[97405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd 1073741824 Jul 10 06:45:39 devstack sudo[97405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1666fcdf-0f11-4937-8eb5-c80cda118d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f76da262-9fa5-449d-8ca5-58bf1625201c', 'volume_size': 1, 'snapshot_id': '54277910-7649-4785-9b66-3b281b784f12'}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e818aba5-8b26-41fc-b98c-f6c53bd4be8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:39 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Volume volume-f76da262-9fa5-449d-8ca5-58bf1625201c (f76da262-9fa5-449d-8ca5-58bf1625201c): created successfully Jul 10 06:45:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e818aba5-8b26-41fc-b98c-f6c53bd4be8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Flow 'volume_create_manager' (528fb92a-30f3-4036-9992-3b51e10b66c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:45:39 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-b72095de-7adc-4bbe-8e89-14302e4a313c tempest-VolumesSnapshotTestJSON-2129310836 None] Created volume successfully. Jul 10 06:45:39 devstack sudo[97402]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5151feae-3e72-4c28-a05d-6a5b99fe8d13 tempest-VolumesListTestJSON-2135069663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.669s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:39 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-5151feae-3e72-4c28-a05d-6a5b99fe8d13 tempest-VolumesListTestJSON-2135069663 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:45:39 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-5151feae-3e72-4c28-a05d-6a5b99fe8d13 tempest-VolumesListTestJSON-2135069663 None] Deleted volume successfully. Jul 10 06:45:39 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-5151feae-3e72-4c28-a05d-6a5b99fe8d13 tempest-VolumesListTestJSON-2135069663 None] Lock "cinder-2be82d89-e3b4-47d2-9ef7-2b8a78ebb687-delete_volume" released by "delete_volume" :: held 3.063s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:39 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c80d7b45-0665-4879-948c-8302884dcf02 tempest-VolumesListTestJSON-2135069663 None] Acquiring lock "cinder-71a6b200-8790-48c5-940d-d7505666ac5b-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:39 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c80d7b45-0665-4879-948c-8302884dcf02 tempest-VolumesListTestJSON-2135069663 None] Lock "cinder-71a6b200-8790-48c5-940d-d7505666ac5b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:39 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c80d7b45-0665-4879-948c-8302884dcf02 tempest-VolumesListTestJSON-2135069663 None] Acquiring lock "cinder-quobyte-71a6b200-8790-48c5-940d-d7505666ac5b" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:39 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c80d7b45-0665-4879-948c-8302884dcf02 tempest-VolumesListTestJSON-2135069663 None] Lock "cinder-quobyte-71a6b200-8790-48c5-940d-d7505666ac5b" acquired by "delete_volume" :: waited 0.015s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:39 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[b371ff8d-5bb2-40b2-807a-a3130692cd91]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:45:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c80d7b45-0665-4879-948c-8302884dcf02 tempest-VolumesListTestJSON-2135069663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-71a6b200-8790-48c5-940d-d7505666ac5b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:39 devstack sudo[97412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-71a6b200-8790-48c5-940d-d7505666ac5b Jul 10 06:45:39 devstack sudo[97412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:39 devstack sudo[97405]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd 1073741824" returned: 0 in 0.891s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:40 devstack sudo[97415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd Jul 10 06:45:40 devstack sudo[97415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:40 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-efb3c188-1647-462c-a5c4-c02f6e5701fd tempest-VolumesSnapshotTestJSON-2129310836 None] Acquiring lock "cinder-f76da262-9fa5-449d-8ca5-58bf1625201c-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:40 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-efb3c188-1647-462c-a5c4-c02f6e5701fd tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "cinder-f76da262-9fa5-449d-8ca5-58bf1625201c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:40 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-efb3c188-1647-462c-a5c4-c02f6e5701fd tempest-VolumesSnapshotTestJSON-2129310836 None] Acquiring lock "cinder-quobyte-f76da262-9fa5-449d-8ca5-58bf1625201c" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:40 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-efb3c188-1647-462c-a5c4-c02f6e5701fd tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "cinder-quobyte-f76da262-9fa5-449d-8ca5-58bf1625201c" acquired by "delete_volume" :: waited 0.016s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:40 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4eeef59-f888-4f0b-bd65-7ec6fc07def0]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:45:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-efb3c188-1647-462c-a5c4-c02f6e5701fd tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f76da262-9fa5-449d-8ca5-58bf1625201c {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:40 devstack sudo[97417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f76da262-9fa5-449d-8ca5-58bf1625201c Jul 10 06:45:40 devstack sudo[97417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:40 devstack sudo[97412]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c80d7b45-0665-4879-948c-8302884dcf02 tempest-VolumesListTestJSON-2135069663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-71a6b200-8790-48c5-940d-d7505666ac5b" returned: 0 in 0.796s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c80d7b45-0665-4879-948c-8302884dcf02 tempest-VolumesListTestJSON-2135069663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-71a6b200-8790-48c5-940d-d7505666ac5b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:40 devstack sudo[97422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-71a6b200-8790-48c5-940d-d7505666ac5b Jul 10 06:45:40 devstack sudo[97422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:40 devstack sudo[97415]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd" returned: 0 in 0.708s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:40 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:45:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-45d0b990-ba32-4273-a956-0cab01270f1c tempest-AttachVolumeTestJSON-1155117856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.434s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:40 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-45d0b990-ba32-4273-a956-0cab01270f1c tempest-AttachVolumeTestJSON-1155117856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-635209202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=813f563f-4836-489f-9f9d-32969c8f02a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbc42550af72433497aac3c1eb3b6741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:45:33Z,use_quota=True,user_id='6d0a6c06d30f4c2b9b4de6a4dc322e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:45:40 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-45d0b990-ba32-4273-a956-0cab01270f1c tempest-AttachVolumeTestJSON-1155117856 None] Creating volume 813f563f-4836-489f-9f9d-32969c8f02a4 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:45:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-45d0b990-ba32-4273-a956-0cab01270f1c tempest-AttachVolumeTestJSON-1155117856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-45d0b990-ba32-4273-a956-0cab01270f1c tempest-AttachVolumeTestJSON-1155117856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:40 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-45d0b990-ba32-4273-a956-0cab01270f1c tempest-AttachVolumeTestJSON-1155117856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:45:40 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-45d0b990-ba32-4273-a956-0cab01270f1c tempest-AttachVolumeTestJSON-1155117856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:45:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-45d0b990-ba32-4273-a956-0cab01270f1c tempest-AttachVolumeTestJSON-1155117856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:40 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-45d0b990-ba32-4273-a956-0cab01270f1c tempest-AttachVolumeTestJSON-1155117856 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:45:40 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-45d0b990-ba32-4273-a956-0cab01270f1c tempest-AttachVolumeTestJSON-1155117856 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:45:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-45d0b990-ba32-4273-a956-0cab01270f1c tempest-AttachVolumeTestJSON-1155117856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-813f563f-4836-489f-9f9d-32969c8f02a4 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:40 devstack sudo[97425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-813f563f-4836-489f-9f9d-32969c8f02a4 1073741824 Jul 10 06:45:40 devstack sudo[97425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:40 devstack cinder-volume[87294]: DEBUG cinder.volume.volume_utils [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Attempting download of fce564e0-408f-448f-b73c-5fae94549898 ((None, [{'url': 'file:///opt/stack/data/glance/images/fce564e0-408f-448f-b73c-5fae94549898', 'metadata': {}}])) to volume 1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd. {{(pid=87294) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 06:45:40 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69ccb69-9193-43d9-9036-4520c99c8d38]: (4, 'raw') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:45:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fce564e0-408f-448f-b73c-5fae94549898_92njg4j8 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:40 devstack sudo[97427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fce564e0-408f-448f-b73c-5fae94549898_92njg4j8 Jul 10 06:45:40 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:41 devstack sudo[97417]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-efb3c188-1647-462c-a5c4-c02f6e5701fd tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f76da262-9fa5-449d-8ca5-58bf1625201c" returned: 0 in 0.841s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-efb3c188-1647-462c-a5c4-c02f6e5701fd tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f76da262-9fa5-449d-8ca5-58bf1625201c {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:41 devstack sudo[97422]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c80d7b45-0665-4879-948c-8302884dcf02 tempest-VolumesListTestJSON-2135069663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-71a6b200-8790-48c5-940d-d7505666ac5b" returned: 0 in 0.701s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:41 devstack sudo[97433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f76da262-9fa5-449d-8ca5-58bf1625201c Jul 10 06:45:41 devstack sudo[97433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c80d7b45-0665-4879-948c-8302884dcf02 tempest-VolumesListTestJSON-2135069663 None] Lock "cinder-quobyte-71a6b200-8790-48c5-940d-d7505666ac5b" released by "delete_volume" :: held 1.550s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:41 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-c80d7b45-0665-4879-948c-8302884dcf02 tempest-VolumesListTestJSON-2135069663 None] Created reservations ['f64b9bc1-e968-4857-9d4f-1a42c6560480', 'ff4445d9-8194-42b5-8861-aaf8849f953e', 'd4846633-6440-4d4f-86c0-289aa11e73ab', '5ea9a283-2016-4765-b4d4-da1f57d76d2d'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:45:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c80d7b45-0665-4879-948c-8302884dcf02 tempest-VolumesListTestJSON-2135069663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c80d7b45-0665-4879-948c-8302884dcf02 tempest-VolumesListTestJSON-2135069663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:41 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-c80d7b45-0665-4879-948c-8302884dcf02 tempest-VolumesListTestJSON-2135069663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:45:41 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-c80d7b45-0665-4879-948c-8302884dcf02 tempest-VolumesListTestJSON-2135069663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:45:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c80d7b45-0665-4879-948c-8302884dcf02 tempest-VolumesListTestJSON-2135069663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c80d7b45-0665-4879-948c-8302884dcf02 tempest-VolumesListTestJSON-2135069663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:41 devstack sudo[97438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:45:41 devstack sudo[97438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:41 devstack sudo[97425]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-45d0b990-ba32-4273-a956-0cab01270f1c tempest-AttachVolumeTestJSON-1155117856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-813f563f-4836-489f-9f9d-32969c8f02a4 1073741824" returned: 0 in 0.935s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-45d0b990-ba32-4273-a956-0cab01270f1c tempest-AttachVolumeTestJSON-1155117856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-813f563f-4836-489f-9f9d-32969c8f02a4 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:41 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fce564e0-408f-448f-b73c-5fae94549898_92njg4j8" returned: 0 in 0.912s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fce564e0-408f-448f-b73c-5fae94549898_92njg4j8 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:41 devstack sudo[97443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-813f563f-4836-489f-9f9d-32969c8f02a4 Jul 10 06:45:41 devstack sudo[97443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:41 devstack sudo[97433]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-efb3c188-1647-462c-a5c4-c02f6e5701fd tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f76da262-9fa5-449d-8ca5-58bf1625201c" returned: 0 in 0.708s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-efb3c188-1647-462c-a5c4-c02f6e5701fd tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "cinder-quobyte-f76da262-9fa5-449d-8ca5-58bf1625201c" released by "delete_volume" :: held 1.606s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:41 devstack sudo[97445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fce564e0-408f-448f-b73c-5fae94549898_92njg4j8 Jul 10 06:45:41 devstack sudo[97445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:42 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-efb3c188-1647-462c-a5c4-c02f6e5701fd tempest-VolumesSnapshotTestJSON-2129310836 None] Created reservations ['ccf93c48-bef2-4ec7-8ac4-48a98b23f291', '9c39fa79-b7d0-4d8d-b2f6-70ea61e4b825', '649f70c6-9527-48bb-b46e-6ae0db70e227', '08d54898-6734-4300-bd99-36d0b86100a8'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:45:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-efb3c188-1647-462c-a5c4-c02f6e5701fd tempest-VolumesSnapshotTestJSON-2129310836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-efb3c188-1647-462c-a5c4-c02f6e5701fd tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:42 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-efb3c188-1647-462c-a5c4-c02f6e5701fd tempest-VolumesSnapshotTestJSON-2129310836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:45:42 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-efb3c188-1647-462c-a5c4-c02f6e5701fd tempest-VolumesSnapshotTestJSON-2129310836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:45:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-efb3c188-1647-462c-a5c4-c02f6e5701fd tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-efb3c188-1647-462c-a5c4-c02f6e5701fd tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:42 devstack sudo[97449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:45:42 devstack sudo[97449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:42 devstack sudo[97438]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c80d7b45-0665-4879-948c-8302884dcf02 tempest-VolumesListTestJSON-2135069663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.889s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:42 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-c80d7b45-0665-4879-948c-8302884dcf02 tempest-VolumesListTestJSON-2135069663 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:45:42 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-c80d7b45-0665-4879-948c-8302884dcf02 tempest-VolumesListTestJSON-2135069663 None] Deleted volume successfully. Jul 10 06:45:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c80d7b45-0665-4879-948c-8302884dcf02 tempest-VolumesListTestJSON-2135069663 None] Lock "cinder-71a6b200-8790-48c5-940d-d7505666ac5b-delete_volume" released by "delete_volume" :: held 2.690s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-eab5e9b4-0a50-4ace-bf79-dc8ee20dd099 tempest-VolumesSnapshotTestJSON-2129310836 None] Acquiring lock "cinder-54277910-7649-4785-9b66-3b281b784f12-delete_snapshot" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-eab5e9b4-0a50-4ace-bf79-dc8ee20dd099 tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "cinder-54277910-7649-4785-9b66-3b281b784f12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-eab5e9b4-0a50-4ace-bf79-dc8ee20dd099 tempest-VolumesSnapshotTestJSON-2129310836 None] Acquiring lock "cinder-quobyte-7ededd08-11bd-410c-9296-42a307f8f184" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-eab5e9b4-0a50-4ace-bf79-dc8ee20dd099 tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "cinder-quobyte-7ededd08-11bd-410c-9296-42a307f8f184" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-eab5e9b4-0a50-4ace-bf79-dc8ee20dd099 tempest-VolumesSnapshotTestJSON-2129310836 None] Acquiring lock "cinder-quobyte-54277910-7649-4785-9b66-3b281b784f12" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-eab5e9b4-0a50-4ace-bf79-dc8ee20dd099 tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "cinder-quobyte-54277910-7649-4785-9b66-3b281b784f12" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:42 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-eab5e9b4-0a50-4ace-bf79-dc8ee20dd099 tempest-VolumesSnapshotTestJSON-2129310836 None] Deleting offline snapshot 54277910-7649-4785-9b66-3b281b784f12 of volume 7ededd08-11bd-410c-9296-42a307f8f184 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:45:42 devstack sudo[97443]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:42 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-eab5e9b4-0a50-4ace-bf79-dc8ee20dd099 tempest-VolumesSnapshotTestJSON-2129310836 None] snapshot_file for this snap is: volume-7ededd08-11bd-410c-9296-42a307f8f184.54277910-7649-4785-9b66-3b281b784f12 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:45:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-45d0b990-ba32-4273-a956-0cab01270f1c tempest-AttachVolumeTestJSON-1155117856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-813f563f-4836-489f-9f9d-32969c8f02a4" returned: 0 in 0.966s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:42 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-45d0b990-ba32-4273-a956-0cab01270f1c tempest-AttachVolumeTestJSON-1155117856 None] <== create_volume: return (1970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:45:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-45d0b990-ba32-4273-a956-0cab01270f1c tempest-AttachVolumeTestJSON-1155117856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.973s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:42 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d96e7b7-0e1b-4494-b419-62d544eed90f]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:45:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-eab5e9b4-0a50-4ace-bf79-dc8ee20dd099 tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184.54277910-7649-4785-9b66-3b281b784f12 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-45d0b990-ba32-4273-a956-0cab01270f1c tempest-AttachVolumeTestJSON-1155117856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38243479-47f6-4db3-9d5e-065abce4aeb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-813f563f-4836-489f-9f9d-32969c8f02a4', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-45d0b990-ba32-4273-a956-0cab01270f1c tempest-AttachVolumeTestJSON-1155117856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e755ae7-8456-44e5-aba8-b91151a6dc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:42 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-45d0b990-ba32-4273-a956-0cab01270f1c tempest-AttachVolumeTestJSON-1155117856 None] Volume volume-813f563f-4836-489f-9f9d-32969c8f02a4 (813f563f-4836-489f-9f9d-32969c8f02a4): created successfully Jul 10 06:45:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-45d0b990-ba32-4273-a956-0cab01270f1c tempest-AttachVolumeTestJSON-1155117856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e755ae7-8456-44e5-aba8-b91151a6dc62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-45d0b990-ba32-4273-a956-0cab01270f1c tempest-AttachVolumeTestJSON-1155117856 None] Flow 'volume_create_manager' (bc2b0734-00a6-4e33-ba07-c4cd43ce51ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:45:42 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-45d0b990-ba32-4273-a956-0cab01270f1c tempest-AttachVolumeTestJSON-1155117856 None] Created volume successfully. Jul 10 06:45:42 devstack sudo[97445]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fce564e0-408f-448f-b73c-5fae94549898_92njg4j8" returned: 1 in 1.102s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fce564e0-408f-448f-b73c-5fae94549898_92njg4j8' failed. Not Retrying. {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:45:42 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52ca294-aaab-4a77-81fb-e56c63585dad]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:45:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_jz3xv415devstack@QuobyteHD {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:42 devstack sudo[97454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184.54277910-7649-4785-9b66-3b281b784f12 Jul 10 06:45:42 devstack sudo[97454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:43 devstack sudo[97455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_jz3xv415devstack@QuobyteHD Jul 10 06:45:43 devstack sudo[97455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:43 devstack sudo[97449]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-efb3c188-1647-462c-a5c4-c02f6e5701fd tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.926s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:43 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-efb3c188-1647-462c-a5c4-c02f6e5701fd tempest-VolumesSnapshotTestJSON-2129310836 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:45:43 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-efb3c188-1647-462c-a5c4-c02f6e5701fd tempest-VolumesSnapshotTestJSON-2129310836 None] Deleted volume successfully. Jul 10 06:45:43 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-efb3c188-1647-462c-a5c4-c02f6e5701fd tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "cinder-f76da262-9fa5-449d-8ca5-58bf1625201c-delete_volume" released by "delete_volume" :: held 2.888s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:43 devstack sudo[97454]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-eab5e9b4-0a50-4ace-bf79-dc8ee20dd099 tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184.54277910-7649-4785-9b66-3b281b784f12" returned: 0 in 0.959s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:43 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-eab5e9b4-0a50-4ace-bf79-dc8ee20dd099 tempest-VolumesSnapshotTestJSON-2129310836 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ededd08-11bd-410c-9296-42a307f8f184(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:45:43 devstack sudo[97455]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_jz3xv415devstack@QuobyteHD" returned: 0 in 0.840s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:43 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] fce564e0-408f-448f-b73c-5fae94549898 was qcow2, converting to raw {{(pid=87294) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 06:45:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_jz3xv415devstack@QuobyteHD /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:43 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[82543256-4195-4592-b95e-ed1b75310a40]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:45:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-eab5e9b4-0a50-4ace-bf79-dc8ee20dd099 tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:43 devstack sudo[97466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_jz3xv415devstack@QuobyteHD /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd Jul 10 06:45:43 devstack sudo[97466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:43 devstack sudo[97467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184 Jul 10 06:45:43 devstack sudo[97467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:44 devstack sudo[97467]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-eab5e9b4-0a50-4ace-bf79-dc8ee20dd099 tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184" returned: 0 in 0.875s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-eab5e9b4-0a50-4ace-bf79-dc8ee20dd099 tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184.54277910-7649-4785-9b66-3b281b784f12 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:44 devstack sudo[97483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184.54277910-7649-4785-9b66-3b281b784f12 Jul 10 06:45:44 devstack sudo[97483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:45 devstack sudo[97483]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-eab5e9b4-0a50-4ace-bf79-dc8ee20dd099 tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184.54277910-7649-4785-9b66-3b281b784f12" returned: 0 in 0.900s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-eab5e9b4-0a50-4ace-bf79-dc8ee20dd099 tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184.54277910-7649-4785-9b66-3b281b784f12 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:45 devstack sudo[97489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184.54277910-7649-4785-9b66-3b281b784f12 Jul 10 06:45:45 devstack sudo[97489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:46 devstack sudo[97466]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_jz3xv415devstack@QuobyteHD /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd" returned: 0 in 2.288s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:46 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_jz3xv415devstack@QuobyteHD, size 112.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd {{(pid=87294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 06:45:46 devstack cinder-volume[87294]: INFO cinder.image.image_utils [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Converted 112.00 MB image at 48.93 MB/s Jul 10 06:45:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:46 devstack sudo[97491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd 1G Jul 10 06:45:46 devstack sudo[97491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:46 devstack sudo[97489]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-eab5e9b4-0a50-4ace-bf79-dc8ee20dd099 tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184.54277910-7649-4785-9b66-3b281b784f12" returned: 0 in 0.726s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:46 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-eab5e9b4-0a50-4ace-bf79-dc8ee20dd099 tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "cinder-quobyte-54277910-7649-4785-9b66-3b281b784f12" released by "_delete_snapshot" :: held 3.615s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:46 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-eab5e9b4-0a50-4ace-bf79-dc8ee20dd099 tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "cinder-quobyte-7ededd08-11bd-410c-9296-42a307f8f184" released by "delete_snapshot" :: held 3.653s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:46 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-eab5e9b4-0a50-4ace-bf79-dc8ee20dd099 tempest-VolumesSnapshotTestJSON-2129310836 None] Created reservations ['88a154d8-e576-45dc-bda7-683ac63cbb8a', 'de45fa46-a273-42a3-833a-93e64d287b6e', '71024ea3-43bb-4294-9131-4ec5b5113371', 'bd08cece-0df0-45fa-bfc9-914d9acdc5ff'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:45:46 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-eab5e9b4-0a50-4ace-bf79-dc8ee20dd099 tempest-VolumesSnapshotTestJSON-2129310836 None] Delete snapshot completed successfully. Jul 10 06:45:46 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-eab5e9b4-0a50-4ace-bf79-dc8ee20dd099 tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "cinder-54277910-7649-4785-9b66-3b281b784f12-delete_snapshot" released by "delete_snapshot" :: held 3.842s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:46 devstack sudo[97491]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd 1G" returned: 0 in 0.834s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:46 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfb31c6-884a-4fda-b0bc-f62c874721d6]: (4, 'raw') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:45:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:46 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c996d893-c8db-4431-bae6-1dec780b73dd tempest-VolumesSnapshotTestJSON-2129310836 None] Acquiring lock "cinder-7ededd08-11bd-410c-9296-42a307f8f184-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:46 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c996d893-c8db-4431-bae6-1dec780b73dd tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "cinder-7ededd08-11bd-410c-9296-42a307f8f184-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:47 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c996d893-c8db-4431-bae6-1dec780b73dd tempest-VolumesSnapshotTestJSON-2129310836 None] Acquiring lock "cinder-quobyte-7ededd08-11bd-410c-9296-42a307f8f184" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:47 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c996d893-c8db-4431-bae6-1dec780b73dd tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "cinder-quobyte-7ededd08-11bd-410c-9296-42a307f8f184" acquired by "delete_volume" :: waited 0.021s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:47 devstack sudo[97497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd Jul 10 06:45:47 devstack sudo[97497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:47 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[544e5d9c-4886-4aaa-8dad-275ba6f1677e]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:45:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c996d893-c8db-4431-bae6-1dec780b73dd tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:47 devstack sudo[97499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184 Jul 10 06:45:47 devstack sudo[97499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-01ff4d7e-9a50-4745-a298-3903370620e7 req-e0eb51a6-b888-4ec3-a788-7e66a9dc7c36 tempest-AttachVolumeTestJSON-1155117856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-01ff4d7e-9a50-4745-a298-3903370620e7 req-e0eb51a6-b888-4ec3-a788-7e66a9dc7c36 tempest-AttachVolumeTestJSON-1155117856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:47 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eca2aed-e2f2-485a-a23d-e1bda457780f]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:45:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-01ff4d7e-9a50-4745-a298-3903370620e7 req-e0eb51a6-b888-4ec3-a788-7e66a9dc7c36 tempest-AttachVolumeTestJSON-1155117856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-813f563f-4836-489f-9f9d-32969c8f02a4 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:47 devstack sudo[97497]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:47 devstack sudo[97511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-813f563f-4836-489f-9f9d-32969c8f02a4 Jul 10 06:45:47 devstack sudo[97511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd" returned: 0 in 1.004s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:47 devstack sudo[97499]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c996d893-c8db-4431-bae6-1dec780b73dd tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184" returned: 0 in 0.855s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c996d893-c8db-4431-bae6-1dec780b73dd tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:47 devstack sudo[97518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184 Jul 10 06:45:47 devstack sudo[97518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:48 devstack sudo[97517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd Jul 10 06:45:48 devstack sudo[97517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:48 devstack sudo[97511]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:48 devstack sudo[97518]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c996d893-c8db-4431-bae6-1dec780b73dd tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ededd08-11bd-410c-9296-42a307f8f184" returned: 0 in 0.782s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-01ff4d7e-9a50-4745-a298-3903370620e7 req-e0eb51a6-b888-4ec3-a788-7e66a9dc7c36 tempest-AttachVolumeTestJSON-1155117856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-813f563f-4836-489f-9f9d-32969c8f02a4" returned: 0 in 0.969s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-01ff4d7e-9a50-4745-a298-3903370620e7 req-e0eb51a6-b888-4ec3-a788-7e66a9dc7c36 tempest-AttachVolumeTestJSON-1155117856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.002s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:48 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c996d893-c8db-4431-bae6-1dec780b73dd tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "cinder-quobyte-7ededd08-11bd-410c-9296-42a307f8f184" released by "delete_volume" :: held 1.727s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:48 devstack sudo[97517]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd" returned: 1 in 0.870s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd' failed. Not Retrying. {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:45:48 devstack cinder-volume[87294]: DEBUG cinder.volume.volume_utils [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Downloaded image fce564e0-408f-448f-b73c-5fae94549898 ((None, [{'url': 'file:///opt/stack/data/glance/images/fce564e0-408f-448f-b73c-5fae94549898', 'metadata': {}}])) to volume 1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd successfully. {{(pid=87294) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 06:45:48 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Temporary image fce564e0-408f-448f-b73c-5fae94549898 for user 3b01103b9e864780af5a6824d10744f3 is deleted. {{(pid=87294) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 06:45:48 devstack cinder-volume[87294]: DEBUG cinder.volume.volume_utils [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Marking volume 1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd as bootable. {{(pid=87294) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 06:45:48 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-01ff4d7e-9a50-4745-a298-3903370620e7 req-e0eb51a6-b888-4ec3-a788-7e66a9dc7c36 tempest-AttachVolumeTestJSON-1155117856 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804', 'name': 'volume-813f563f-4836-489f-9f9d-32969c8f02a4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '18ca2a4b-a119-4742-816e-df81da16b8de', 'enforce_multipath': True} {{(pid=87294) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:45:48 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Copying metadata from image fce564e0-408f-448f-b73c-5fae94549898 to 1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd. {{(pid=87294) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 06:45:48 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Creating volume glance metadata for volume 1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd backed by image fce564e0-408f-448f-b73c-5fae94549898 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fce564e0-408f-448f-b73c-5fae94549898', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87294) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 06:45:48 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-c996d893-c8db-4431-bae6-1dec780b73dd tempest-VolumesSnapshotTestJSON-2129310836 None] Created reservations ['33814be1-4706-43a3-a039-6544dc67ba86', '875f76e2-c2ff-40c5-8d57-31b46fc8b5f6', '5e08a34c-0147-4f1e-ad0c-9b140e038d88', '0bdac924-cc3e-421d-b44c-0c864df890d5'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:45:49 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-01ff4d7e-9a50-4745-a298-3903370620e7 req-e0eb51a6-b888-4ec3-a788-7e66a9dc7c36 tempest-AttachVolumeTestJSON-1155117856 None] attachment_update completed successfully. Jul 10 06:45:49 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a36dd4ba-9687-4c35-8f2c-97fdb2c156b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd', 'volume_size': 1, 'image_id': 'fce564e0-408f-448f-b73c-5fae94549898', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fce564e0-408f-448f-b73c-5fae94549898', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '62db6635aac548658dfcc55ac904ccde', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fce564e0-408f-448f-b73c-5fae94549898', 'created_at': datetime.datetime(2026, 7, 10, 4, 29, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 29, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fce564e0-408f-448f-b73c-5fae94549898/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:49 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f578fbed-e4e6-4caa-b941-27d1f3416c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:49 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Volume volume-1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd (1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd): created successfully Jul 10 06:45:49 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f578fbed-e4e6-4caa-b941-27d1f3416c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:49 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Flow 'volume_create_manager' (324e2bd4-6e4f-4da4-a221-be427a0f713c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:45:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c996d893-c8db-4431-bae6-1dec780b73dd tempest-VolumesSnapshotTestJSON-2129310836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c996d893-c8db-4431-bae6-1dec780b73dd tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:49 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-c996d893-c8db-4431-bae6-1dec780b73dd tempest-VolumesSnapshotTestJSON-2129310836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:45:49 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-c996d893-c8db-4431-bae6-1dec780b73dd tempest-VolumesSnapshotTestJSON-2129310836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:45:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c996d893-c8db-4431-bae6-1dec780b73dd tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c996d893-c8db-4431-bae6-1dec780b73dd tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:49 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-91949fe9-fc8d-40c1-8f44-8eaad7b0a3eb tempest-VolumesGetTest-1773245057 None] Created volume successfully. Jul 10 06:45:49 devstack sudo[97552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:45:49 devstack sudo[97552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:49 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-3188a673-0e37-4517-ac91-2e07c5551e61 tempest-VolumesSnapshotTestJSON-2129310836 None] Acquiring lock "cinder-9d1df4cd-f187-43fb-bac8-d733281e130c-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:49 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-3188a673-0e37-4517-ac91-2e07c5551e61 tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "cinder-9d1df4cd-f187-43fb-bac8-d733281e130c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:49 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-3188a673-0e37-4517-ac91-2e07c5551e61 tempest-VolumesSnapshotTestJSON-2129310836 None] Acquiring lock "cinder-quobyte-9d1df4cd-f187-43fb-bac8-d733281e130c" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:49 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-3188a673-0e37-4517-ac91-2e07c5551e61 tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "cinder-quobyte-9d1df4cd-f187-43fb-bac8-d733281e130c" acquired by "delete_volume" :: waited 0.017s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:49 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e8d430-8e06-485c-b268-8b03e1f30c1c]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:45:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3188a673-0e37-4517-ac91-2e07c5551e61 tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:49 devstack sudo[97555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c Jul 10 06:45:49 devstack sudo[97555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:49 devstack sudo[97552]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c996d893-c8db-4431-bae6-1dec780b73dd tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.856s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:49 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-c996d893-c8db-4431-bae6-1dec780b73dd tempest-VolumesSnapshotTestJSON-2129310836 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:45:49 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-c996d893-c8db-4431-bae6-1dec780b73dd tempest-VolumesSnapshotTestJSON-2129310836 None] Deleted volume successfully. Jul 10 06:45:50 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c996d893-c8db-4431-bae6-1dec780b73dd tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "cinder-7ededd08-11bd-410c-9296-42a307f8f184-delete_volume" released by "delete_volume" :: held 3.032s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:50 devstack sudo[97555]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3188a673-0e37-4517-ac91-2e07c5551e61 tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c" returned: 0 in 1.002s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3188a673-0e37-4517-ac91-2e07c5551e61 tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:50 devstack sudo[97564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c Jul 10 06:45:50 devstack sudo[97564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:50 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-d984adac-929b-464f-9ab7-a0d5da1b2654 tempest-VolumesGetTest-1773245057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:45:50 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d984adac-929b-464f-9ab7-a0d5da1b2654 tempest-VolumesGetTest-1773245057 None] Flow 'volume_create_manager' (71f94798-5174-40d3-9394-9d683715d213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:45:50 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d984adac-929b-464f-9ab7-a0d5da1b2654 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bae7c66-c87b-459a-8b69-1349ad56fcda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:51 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d984adac-929b-464f-9ab7-a0d5da1b2654 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bae7c66-c87b-459a-8b69-1349ad56fcda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:45:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2001372661',display_name='tempest-VolumesGetTest-Volume-429699827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfa164f7-21f1-410f-804c-acdc6d3a0784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e516fd258b49497d9b6fe259af09b0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:45:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:45:51Z,use_quota=True,user_id='3b01103b9e864780af5a6824d10744f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:51 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d984adac-929b-464f-9ab7-a0d5da1b2654 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed67711d-01a8-4f4d-8e56-562d8442226e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:51 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d984adac-929b-464f-9ab7-a0d5da1b2654 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed67711d-01a8-4f4d-8e56-562d8442226e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:51 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d984adac-929b-464f-9ab7-a0d5da1b2654 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fec5deba-72c5-4625-993b-776ff5a66d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:51 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d984adac-929b-464f-9ab7-a0d5da1b2654 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fec5deba-72c5-4625-993b-776ff5a66d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfa164f7-21f1-410f-804c-acdc6d3a0784', 'volume_name': 'volume-bfa164f7-21f1-410f-804c-acdc6d3a0784', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:51 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d984adac-929b-464f-9ab7-a0d5da1b2654 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (118507ca-60b8-4ba9-9111-a0f79f96673d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:51 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d984adac-929b-464f-9ab7-a0d5da1b2654 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (118507ca-60b8-4ba9-9111-a0f79f96673d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:51 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d984adac-929b-464f-9ab7-a0d5da1b2654 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (820e3863-56cf-4699-b9c4-0cdd629a9632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:51 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-d984adac-929b-464f-9ab7-a0d5da1b2654 tempest-VolumesGetTest-1773245057 None] Volume bfa164f7-21f1-410f-804c-acdc6d3a0784: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfa164f7-21f1-410f-804c-acdc6d3a0784', 'volume_size': 1} Jul 10 06:45:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d984adac-929b-464f-9ab7-a0d5da1b2654 tempest-VolumesGetTest-1773245057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d984adac-929b-464f-9ab7-a0d5da1b2654 tempest-VolumesGetTest-1773245057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:51 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-d984adac-929b-464f-9ab7-a0d5da1b2654 tempest-VolumesGetTest-1773245057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:45:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2001372661',display_name='tempest-VolumesGetTest-Volume-429699827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfa164f7-21f1-410f-804c-acdc6d3a0784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e516fd258b49497d9b6fe259af09b0d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:45:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:45:51Z,use_quota=True,user_id='3b01103b9e864780af5a6824d10744f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:45:51 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-d984adac-929b-464f-9ab7-a0d5da1b2654 tempest-VolumesGetTest-1773245057 None] Creating volume bfa164f7-21f1-410f-804c-acdc6d3a0784 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:45:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d984adac-929b-464f-9ab7-a0d5da1b2654 tempest-VolumesGetTest-1773245057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d984adac-929b-464f-9ab7-a0d5da1b2654 tempest-VolumesGetTest-1773245057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:51 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-d984adac-929b-464f-9ab7-a0d5da1b2654 tempest-VolumesGetTest-1773245057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:45:51 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-d984adac-929b-464f-9ab7-a0d5da1b2654 tempest-VolumesGetTest-1773245057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:45:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d984adac-929b-464f-9ab7-a0d5da1b2654 tempest-VolumesGetTest-1773245057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:51 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-d984adac-929b-464f-9ab7-a0d5da1b2654 tempest-VolumesGetTest-1773245057 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:45:51 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-d984adac-929b-464f-9ab7-a0d5da1b2654 tempest-VolumesGetTest-1773245057 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:45:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d984adac-929b-464f-9ab7-a0d5da1b2654 tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bfa164f7-21f1-410f-804c-acdc6d3a0784 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:51 devstack sudo[97566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bfa164f7-21f1-410f-804c-acdc6d3a0784 1073741824 Jul 10 06:45:51 devstack sudo[97566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:51 devstack sudo[97564]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3188a673-0e37-4517-ac91-2e07c5551e61 tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d1df4cd-f187-43fb-bac8-d733281e130c" returned: 0 in 0.837s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:51 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-3188a673-0e37-4517-ac91-2e07c5551e61 tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "cinder-quobyte-9d1df4cd-f187-43fb-bac8-d733281e130c" released by "delete_volume" :: held 1.901s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:51 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-3188a673-0e37-4517-ac91-2e07c5551e61 tempest-VolumesSnapshotTestJSON-2129310836 None] Created reservations ['213a795f-a23e-43ef-a62d-fe2fcbfa843b', 'bf129db6-3cb7-492c-9a1d-67b3cf99b9e3', '63578fc3-aab0-45f9-8e01-43a07571d36c', '873b3d7d-28ee-4803-adfb-725882492338'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:45:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-3188a673-0e37-4517-ac91-2e07c5551e61 tempest-VolumesSnapshotTestJSON-2129310836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-3188a673-0e37-4517-ac91-2e07c5551e61 tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:51 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-3188a673-0e37-4517-ac91-2e07c5551e61 tempest-VolumesSnapshotTestJSON-2129310836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:45:51 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-3188a673-0e37-4517-ac91-2e07c5551e61 tempest-VolumesSnapshotTestJSON-2129310836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:45:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-3188a673-0e37-4517-ac91-2e07c5551e61 tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3188a673-0e37-4517-ac91-2e07c5551e61 tempest-VolumesSnapshotTestJSON-2129310836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:51 devstack sudo[97569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:45:51 devstack sudo[97569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:52 devstack sudo[97566]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d984adac-929b-464f-9ab7-a0d5da1b2654 tempest-VolumesGetTest-1773245057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bfa164f7-21f1-410f-804c-acdc6d3a0784 1073741824" returned: 0 in 1.025s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d984adac-929b-464f-9ab7-a0d5da1b2654 tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bfa164f7-21f1-410f-804c-acdc6d3a0784 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:52 devstack sudo[97575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bfa164f7-21f1-410f-804c-acdc6d3a0784 Jul 10 06:45:52 devstack sudo[97575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:52 devstack sudo[97569]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3188a673-0e37-4517-ac91-2e07c5551e61 tempest-VolumesSnapshotTestJSON-2129310836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.884s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:52 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-3188a673-0e37-4517-ac91-2e07c5551e61 tempest-VolumesSnapshotTestJSON-2129310836 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:45:52 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-3188a673-0e37-4517-ac91-2e07c5551e61 tempest-VolumesSnapshotTestJSON-2129310836 None] Deleted volume successfully. Jul 10 06:45:52 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-3188a673-0e37-4517-ac91-2e07c5551e61 tempest-VolumesSnapshotTestJSON-2129310836 None] Lock "cinder-9d1df4cd-f187-43fb-bac8-d733281e130c-delete_volume" released by "delete_volume" :: held 3.073s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:52 devstack sudo[97575]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d984adac-929b-464f-9ab7-a0d5da1b2654 tempest-VolumesGetTest-1773245057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bfa164f7-21f1-410f-804c-acdc6d3a0784" returned: 0 in 0.863s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:52 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-d984adac-929b-464f-9ab7-a0d5da1b2654 tempest-VolumesGetTest-1773245057 None] <== create_volume: return (1937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:45:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d984adac-929b-464f-9ab7-a0d5da1b2654 tempest-VolumesGetTest-1773245057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.940s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:53 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d984adac-929b-464f-9ab7-a0d5da1b2654 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (820e3863-56cf-4699-b9c4-0cdd629a9632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfa164f7-21f1-410f-804c-acdc6d3a0784', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:53 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d984adac-929b-464f-9ab7-a0d5da1b2654 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a0b79b6-47e3-40b6-9f9d-1614a36d8de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:45:53 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-d984adac-929b-464f-9ab7-a0d5da1b2654 tempest-VolumesGetTest-1773245057 None] Volume volume-bfa164f7-21f1-410f-804c-acdc6d3a0784 (bfa164f7-21f1-410f-804c-acdc6d3a0784): created successfully Jul 10 06:45:53 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d984adac-929b-464f-9ab7-a0d5da1b2654 tempest-VolumesGetTest-1773245057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a0b79b6-47e3-40b6-9f9d-1614a36d8de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:45:53 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d984adac-929b-464f-9ab7-a0d5da1b2654 tempest-VolumesGetTest-1773245057 None] Flow 'volume_create_manager' (71f94798-5174-40d3-9394-9d683715d213) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:45:53 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-d984adac-929b-464f-9ab7-a0d5da1b2654 tempest-VolumesGetTest-1773245057 None] Created volume successfully. Jul 10 06:45:54 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d159d0d6-0f69-4af0-b90f-138a042ec897 tempest-VolumesGetTest-1773245057 None] Acquiring lock "cinder-bfa164f7-21f1-410f-804c-acdc6d3a0784-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:54 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d159d0d6-0f69-4af0-b90f-138a042ec897 tempest-VolumesGetTest-1773245057 None] Lock "cinder-bfa164f7-21f1-410f-804c-acdc6d3a0784-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:54 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d159d0d6-0f69-4af0-b90f-138a042ec897 tempest-VolumesGetTest-1773245057 None] Acquiring lock "cinder-quobyte-bfa164f7-21f1-410f-804c-acdc6d3a0784" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:54 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d159d0d6-0f69-4af0-b90f-138a042ec897 tempest-VolumesGetTest-1773245057 None] Lock "cinder-quobyte-bfa164f7-21f1-410f-804c-acdc6d3a0784" acquired by "delete_volume" :: waited 0.015s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:54 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[186a247f-11b7-4332-a382-f4a9dbc246c1]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:45:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d159d0d6-0f69-4af0-b90f-138a042ec897 tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bfa164f7-21f1-410f-804c-acdc6d3a0784 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:54 devstack sudo[97583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bfa164f7-21f1-410f-804c-acdc6d3a0784 Jul 10 06:45:54 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:55 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-d35c3622-3ec1-4159-83f9-9a683fb69816 req-0bd790e9-8e6f-4bef-9337-ec0122347faa tempest-AttachVolumeTestJSON-1155117856 None] Terminate volume connection completed successfully. Jul 10 06:45:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-d35c3622-3ec1-4159-83f9-9a683fb69816 req-0bd790e9-8e6f-4bef-9337-ec0122347faa tempest-AttachVolumeTestJSON-1155117856 None] Deleting attachment d989faae-85e1-46a0-8566-b51fcfbb8b4f. {{(pid=87294) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:45:55 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d159d0d6-0f69-4af0-b90f-138a042ec897 tempest-VolumesGetTest-1773245057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bfa164f7-21f1-410f-804c-acdc6d3a0784" returned: 0 in 0.991s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d159d0d6-0f69-4af0-b90f-138a042ec897 tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bfa164f7-21f1-410f-804c-acdc6d3a0784 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:55 devstack sudo[97591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bfa164f7-21f1-410f-804c-acdc6d3a0784 Jul 10 06:45:55 devstack sudo[97591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:56 devstack sudo[97591]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d159d0d6-0f69-4af0-b90f-138a042ec897 tempest-VolumesGetTest-1773245057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-bfa164f7-21f1-410f-804c-acdc6d3a0784" returned: 0 in 1.022s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:56 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d159d0d6-0f69-4af0-b90f-138a042ec897 tempest-VolumesGetTest-1773245057 None] Lock "cinder-quobyte-bfa164f7-21f1-410f-804c-acdc6d3a0784" released by "delete_volume" :: held 2.107s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:56 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-d159d0d6-0f69-4af0-b90f-138a042ec897 tempest-VolumesGetTest-1773245057 None] Created reservations ['211bb8e3-740b-4e06-9030-65702c680f7a', '28c7352d-1cc0-4790-8a6b-54b05da0957c', 'a05215e3-6368-4e28-b1ab-abbc3754be7f', '6204783b-bc0c-4562-89e8-63391255f288'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:45:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d159d0d6-0f69-4af0-b90f-138a042ec897 tempest-VolumesGetTest-1773245057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:45:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d159d0d6-0f69-4af0-b90f-138a042ec897 tempest-VolumesGetTest-1773245057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:45:56 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-d159d0d6-0f69-4af0-b90f-138a042ec897 tempest-VolumesGetTest-1773245057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:45:56 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-d159d0d6-0f69-4af0-b90f-138a042ec897 tempest-VolumesGetTest-1773245057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:45:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d159d0d6-0f69-4af0-b90f-138a042ec897 tempest-VolumesGetTest-1773245057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:45:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d159d0d6-0f69-4af0-b90f-138a042ec897 tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:56 devstack sudo[97596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:45:56 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:57 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d159d0d6-0f69-4af0-b90f-138a042ec897 tempest-VolumesGetTest-1773245057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.865s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:57 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-d159d0d6-0f69-4af0-b90f-138a042ec897 tempest-VolumesGetTest-1773245057 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:45:57 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-d159d0d6-0f69-4af0-b90f-138a042ec897 tempest-VolumesGetTest-1773245057 None] Deleted volume successfully. Jul 10 06:45:57 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d159d0d6-0f69-4af0-b90f-138a042ec897 tempest-VolumesGetTest-1773245057 None] Lock "cinder-bfa164f7-21f1-410f-804c-acdc6d3a0784-delete_volume" released by "delete_volume" :: held 3.279s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:45:57 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6a41b039-3f82-4b0c-bc6a-c37dc15dd785 tempest-VolumesGetTest-1773245057 None] Acquiring lock "cinder-1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:57 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6a41b039-3f82-4b0c-bc6a-c37dc15dd785 tempest-VolumesGetTest-1773245057 None] Lock "cinder-1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:57 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6a41b039-3f82-4b0c-bc6a-c37dc15dd785 tempest-VolumesGetTest-1773245057 None] Acquiring lock "cinder-quobyte-1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:45:57 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6a41b039-3f82-4b0c-bc6a-c37dc15dd785 tempest-VolumesGetTest-1773245057 None] Lock "cinder-quobyte-1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd" acquired by "delete_volume" :: waited 0.041s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:45:58 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e5bee6-d8ac-4be2-80c8-514d7e06d375]: (4, 'raw') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:45:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6a41b039-3f82-4b0c-bc6a-c37dc15dd785 tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:58 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:DELETE=10,cinder:UPDATE=150,cinder:SELECT=114,cinder:INSERT=43 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:45:58 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-a8fe217a-8ce7-4f81-aa5b-2bbcdfb8300b req-319bf959-611a-4681-90d8-51e12ae02645 tempest-AttachVolumeTestJSON-1155117856 None] Terminate volume connection completed successfully. Jul 10 06:45:58 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-a8fe217a-8ce7-4f81-aa5b-2bbcdfb8300b req-319bf959-611a-4681-90d8-51e12ae02645 tempest-AttachVolumeTestJSON-1155117856 None] Deleting attachment 18ca2a4b-a119-4742-816e-df81da16b8de. {{(pid=87294) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:45:58 devstack sudo[97604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd Jul 10 06:45:58 devstack sudo[97604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:45:59 devstack sudo[97604]: pam_unix(sudo:session): session closed for user root Jul 10 06:45:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6a41b039-3f82-4b0c-bc6a-c37dc15dd785 tempest-VolumesGetTest-1773245057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd" returned: 0 in 1.130s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:45:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6a41b039-3f82-4b0c-bc6a-c37dc15dd785 tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:45:59 devstack sudo[97609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd Jul 10 06:45:59 devstack sudo[97609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:00 devstack sudo[97609]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6a41b039-3f82-4b0c-bc6a-c37dc15dd785 tempest-VolumesGetTest-1773245057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd" returned: 1 in 0.916s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6a41b039-3f82-4b0c-bc6a-c37dc15dd785 tempest-VolumesGetTest-1773245057 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd' failed. Not Retrying. {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:46:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6a41b039-3f82-4b0c-bc6a-c37dc15dd785 tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:00 devstack sudo[97615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd Jul 10 06:46:00 devstack sudo[97615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:00 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-f927b6b7-e15d-483a-94a4-a255771d27a3 tempest-VolumesSnapshotListTestJSON-1075097727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:46:00 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f927b6b7-e15d-483a-94a4-a255771d27a3 tempest-VolumesSnapshotListTestJSON-1075097727 None] Flow 'volume_create_manager' (b93c23e5-6fcb-4c36-8796-22fafd28e13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:46:00 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f927b6b7-e15d-483a-94a4-a255771d27a3 tempest-VolumesSnapshotListTestJSON-1075097727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10e8b695-6812-4f5b-8d68-79e5b07546f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f927b6b7-e15d-483a-94a4-a255771d27a3 tempest-VolumesSnapshotListTestJSON-1075097727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10e8b695-6812-4f5b-8d68-79e5b07546f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-250554848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=459ef838-0d55-4822-acaa-5ccfbbf73696,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f025aa81de2e4fb6b3a8aeb15d40766c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:46:01Z,use_quota=True,user_id='acdbc16fb0464a0cac589251f2c04e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f927b6b7-e15d-483a-94a4-a255771d27a3 tempest-VolumesSnapshotListTestJSON-1075097727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (609e79e2-3877-48e0-99c8-271e66aac850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f927b6b7-e15d-483a-94a4-a255771d27a3 tempest-VolumesSnapshotListTestJSON-1075097727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (609e79e2-3877-48e0-99c8-271e66aac850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f927b6b7-e15d-483a-94a4-a255771d27a3 tempest-VolumesSnapshotListTestJSON-1075097727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d4dd0b1-fd89-44e5-ab4f-eb1bee7ecc31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f927b6b7-e15d-483a-94a4-a255771d27a3 tempest-VolumesSnapshotListTestJSON-1075097727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d4dd0b1-fd89-44e5-ab4f-eb1bee7ecc31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '459ef838-0d55-4822-acaa-5ccfbbf73696', 'volume_name': 'volume-459ef838-0d55-4822-acaa-5ccfbbf73696', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:01 devstack sudo[97615]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f927b6b7-e15d-483a-94a4-a255771d27a3 tempest-VolumesSnapshotListTestJSON-1075097727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f29f59ea-0d0d-47be-b36a-678d826e47c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f927b6b7-e15d-483a-94a4-a255771d27a3 tempest-VolumesSnapshotListTestJSON-1075097727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f29f59ea-0d0d-47be-b36a-678d826e47c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f927b6b7-e15d-483a-94a4-a255771d27a3 tempest-VolumesSnapshotListTestJSON-1075097727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94af13c2-e03b-455d-9682-7311d457979e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:01 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-f927b6b7-e15d-483a-94a4-a255771d27a3 tempest-VolumesSnapshotListTestJSON-1075097727 None] Volume 459ef838-0d55-4822-acaa-5ccfbbf73696: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-459ef838-0d55-4822-acaa-5ccfbbf73696', 'volume_size': 1} Jul 10 06:46:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f927b6b7-e15d-483a-94a4-a255771d27a3 tempest-VolumesSnapshotListTestJSON-1075097727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f927b6b7-e15d-483a-94a4-a255771d27a3 tempest-VolumesSnapshotListTestJSON-1075097727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:01 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f927b6b7-e15d-483a-94a4-a255771d27a3 tempest-VolumesSnapshotListTestJSON-1075097727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-250554848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=459ef838-0d55-4822-acaa-5ccfbbf73696,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f025aa81de2e4fb6b3a8aeb15d40766c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:46:01Z,use_quota=True,user_id='acdbc16fb0464a0cac589251f2c04e7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:46:01 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-f927b6b7-e15d-483a-94a4-a255771d27a3 tempest-VolumesSnapshotListTestJSON-1075097727 None] Creating volume 459ef838-0d55-4822-acaa-5ccfbbf73696 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:46:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f927b6b7-e15d-483a-94a4-a255771d27a3 tempest-VolumesSnapshotListTestJSON-1075097727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f927b6b7-e15d-483a-94a4-a255771d27a3 tempest-VolumesSnapshotListTestJSON-1075097727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:01 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f927b6b7-e15d-483a-94a4-a255771d27a3 tempest-VolumesSnapshotListTestJSON-1075097727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:46:01 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f927b6b7-e15d-483a-94a4-a255771d27a3 tempest-VolumesSnapshotListTestJSON-1075097727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:46:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f927b6b7-e15d-483a-94a4-a255771d27a3 tempest-VolumesSnapshotListTestJSON-1075097727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:01 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f927b6b7-e15d-483a-94a4-a255771d27a3 tempest-VolumesSnapshotListTestJSON-1075097727 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:46:01 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-f927b6b7-e15d-483a-94a4-a255771d27a3 tempest-VolumesSnapshotListTestJSON-1075097727 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:46:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f927b6b7-e15d-483a-94a4-a255771d27a3 tempest-VolumesSnapshotListTestJSON-1075097727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6a41b039-3f82-4b0c-bc6a-c37dc15dd785 tempest-VolumesGetTest-1773245057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd" returned: 0 in 0.952s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:01 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696 1073741824 Jul 10 06:46:01 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:01 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6a41b039-3f82-4b0c-bc6a-c37dc15dd785 tempest-VolumesGetTest-1773245057 None] Lock "cinder-quobyte-1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd" released by "delete_volume" :: held 3.117s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:01 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-6a41b039-3f82-4b0c-bc6a-c37dc15dd785 tempest-VolumesGetTest-1773245057 None] Created reservations ['e6bed148-d056-4199-bef5-e7a98bd783f1', 'ff29b8d3-9758-4fa0-bf28-3a13cbe8f18e', '5526cec5-8f0f-4936-af3f-71acd1a0957a', 'e5754950-4b59-4ee9-9287-b7329239a33a'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:46:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-6a41b039-3f82-4b0c-bc6a-c37dc15dd785 tempest-VolumesGetTest-1773245057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-6a41b039-3f82-4b0c-bc6a-c37dc15dd785 tempest-VolumesGetTest-1773245057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:01 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-6a41b039-3f82-4b0c-bc6a-c37dc15dd785 tempest-VolumesGetTest-1773245057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:46:01 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-6a41b039-3f82-4b0c-bc6a-c37dc15dd785 tempest-VolumesGetTest-1773245057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:46:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-6a41b039-3f82-4b0c-bc6a-c37dc15dd785 tempest-VolumesGetTest-1773245057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6a41b039-3f82-4b0c-bc6a-c37dc15dd785 tempest-VolumesGetTest-1773245057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:01 devstack sudo[97620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:46:01 devstack sudo[97620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:02 devstack sudo[97620]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6a41b039-3f82-4b0c-bc6a-c37dc15dd785 tempest-VolumesGetTest-1773245057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.819s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:02 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-6a41b039-3f82-4b0c-bc6a-c37dc15dd785 tempest-VolumesGetTest-1773245057 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:46:02 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-6a41b039-3f82-4b0c-bc6a-c37dc15dd785 tempest-VolumesGetTest-1773245057 None] Deleted volume successfully. Jul 10 06:46:02 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f927b6b7-e15d-483a-94a4-a255771d27a3 tempest-VolumesSnapshotListTestJSON-1075097727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696 1073741824" returned: 0 in 1.136s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:02 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6a41b039-3f82-4b0c-bc6a-c37dc15dd785 tempest-VolumesGetTest-1773245057 None] Lock "cinder-1b61eb84-e91f-4da8-88cf-be3bf7c7ebcd-delete_volume" released by "delete_volume" :: held 4.309s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f927b6b7-e15d-483a-94a4-a255771d27a3 tempest-VolumesSnapshotListTestJSON-1075097727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:02 devstack sudo[97633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696 Jul 10 06:46:02 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:03 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f927b6b7-e15d-483a-94a4-a255771d27a3 tempest-VolumesSnapshotListTestJSON-1075097727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696" returned: 0 in 0.997s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:03 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f927b6b7-e15d-483a-94a4-a255771d27a3 tempest-VolumesSnapshotListTestJSON-1075097727 None] <== create_volume: return (2184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:46:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f927b6b7-e15d-483a-94a4-a255771d27a3 tempest-VolumesSnapshotListTestJSON-1075097727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.187s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:03 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f927b6b7-e15d-483a-94a4-a255771d27a3 tempest-VolumesSnapshotListTestJSON-1075097727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94af13c2-e03b-455d-9682-7311d457979e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-459ef838-0d55-4822-acaa-5ccfbbf73696', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:03 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f927b6b7-e15d-483a-94a4-a255771d27a3 tempest-VolumesSnapshotListTestJSON-1075097727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb318f69-6aec-4f11-8298-321316dba750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:03 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-f927b6b7-e15d-483a-94a4-a255771d27a3 tempest-VolumesSnapshotListTestJSON-1075097727 None] Volume volume-459ef838-0d55-4822-acaa-5ccfbbf73696 (459ef838-0d55-4822-acaa-5ccfbbf73696): created successfully Jul 10 06:46:03 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f927b6b7-e15d-483a-94a4-a255771d27a3 tempest-VolumesSnapshotListTestJSON-1075097727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb318f69-6aec-4f11-8298-321316dba750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:03 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f927b6b7-e15d-483a-94a4-a255771d27a3 tempest-VolumesSnapshotListTestJSON-1075097727 None] Flow 'volume_create_manager' (b93c23e5-6fcb-4c36-8796-22fafd28e13d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:46:03 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-f927b6b7-e15d-483a-94a4-a255771d27a3 tempest-VolumesSnapshotListTestJSON-1075097727 None] Created volume successfully. Jul 10 06:46:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2e051667-b7ce-46a3-8ab3-d450fa1b0025 tempest-VolumesSnapshotListTestJSON-1075097727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2e051667-b7ce-46a3-8ab3-d450fa1b0025 tempest-VolumesSnapshotListTestJSON-1075097727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:04 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-2e051667-b7ce-46a3-8ab3-d450fa1b0025 tempest-VolumesSnapshotListTestJSON-1075097727 None] Creating offline snapshot eb4682d1-ef04-408c-b397-77f399b2f43b of volume 459ef838-0d55-4822-acaa-5ccfbbf73696 {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:46:04 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c32d98c-d5e1-4c69-8867-60b39673ffb2]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2e051667-b7ce-46a3-8ab3-d450fa1b0025 tempest-VolumesSnapshotListTestJSON-1075097727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:04 devstack sudo[97654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696 Jul 10 06:46:04 devstack sudo[97654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:05 devstack sudo[97654]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2e051667-b7ce-46a3-8ab3-d450fa1b0025 tempest-VolumesSnapshotListTestJSON-1075097727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696" returned: 0 in 1.215s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2e051667-b7ce-46a3-8ab3-d450fa1b0025 tempest-VolumesSnapshotListTestJSON-1075097727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.eb4682d1-ef04-408c-b397-77f399b2f43b 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:05 devstack sudo[97659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.eb4682d1-ef04-408c-b397-77f399b2f43b 1G Jul 10 06:46:05 devstack sudo[97659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:06 devstack sudo[97659]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2e051667-b7ce-46a3-8ab3-d450fa1b0025 tempest-VolumesSnapshotListTestJSON-1075097727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.eb4682d1-ef04-408c-b397-77f399b2f43b 1G" returned: 0 in 1.096s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2e051667-b7ce-46a3-8ab3-d450fa1b0025 tempest-VolumesSnapshotListTestJSON-1075097727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-459ef838-0d55-4822-acaa-5ccfbbf73696 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.eb4682d1-ef04-408c-b397-77f399b2f43b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:06 devstack sudo[97665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-459ef838-0d55-4822-acaa-5ccfbbf73696 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.eb4682d1-ef04-408c-b397-77f399b2f43b Jul 10 06:46:06 devstack sudo[97665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:07 devstack sudo[97665]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2e051667-b7ce-46a3-8ab3-d450fa1b0025 tempest-VolumesSnapshotListTestJSON-1075097727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-459ef838-0d55-4822-acaa-5ccfbbf73696 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.eb4682d1-ef04-408c-b397-77f399b2f43b" returned: 0 in 1.204s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:07 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-2e051667-b7ce-46a3-8ab3-d450fa1b0025 tempest-VolumesSnapshotListTestJSON-1075097727 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.eb4682d1-ef04-408c-b397-77f399b2f43b is being set with open permissions: ugo+rw Jul 10 06:46:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2e051667-b7ce-46a3-8ab3-d450fa1b0025 tempest-VolumesSnapshotListTestJSON-1075097727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.eb4682d1-ef04-408c-b397-77f399b2f43b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:07 devstack sudo[97672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.eb4682d1-ef04-408c-b397-77f399b2f43b Jul 10 06:46:07 devstack sudo[97672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:08 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-661f4e1c-83e6-4a55-a02e-b568d7ca65e9 tempest-VolumesNegativeTest-48208343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:46:08 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-661f4e1c-83e6-4a55-a02e-b568d7ca65e9 tempest-VolumesNegativeTest-48208343 None] Flow 'volume_create_manager' (a32612cd-68f8-4b9e-b09d-b65ed48012b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:46:08 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-661f4e1c-83e6-4a55-a02e-b568d7ca65e9 tempest-VolumesNegativeTest-48208343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef4b5e02-6662-4937-86f7-a239458736e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:08 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-661f4e1c-83e6-4a55-a02e-b568d7ca65e9 tempest-VolumesNegativeTest-48208343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef4b5e02-6662-4937-86f7-a239458736e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-592593605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f34fe795-881d-43f1-8567-20ee39a71e3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='600e8ad32a2f4c988ff3fc6687fc787d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:46:08Z,use_quota=True,user_id='8c83b8460a254c1ba0c83674b09cd76c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:08 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-661f4e1c-83e6-4a55-a02e-b568d7ca65e9 tempest-VolumesNegativeTest-48208343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7763e496-9b37-4418-96f3-f73587a45d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:08 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-661f4e1c-83e6-4a55-a02e-b568d7ca65e9 tempest-VolumesNegativeTest-48208343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7763e496-9b37-4418-96f3-f73587a45d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:08 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-661f4e1c-83e6-4a55-a02e-b568d7ca65e9 tempest-VolumesNegativeTest-48208343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (602293eb-e2c7-489f-96f1-80bb6ba60d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:08 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-661f4e1c-83e6-4a55-a02e-b568d7ca65e9 tempest-VolumesNegativeTest-48208343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (602293eb-e2c7-489f-96f1-80bb6ba60d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f34fe795-881d-43f1-8567-20ee39a71e3e', 'volume_name': 'volume-f34fe795-881d-43f1-8567-20ee39a71e3e', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:08 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-661f4e1c-83e6-4a55-a02e-b568d7ca65e9 tempest-VolumesNegativeTest-48208343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbf0f538-1d6b-42c0-8060-784c6ada4230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:08 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-661f4e1c-83e6-4a55-a02e-b568d7ca65e9 tempest-VolumesNegativeTest-48208343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbf0f538-1d6b-42c0-8060-784c6ada4230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:08 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-661f4e1c-83e6-4a55-a02e-b568d7ca65e9 tempest-VolumesNegativeTest-48208343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (302271ca-4225-43ba-9ee0-125c008e2518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:08 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-661f4e1c-83e6-4a55-a02e-b568d7ca65e9 tempest-VolumesNegativeTest-48208343 None] Volume f34fe795-881d-43f1-8567-20ee39a71e3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f34fe795-881d-43f1-8567-20ee39a71e3e', 'volume_size': 1} Jul 10 06:46:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-661f4e1c-83e6-4a55-a02e-b568d7ca65e9 tempest-VolumesNegativeTest-48208343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:08 devstack sudo[97672]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2e051667-b7ce-46a3-8ab3-d450fa1b0025 tempest-VolumesSnapshotListTestJSON-1075097727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.eb4682d1-ef04-408c-b397-77f399b2f43b" returned: 0 in 0.817s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2e051667-b7ce-46a3-8ab3-d450fa1b0025 tempest-VolumesSnapshotListTestJSON-1075097727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:08 devstack sudo[97675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.info Jul 10 06:46:08 devstack sudo[97675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:09 devstack sudo[97675]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2e051667-b7ce-46a3-8ab3-d450fa1b0025 tempest-VolumesSnapshotListTestJSON-1075097727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.info" returned: 0 in 0.770s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:09 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-2e051667-b7ce-46a3-8ab3-d450fa1b0025 tempest-VolumesSnapshotListTestJSON-1075097727 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.info is being set with open permissions: ugo+rw Jul 10 06:46:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2e051667-b7ce-46a3-8ab3-d450fa1b0025 tempest-VolumesSnapshotListTestJSON-1075097727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:09 devstack sudo[97679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.info Jul 10 06:46:09 devstack sudo[97679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:10 devstack sudo[97679]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2e051667-b7ce-46a3-8ab3-d450fa1b0025 tempest-VolumesSnapshotListTestJSON-1075097727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.info" returned: 0 in 0.822s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2e051667-b7ce-46a3-8ab3-d450fa1b0025 tempest-VolumesSnapshotListTestJSON-1075097727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.019s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-661f4e1c-83e6-4a55-a02e-b568d7ca65e9 tempest-VolumesNegativeTest-48208343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.157s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:10 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-661f4e1c-83e6-4a55-a02e-b568d7ca65e9 tempest-VolumesNegativeTest-48208343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-592593605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f34fe795-881d-43f1-8567-20ee39a71e3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='600e8ad32a2f4c988ff3fc6687fc787d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:46:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:46:08Z,use_quota=True,user_id='8c83b8460a254c1ba0c83674b09cd76c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:46:10 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-661f4e1c-83e6-4a55-a02e-b568d7ca65e9 tempest-VolumesNegativeTest-48208343 None] Creating volume f34fe795-881d-43f1-8567-20ee39a71e3e {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:46:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-661f4e1c-83e6-4a55-a02e-b568d7ca65e9 tempest-VolumesNegativeTest-48208343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-661f4e1c-83e6-4a55-a02e-b568d7ca65e9 tempest-VolumesNegativeTest-48208343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:10 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-661f4e1c-83e6-4a55-a02e-b568d7ca65e9 tempest-VolumesNegativeTest-48208343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:46:10 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-661f4e1c-83e6-4a55-a02e-b568d7ca65e9 tempest-VolumesNegativeTest-48208343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:46:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-661f4e1c-83e6-4a55-a02e-b568d7ca65e9 tempest-VolumesNegativeTest-48208343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:10 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-661f4e1c-83e6-4a55-a02e-b568d7ca65e9 tempest-VolumesNegativeTest-48208343 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:46:10 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-661f4e1c-83e6-4a55-a02e-b568d7ca65e9 tempest-VolumesNegativeTest-48208343 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:46:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-661f4e1c-83e6-4a55-a02e-b568d7ca65e9 tempest-VolumesNegativeTest-48208343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f34fe795-881d-43f1-8567-20ee39a71e3e 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:10 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:UPDATE=131,cinder:DELETE=15,cinder:INSERT=33,cinder:SELECT=112 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:46:10 devstack sudo[97682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f34fe795-881d-43f1-8567-20ee39a71e3e 1073741824 Jul 10 06:46:10 devstack sudo[97682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:10 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-2e051667-b7ce-46a3-8ab3-d450fa1b0025 tempest-VolumesSnapshotListTestJSON-1075097727 None] Create snapshot completed successfully Jul 10 06:46:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-efe14cc7-a4de-4554-982a-5d12da053d6c tempest-VolumesSnapshotListTestJSON-1075097727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:11 devstack sudo[97682]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-661f4e1c-83e6-4a55-a02e-b568d7ca65e9 tempest-VolumesNegativeTest-48208343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f34fe795-881d-43f1-8567-20ee39a71e3e 1073741824" returned: 0 in 1.025s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-661f4e1c-83e6-4a55-a02e-b568d7ca65e9 tempest-VolumesNegativeTest-48208343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f34fe795-881d-43f1-8567-20ee39a71e3e {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:11 devstack sudo[97688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f34fe795-881d-43f1-8567-20ee39a71e3e Jul 10 06:46:11 devstack sudo[97688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:12 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-25f4120f-5b81-45c9-a78a-4b7466ad16ee tempest-AttachVolumeTestJSON-1155117856 None] Acquiring lock "cinder-813f563f-4836-489f-9f9d-32969c8f02a4-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:12 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-25f4120f-5b81-45c9-a78a-4b7466ad16ee tempest-AttachVolumeTestJSON-1155117856 None] Lock "cinder-813f563f-4836-489f-9f9d-32969c8f02a4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:12 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-25f4120f-5b81-45c9-a78a-4b7466ad16ee tempest-AttachVolumeTestJSON-1155117856 None] Acquiring lock "cinder-quobyte-813f563f-4836-489f-9f9d-32969c8f02a4" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:12 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-25f4120f-5b81-45c9-a78a-4b7466ad16ee tempest-AttachVolumeTestJSON-1155117856 None] Lock "cinder-quobyte-813f563f-4836-489f-9f9d-32969c8f02a4" acquired by "delete_volume" :: waited 0.016s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:12 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[781bf245-3880-4bce-bf83-872bdb279481]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-25f4120f-5b81-45c9-a78a-4b7466ad16ee tempest-AttachVolumeTestJSON-1155117856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-813f563f-4836-489f-9f9d-32969c8f02a4 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:12 devstack sudo[97688]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-661f4e1c-83e6-4a55-a02e-b568d7ca65e9 tempest-VolumesNegativeTest-48208343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f34fe795-881d-43f1-8567-20ee39a71e3e" returned: 0 in 0.746s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:12 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-661f4e1c-83e6-4a55-a02e-b568d7ca65e9 tempest-VolumesNegativeTest-48208343 None] <== create_volume: return (1858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:46:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-661f4e1c-83e6-4a55-a02e-b568d7ca65e9 tempest-VolumesNegativeTest-48208343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.861s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-efe14cc7-a4de-4554-982a-5d12da053d6c tempest-VolumesSnapshotListTestJSON-1075097727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.305s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:12 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-661f4e1c-83e6-4a55-a02e-b568d7ca65e9 tempest-VolumesNegativeTest-48208343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (302271ca-4225-43ba-9ee0-125c008e2518) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f34fe795-881d-43f1-8567-20ee39a71e3e', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:12 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-661f4e1c-83e6-4a55-a02e-b568d7ca65e9 tempest-VolumesNegativeTest-48208343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (866fd063-43f0-4f5a-9705-3105f2a842df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:12 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-efe14cc7-a4de-4554-982a-5d12da053d6c tempest-VolumesSnapshotListTestJSON-1075097727 None] Creating offline snapshot 88b90af9-8239-443c-b84f-1cda88580c6b of volume 459ef838-0d55-4822-acaa-5ccfbbf73696 {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:46:12 devstack sudo[97691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-813f563f-4836-489f-9f9d-32969c8f02a4 Jul 10 06:46:12 devstack sudo[97691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:12 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-661f4e1c-83e6-4a55-a02e-b568d7ca65e9 tempest-VolumesNegativeTest-48208343 None] Volume volume-f34fe795-881d-43f1-8567-20ee39a71e3e (f34fe795-881d-43f1-8567-20ee39a71e3e): created successfully Jul 10 06:46:12 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-661f4e1c-83e6-4a55-a02e-b568d7ca65e9 tempest-VolumesNegativeTest-48208343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (866fd063-43f0-4f5a-9705-3105f2a842df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:12 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-661f4e1c-83e6-4a55-a02e-b568d7ca65e9 tempest-VolumesNegativeTest-48208343 None] Flow 'volume_create_manager' (a32612cd-68f8-4b9e-b09d-b65ed48012b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:46:12 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9679127-295d-4217-a948-49f0c1636bb3]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-efe14cc7-a4de-4554-982a-5d12da053d6c tempest-VolumesSnapshotListTestJSON-1075097727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.eb4682d1-ef04-408c-b397-77f399b2f43b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:12 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-661f4e1c-83e6-4a55-a02e-b568d7ca65e9 tempest-VolumesNegativeTest-48208343 None] Created volume successfully. Jul 10 06:46:12 devstack sudo[97693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.eb4682d1-ef04-408c-b397-77f399b2f43b Jul 10 06:46:12 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:13 devstack sudo[97691]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-25f4120f-5b81-45c9-a78a-4b7466ad16ee tempest-AttachVolumeTestJSON-1155117856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-813f563f-4836-489f-9f9d-32969c8f02a4" returned: 0 in 0.881s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-25f4120f-5b81-45c9-a78a-4b7466ad16ee tempest-AttachVolumeTestJSON-1155117856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-813f563f-4836-489f-9f9d-32969c8f02a4 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:13 devstack sudo[97701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-813f563f-4836-489f-9f9d-32969c8f02a4 Jul 10 06:46:13 devstack sudo[97701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:13 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-efe14cc7-a4de-4554-982a-5d12da053d6c tempest-VolumesSnapshotListTestJSON-1075097727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.eb4682d1-ef04-408c-b397-77f399b2f43b" returned: 0 in 0.890s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:13 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-efe14cc7-a4de-4554-982a-5d12da053d6c tempest-VolumesSnapshotListTestJSON-1075097727 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-459ef838-0d55-4822-acaa-5ccfbbf73696(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:46:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-efe14cc7-a4de-4554-982a-5d12da053d6c tempest-VolumesSnapshotListTestJSON-1075097727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.eb4682d1-ef04-408c-b397-77f399b2f43b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.88b90af9-8239-443c-b84f-1cda88580c6b 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:13 devstack sudo[97704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.eb4682d1-ef04-408c-b397-77f399b2f43b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.88b90af9-8239-443c-b84f-1cda88580c6b 1G Jul 10 06:46:13 devstack sudo[97704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:13 devstack sudo[97701]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-25f4120f-5b81-45c9-a78a-4b7466ad16ee tempest-AttachVolumeTestJSON-1155117856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-813f563f-4836-489f-9f9d-32969c8f02a4" returned: 0 in 0.817s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:13 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-25f4120f-5b81-45c9-a78a-4b7466ad16ee tempest-AttachVolumeTestJSON-1155117856 None] Lock "cinder-quobyte-813f563f-4836-489f-9f9d-32969c8f02a4" released by "delete_volume" :: held 1.775s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:13 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-25f4120f-5b81-45c9-a78a-4b7466ad16ee tempest-AttachVolumeTestJSON-1155117856 None] Created reservations ['a4f6ab30-c164-4739-ae8e-06763062de86', 'b58dea70-b57d-4d3c-b9c0-e0ed3d64995b', 'a74a3095-d87d-4a10-9924-dfc554b5cde9', 'e61d2ced-1cba-4d7e-b2b0-aec736b6d52e'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:46:14 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-617a437d-1632-4d06-8bf6-e79b9f8e3c82 tempest-TestInstancesWithCinderVolumes-177535336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:46:14 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-617a437d-1632-4d06-8bf6-e79b9f8e3c82 tempest-TestInstancesWithCinderVolumes-177535336 None] Flow 'volume_create_manager' (6fc683a0-09f5-4cdd-986a-388c11fcf1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:46:14 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-617a437d-1632-4d06-8bf6-e79b9f8e3c82 tempest-TestInstancesWithCinderVolumes-177535336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b5ca8d8-0377-4f96-b819-4dd109a370e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:14 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-617a437d-1632-4d06-8bf6-e79b9f8e3c82 tempest-TestInstancesWithCinderVolumes-177535336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b5ca8d8-0377-4f96-b819-4dd109a370e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-301848622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=653c787e-bd21-4fd0-abd9-4de9209cfe7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='764c282aa53f4c869b3d9ba7becf3733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:46:14Z,use_quota=True,user_id='a670d569079a4d9d90a29dee7b429a1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb219bbb-b164-49da-859f-eb45635a7321),volume_type_id=fb219bbb-b164-49da-859f-eb45635a7321)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:14 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-617a437d-1632-4d06-8bf6-e79b9f8e3c82 tempest-TestInstancesWithCinderVolumes-177535336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c60a749a-759d-4aee-98eb-352753091b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:14 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-617a437d-1632-4d06-8bf6-e79b9f8e3c82 tempest-TestInstancesWithCinderVolumes-177535336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c60a749a-759d-4aee-98eb-352753091b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:14 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-617a437d-1632-4d06-8bf6-e79b9f8e3c82 tempest-TestInstancesWithCinderVolumes-177535336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1e507b3-681e-4556-8d6d-c28c431316c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:14 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-617a437d-1632-4d06-8bf6-e79b9f8e3c82 tempest-TestInstancesWithCinderVolumes-177535336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1e507b3-681e-4556-8d6d-c28c431316c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '653c787e-bd21-4fd0-abd9-4de9209cfe7a', 'volume_name': 'volume-653c787e-bd21-4fd0-abd9-4de9209cfe7a', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:14 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-617a437d-1632-4d06-8bf6-e79b9f8e3c82 tempest-TestInstancesWithCinderVolumes-177535336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c0e257d-a410-4492-9bbb-8ba67f407abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:14 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-617a437d-1632-4d06-8bf6-e79b9f8e3c82 tempest-TestInstancesWithCinderVolumes-177535336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c0e257d-a410-4492-9bbb-8ba67f407abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:14 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-617a437d-1632-4d06-8bf6-e79b9f8e3c82 tempest-TestInstancesWithCinderVolumes-177535336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f38c5a8-d8d4-447f-94fc-8f4831454aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:14 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-617a437d-1632-4d06-8bf6-e79b9f8e3c82 tempest-TestInstancesWithCinderVolumes-177535336 None] Volume 653c787e-bd21-4fd0-abd9-4de9209cfe7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-653c787e-bd21-4fd0-abd9-4de9209cfe7a', 'volume_size': 1} Jul 10 06:46:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-617a437d-1632-4d06-8bf6-e79b9f8e3c82 tempest-TestInstancesWithCinderVolumes-177535336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-25f4120f-5b81-45c9-a78a-4b7466ad16ee tempest-AttachVolumeTestJSON-1155117856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-25f4120f-5b81-45c9-a78a-4b7466ad16ee tempest-AttachVolumeTestJSON-1155117856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:14 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-25f4120f-5b81-45c9-a78a-4b7466ad16ee tempest-AttachVolumeTestJSON-1155117856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:46:14 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-25f4120f-5b81-45c9-a78a-4b7466ad16ee tempest-AttachVolumeTestJSON-1155117856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:46:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-25f4120f-5b81-45c9-a78a-4b7466ad16ee tempest-AttachVolumeTestJSON-1155117856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-25f4120f-5b81-45c9-a78a-4b7466ad16ee tempest-AttachVolumeTestJSON-1155117856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:14 devstack sudo[97714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:46:14 devstack sudo[97714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:14 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-0129f31d-0006-4652-ac01-e6a3a13828e6 tempest-AttachVolumeTestJSON-1155117856 None] Acquiring lock "cinder-783a9ec5-ae87-4fc3-a758-283c172ee2ee-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:14 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-0129f31d-0006-4652-ac01-e6a3a13828e6 tempest-AttachVolumeTestJSON-1155117856 None] Lock "cinder-783a9ec5-ae87-4fc3-a758-283c172ee2ee-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:14 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-0129f31d-0006-4652-ac01-e6a3a13828e6 tempest-AttachVolumeTestJSON-1155117856 None] Acquiring lock "cinder-quobyte-783a9ec5-ae87-4fc3-a758-283c172ee2ee" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:14 devstack sudo[97704]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:14 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-0129f31d-0006-4652-ac01-e6a3a13828e6 tempest-AttachVolumeTestJSON-1155117856 None] Lock "cinder-quobyte-783a9ec5-ae87-4fc3-a758-283c172ee2ee" acquired by "delete_volume" :: waited 0.023s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-efe14cc7-a4de-4554-982a-5d12da053d6c tempest-VolumesSnapshotListTestJSON-1075097727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.eb4682d1-ef04-408c-b397-77f399b2f43b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.88b90af9-8239-443c-b84f-1cda88580c6b 1G" returned: 0 in 1.373s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-efe14cc7-a4de-4554-982a-5d12da053d6c tempest-VolumesSnapshotListTestJSON-1075097727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-459ef838-0d55-4822-acaa-5ccfbbf73696.eb4682d1-ef04-408c-b397-77f399b2f43b -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.88b90af9-8239-443c-b84f-1cda88580c6b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:14 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f78f9f7-6be0-4598-be53-1d4f32d25080]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0129f31d-0006-4652-ac01-e6a3a13828e6 tempest-AttachVolumeTestJSON-1155117856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-783a9ec5-ae87-4fc3-a758-283c172ee2ee {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:14 devstack sudo[97716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-459ef838-0d55-4822-acaa-5ccfbbf73696.eb4682d1-ef04-408c-b397-77f399b2f43b -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.88b90af9-8239-443c-b84f-1cda88580c6b Jul 10 06:46:14 devstack sudo[97716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:14 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1924408-cbc6-4aa2-96e3-f308163f2252 tempest-TestInstancesWithCinderVolumes-177535336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:46:14 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e1924408-cbc6-4aa2-96e3-f308163f2252 tempest-TestInstancesWithCinderVolumes-177535336 None] Flow 'volume_create_manager' (558af951-513f-4680-a24f-793c35b99c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:46:14 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e1924408-cbc6-4aa2-96e3-f308163f2252 tempest-TestInstancesWithCinderVolumes-177535336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e2632d2-eeeb-4979-a752-cf410365cc50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:14 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e1924408-cbc6-4aa2-96e3-f308163f2252 tempest-TestInstancesWithCinderVolumes-177535336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e2632d2-eeeb-4979-a752-cf410365cc50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-747280297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8648d0c6-b3a5-4173-a859-20e7c84dc0a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='764c282aa53f4c869b3d9ba7becf3733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:46:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:46:15Z,use_quota=True,user_id='a670d569079a4d9d90a29dee7b429a1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(551208fa-323d-437e-89d4-9064a4dd4cad),volume_type_id=551208fa-323d-437e-89d4-9064a4dd4cad)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:14 devstack sudo[97717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-783a9ec5-ae87-4fc3-a758-283c172ee2ee Jul 10 06:46:14 devstack sudo[97717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:14 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e1924408-cbc6-4aa2-96e3-f308163f2252 tempest-TestInstancesWithCinderVolumes-177535336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fdab540-5426-4e9f-90cd-a012ab67a22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:14 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e1924408-cbc6-4aa2-96e3-f308163f2252 tempest-TestInstancesWithCinderVolumes-177535336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fdab540-5426-4e9f-90cd-a012ab67a22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:14 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e1924408-cbc6-4aa2-96e3-f308163f2252 tempest-TestInstancesWithCinderVolumes-177535336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a2537fe-b0f5-4699-892e-2edb7fd9fef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:14 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e1924408-cbc6-4aa2-96e3-f308163f2252 tempest-TestInstancesWithCinderVolumes-177535336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a2537fe-b0f5-4699-892e-2edb7fd9fef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8648d0c6-b3a5-4173-a859-20e7c84dc0a5', 'volume_name': 'volume-8648d0c6-b3a5-4173-a859-20e7c84dc0a5', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:14 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e1924408-cbc6-4aa2-96e3-f308163f2252 tempest-TestInstancesWithCinderVolumes-177535336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1223f6bd-5175-41db-ba21-2c10e3c4a080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:14 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e1924408-cbc6-4aa2-96e3-f308163f2252 tempest-TestInstancesWithCinderVolumes-177535336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1223f6bd-5175-41db-ba21-2c10e3c4a080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:14 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e1924408-cbc6-4aa2-96e3-f308163f2252 tempest-TestInstancesWithCinderVolumes-177535336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe8e07c7-8705-4e65-a258-2922be299249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:14 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-e1924408-cbc6-4aa2-96e3-f308163f2252 tempest-TestInstancesWithCinderVolumes-177535336 None] Volume 8648d0c6-b3a5-4173-a859-20e7c84dc0a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8648d0c6-b3a5-4173-a859-20e7c84dc0a5', 'volume_size': 1} Jul 10 06:46:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e1924408-cbc6-4aa2-96e3-f308163f2252 tempest-TestInstancesWithCinderVolumes-177535336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:15 devstack sudo[97714]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-25f4120f-5b81-45c9-a78a-4b7466ad16ee tempest-AttachVolumeTestJSON-1155117856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.029s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:15 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-25f4120f-5b81-45c9-a78a-4b7466ad16ee tempest-AttachVolumeTestJSON-1155117856 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:46:15 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-25f4120f-5b81-45c9-a78a-4b7466ad16ee tempest-AttachVolumeTestJSON-1155117856 None] Deleted volume successfully. Jul 10 06:46:15 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-25f4120f-5b81-45c9-a78a-4b7466ad16ee tempest-AttachVolumeTestJSON-1155117856 None] Lock "cinder-813f563f-4836-489f-9f9d-32969c8f02a4-delete_volume" released by "delete_volume" :: held 3.296s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:15 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:46:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Flow 'volume_create_manager' (d8a98fc2-a3d8-40f2-9907-556e74167f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:46:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cfbe957-8054-4384-8078-7519b5b3c505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cfbe957-8054-4384-8078-7519b5b3c505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1299099804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0980f2aa-516f-40a7-8d8f-f0547bb4a8d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='764c282aa53f4c869b3d9ba7becf3733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:46:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:46:16Z,use_quota=True,user_id='a670d569079a4d9d90a29dee7b429a1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c099cb-710e-42fe-b3c2-8c40c585a82f),volume_type_id=75c099cb-710e-42fe-b3c2-8c40c585a82f)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:15 devstack sudo[97717]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cd808aa-d3a8-4bbd-9224-c96b7a66d649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cd808aa-d3a8-4bbd-9224-c96b7a66d649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c49efd78-6628-4c24-b72d-48e91be51b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:15 devstack cinder-volume[87294]: DEBUG cinder.image.glance [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Creating Keystone auth plugin from conf {{(pid=87294) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 06:46:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0129f31d-0006-4652-ac01-e6a3a13828e6 tempest-AttachVolumeTestJSON-1155117856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-783a9ec5-ae87-4fc3-a758-283c172ee2ee" returned: 0 in 1.049s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0129f31d-0006-4652-ac01-e6a3a13828e6 tempest-AttachVolumeTestJSON-1155117856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-783a9ec5-ae87-4fc3-a758-283c172ee2ee {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:15 devstack sudo[97727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-783a9ec5-ae87-4fc3-a758-283c172ee2ee Jul 10 06:46:15 devstack sudo[97727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:15 devstack sudo[97716]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-efe14cc7-a4de-4554-982a-5d12da053d6c tempest-VolumesSnapshotListTestJSON-1075097727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-459ef838-0d55-4822-acaa-5ccfbbf73696.eb4682d1-ef04-408c-b397-77f399b2f43b -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.88b90af9-8239-443c-b84f-1cda88580c6b" returned: 0 in 1.146s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:15 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-efe14cc7-a4de-4554-982a-5d12da053d6c tempest-VolumesSnapshotListTestJSON-1075097727 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.88b90af9-8239-443c-b84f-1cda88580c6b is being set with open permissions: ugo+rw Jul 10 06:46:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-efe14cc7-a4de-4554-982a-5d12da053d6c tempest-VolumesSnapshotListTestJSON-1075097727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.88b90af9-8239-443c-b84f-1cda88580c6b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:15 devstack sudo[97729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.88b90af9-8239-443c-b84f-1cda88580c6b Jul 10 06:46:15 devstack sudo[97729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c49efd78-6628-4c24-b72d-48e91be51b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0980f2aa-516f-40a7-8d8f-f0547bb4a8d5', 'volume_name': 'volume-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5', 'volume_size': 1, 'image_id': 'e2eebdb6-90f1-46d6-90c1-ab2692fd22e5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2eebdb6-90f1-46d6-90c1-ab2692fd22e5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1334229454', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '764c282aa53f4c869b3d9ba7becf3733', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e2eebdb6-90f1-46d6-90c1-ab2692fd22e5', 'created_at': datetime.datetime(2026, 7, 10, 4, 46, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 46, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2eebdb6-90f1-46d6-90c1-ab2692fd22e5/file', 'properties': {}}, 'image_service': }' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dcb5be8-6026-4d6c-8ba8-8d6fbab302de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dcb5be8-6026-4d6c-8ba8-8d6fbab302de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b9f2194-6820-4dab-90b9-93efd32a2bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:15 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Volume 0980f2aa-516f-40a7-8d8f-f0547bb4a8d5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5', 'volume_size': 1, 'image_id': 'e2eebdb6-90f1-46d6-90c1-ab2692fd22e5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2eebdb6-90f1-46d6-90c1-ab2692fd22e5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1334229454', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '764c282aa53f4c869b3d9ba7becf3733', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e2eebdb6-90f1-46d6-90c1-ab2692fd22e5', 'created_at': datetime.datetime(2026, 7, 10, 4, 46, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 46, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2eebdb6-90f1-46d6-90c1-ab2692fd22e5/file', 'properties': {}}, 'image_service': } Jul 10 06:46:15 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Trying to clone 0980f2aa-516f-40a7-8d8f-f0547bb4a8d5 from image e2eebdb6-90f1-46d6-90c1-ab2692fd22e5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e2eebdb6-90f1-46d6-90c1-ab2692fd22e5', 'metadata': {}}]). {{(pid=87294) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 06:46:16 devstack sudo[97727]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0129f31d-0006-4652-ac01-e6a3a13828e6 tempest-AttachVolumeTestJSON-1155117856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-783a9ec5-ae87-4fc3-a758-283c172ee2ee" returned: 0 in 0.716s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:16 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-0129f31d-0006-4652-ac01-e6a3a13828e6 tempest-AttachVolumeTestJSON-1155117856 None] Lock "cinder-quobyte-783a9ec5-ae87-4fc3-a758-283c172ee2ee" released by "delete_volume" :: held 1.829s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:16 devstack sudo[97729]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-efe14cc7-a4de-4554-982a-5d12da053d6c tempest-VolumesSnapshotListTestJSON-1075097727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.88b90af9-8239-443c-b84f-1cda88580c6b" returned: 0 in 0.709s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-efe14cc7-a4de-4554-982a-5d12da053d6c tempest-VolumesSnapshotListTestJSON-1075097727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.304s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-617a437d-1632-4d06-8bf6-e79b9f8e3c82 tempest-TestInstancesWithCinderVolumes-177535336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.298s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:16 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-617a437d-1632-4d06-8bf6-e79b9f8e3c82 tempest-TestInstancesWithCinderVolumes-177535336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-301848622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=653c787e-bd21-4fd0-abd9-4de9209cfe7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='764c282aa53f4c869b3d9ba7becf3733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:46:14Z,use_quota=True,user_id='a670d569079a4d9d90a29dee7b429a1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb219bbb-b164-49da-859f-eb45635a7321),volume_type_id=fb219bbb-b164-49da-859f-eb45635a7321)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:46:16 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-617a437d-1632-4d06-8bf6-e79b9f8e3c82 tempest-TestInstancesWithCinderVolumes-177535336 None] Creating volume 653c787e-bd21-4fd0-abd9-4de9209cfe7a {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:46:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-617a437d-1632-4d06-8bf6-e79b9f8e3c82 tempest-TestInstancesWithCinderVolumes-177535336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-617a437d-1632-4d06-8bf6-e79b9f8e3c82 tempest-TestInstancesWithCinderVolumes-177535336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:16 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-617a437d-1632-4d06-8bf6-e79b9f8e3c82 tempest-TestInstancesWithCinderVolumes-177535336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:46:16 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-617a437d-1632-4d06-8bf6-e79b9f8e3c82 tempest-TestInstancesWithCinderVolumes-177535336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:46:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-617a437d-1632-4d06-8bf6-e79b9f8e3c82 tempest-TestInstancesWithCinderVolumes-177535336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:16 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-617a437d-1632-4d06-8bf6-e79b9f8e3c82 tempest-TestInstancesWithCinderVolumes-177535336 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:46:16 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-617a437d-1632-4d06-8bf6-e79b9f8e3c82 tempest-TestInstancesWithCinderVolumes-177535336 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:46:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-617a437d-1632-4d06-8bf6-e79b9f8e3c82 tempest-TestInstancesWithCinderVolumes-177535336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-653c787e-bd21-4fd0-abd9-4de9209cfe7a 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:16 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-0129f31d-0006-4652-ac01-e6a3a13828e6 tempest-AttachVolumeTestJSON-1155117856 None] Created reservations ['cf9d72d3-597b-4aa6-ad79-eded062e8b1c', '49ff02e8-0791-4ed1-8d44-7198d66026a8', '2d4a5468-a8ac-441a-ace4-a837645e30b3', '07c23e42-c16d-4643-9bf8-acadfa5b15f9'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:46:16 devstack sudo[97733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-653c787e-bd21-4fd0-abd9-4de9209cfe7a 1073741824 Jul 10 06:46:16 devstack sudo[97733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:16 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-efe14cc7-a4de-4554-982a-5d12da053d6c tempest-VolumesSnapshotListTestJSON-1075097727 None] Create snapshot completed successfully Jul 10 06:46:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-0129f31d-0006-4652-ac01-e6a3a13828e6 tempest-AttachVolumeTestJSON-1155117856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-0129f31d-0006-4652-ac01-e6a3a13828e6 tempest-AttachVolumeTestJSON-1155117856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:16 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-0129f31d-0006-4652-ac01-e6a3a13828e6 tempest-AttachVolumeTestJSON-1155117856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:46:16 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-0129f31d-0006-4652-ac01-e6a3a13828e6 tempest-AttachVolumeTestJSON-1155117856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:46:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-0129f31d-0006-4652-ac01-e6a3a13828e6 tempest-AttachVolumeTestJSON-1155117856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0129f31d-0006-4652-ac01-e6a3a13828e6 tempest-AttachVolumeTestJSON-1155117856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:16 devstack sudo[97735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:46:16 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:16 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-520693f5-e251-4fcf-9f39-24c5656ea9f5 tempest-AttachVolumeTestJSON-1155117856 None] Acquiring lock "cinder-59f78cb8-a2d0-427f-ab1b-3883e220fbd5-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:17 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-520693f5-e251-4fcf-9f39-24c5656ea9f5 tempest-AttachVolumeTestJSON-1155117856 None] Lock "cinder-59f78cb8-a2d0-427f-ab1b-3883e220fbd5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:17 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-520693f5-e251-4fcf-9f39-24c5656ea9f5 tempest-AttachVolumeTestJSON-1155117856 None] Acquiring lock "cinder-quobyte-59f78cb8-a2d0-427f-ab1b-3883e220fbd5" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:17 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-520693f5-e251-4fcf-9f39-24c5656ea9f5 tempest-AttachVolumeTestJSON-1155117856 None] Lock "cinder-quobyte-59f78cb8-a2d0-427f-ab1b-3883e220fbd5" acquired by "delete_volume" :: waited 0.029s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:17 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f3e193-2160-4509-b094-243f3e6713ac]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-520693f5-e251-4fcf-9f39-24c5656ea9f5 tempest-AttachVolumeTestJSON-1155117856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-59f78cb8-a2d0-427f-ab1b-3883e220fbd5 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:17 devstack sudo[97737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-59f78cb8-a2d0-427f-ab1b-3883e220fbd5 Jul 10 06:46:17 devstack sudo[97737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5df379f0-521c-4e85-b9e5-f100a92dea95 tempest-VolumesSnapshotListTestJSON-1075097727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:17 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0129f31d-0006-4652-ac01-e6a3a13828e6 tempest-AttachVolumeTestJSON-1155117856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.091s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:17 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-0129f31d-0006-4652-ac01-e6a3a13828e6 tempest-AttachVolumeTestJSON-1155117856 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:46:17 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-0129f31d-0006-4652-ac01-e6a3a13828e6 tempest-AttachVolumeTestJSON-1155117856 None] Deleted volume successfully. Jul 10 06:46:17 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-0129f31d-0006-4652-ac01-e6a3a13828e6 tempest-AttachVolumeTestJSON-1155117856 None] Lock "cinder-783a9ec5-ae87-4fc3-a758-283c172ee2ee-delete_volume" released by "delete_volume" :: held 3.302s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:17 devstack sudo[97733]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-617a437d-1632-4d06-8bf6-e79b9f8e3c82 tempest-TestInstancesWithCinderVolumes-177535336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-653c787e-bd21-4fd0-abd9-4de9209cfe7a 1073741824" returned: 0 in 1.326s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-617a437d-1632-4d06-8bf6-e79b9f8e3c82 tempest-TestInstancesWithCinderVolumes-177535336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-653c787e-bd21-4fd0-abd9-4de9209cfe7a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:17 devstack sudo[97779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-653c787e-bd21-4fd0-abd9-4de9209cfe7a Jul 10 06:46:17 devstack sudo[97779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:18 devstack sudo[97737]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-520693f5-e251-4fcf-9f39-24c5656ea9f5 tempest-AttachVolumeTestJSON-1155117856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-59f78cb8-a2d0-427f-ab1b-3883e220fbd5" returned: 0 in 1.190s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-520693f5-e251-4fcf-9f39-24c5656ea9f5 tempest-AttachVolumeTestJSON-1155117856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-59f78cb8-a2d0-427f-ab1b-3883e220fbd5 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:18 devstack sudo[97784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-59f78cb8-a2d0-427f-ab1b-3883e220fbd5 Jul 10 06:46:18 devstack sudo[97784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:18 devstack sudo[97779]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-617a437d-1632-4d06-8bf6-e79b9f8e3c82 tempest-TestInstancesWithCinderVolumes-177535336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-653c787e-bd21-4fd0-abd9-4de9209cfe7a" returned: 0 in 0.679s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:18 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-617a437d-1632-4d06-8bf6-e79b9f8e3c82 tempest-TestInstancesWithCinderVolumes-177535336 None] <== create_volume: return (2060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:46:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-617a437d-1632-4d06-8bf6-e79b9f8e3c82 tempest-TestInstancesWithCinderVolumes-177535336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.063s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e1924408-cbc6-4aa2-96e3-f308163f2252 tempest-TestInstancesWithCinderVolumes-177535336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.739s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:18 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-e1924408-cbc6-4aa2-96e3-f308163f2252 tempest-TestInstancesWithCinderVolumes-177535336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-747280297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8648d0c6-b3a5-4173-a859-20e7c84dc0a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='764c282aa53f4c869b3d9ba7becf3733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:46:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:46:15Z,use_quota=True,user_id='a670d569079a4d9d90a29dee7b429a1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(551208fa-323d-437e-89d4-9064a4dd4cad),volume_type_id=551208fa-323d-437e-89d4-9064a4dd4cad)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:46:18 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-e1924408-cbc6-4aa2-96e3-f308163f2252 tempest-TestInstancesWithCinderVolumes-177535336 None] Creating volume 8648d0c6-b3a5-4173-a859-20e7c84dc0a5 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:46:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e1924408-cbc6-4aa2-96e3-f308163f2252 tempest-TestInstancesWithCinderVolumes-177535336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e1924408-cbc6-4aa2-96e3-f308163f2252 tempest-TestInstancesWithCinderVolumes-177535336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:18 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-e1924408-cbc6-4aa2-96e3-f308163f2252 tempest-TestInstancesWithCinderVolumes-177535336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:46:18 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-e1924408-cbc6-4aa2-96e3-f308163f2252 tempest-TestInstancesWithCinderVolumes-177535336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:46:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e1924408-cbc6-4aa2-96e3-f308163f2252 tempest-TestInstancesWithCinderVolumes-177535336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:18 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-e1924408-cbc6-4aa2-96e3-f308163f2252 tempest-TestInstancesWithCinderVolumes-177535336 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:46:18 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-e1924408-cbc6-4aa2-96e3-f308163f2252 tempest-TestInstancesWithCinderVolumes-177535336 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:46:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e1924408-cbc6-4aa2-96e3-f308163f2252 tempest-TestInstancesWithCinderVolumes-177535336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8648d0c6-b3a5-4173-a859-20e7c84dc0a5 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-617a437d-1632-4d06-8bf6-e79b9f8e3c82 tempest-TestInstancesWithCinderVolumes-177535336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f38c5a8-d8d4-447f-94fc-8f4831454aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-653c787e-bd21-4fd0-abd9-4de9209cfe7a', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-617a437d-1632-4d06-8bf6-e79b9f8e3c82 tempest-TestInstancesWithCinderVolumes-177535336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (152e9765-1cd1-46eb-aef6-42a46a4a94b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:18 devstack sudo[97787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8648d0c6-b3a5-4173-a859-20e7c84dc0a5 1073741824 Jul 10 06:46:18 devstack sudo[97787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:18 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-617a437d-1632-4d06-8bf6-e79b9f8e3c82 tempest-TestInstancesWithCinderVolumes-177535336 None] Volume volume-653c787e-bd21-4fd0-abd9-4de9209cfe7a (653c787e-bd21-4fd0-abd9-4de9209cfe7a): created successfully Jul 10 06:46:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-617a437d-1632-4d06-8bf6-e79b9f8e3c82 tempest-TestInstancesWithCinderVolumes-177535336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (152e9765-1cd1-46eb-aef6-42a46a4a94b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-617a437d-1632-4d06-8bf6-e79b9f8e3c82 tempest-TestInstancesWithCinderVolumes-177535336 None] Flow 'volume_create_manager' (6fc683a0-09f5-4cdd-986a-388c11fcf1a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:46:18 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-617a437d-1632-4d06-8bf6-e79b9f8e3c82 tempest-TestInstancesWithCinderVolumes-177535336 None] Created volume successfully. Jul 10 06:46:19 devstack sudo[97784]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-520693f5-e251-4fcf-9f39-24c5656ea9f5 tempest-AttachVolumeTestJSON-1155117856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-59f78cb8-a2d0-427f-ab1b-3883e220fbd5" returned: 0 in 0.763s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:19 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-520693f5-e251-4fcf-9f39-24c5656ea9f5 tempest-AttachVolumeTestJSON-1155117856 None] Lock "cinder-quobyte-59f78cb8-a2d0-427f-ab1b-3883e220fbd5" released by "delete_volume" :: held 2.006s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:19 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-520693f5-e251-4fcf-9f39-24c5656ea9f5 tempest-AttachVolumeTestJSON-1155117856 None] Created reservations ['1b8c6f53-5008-4c8b-9805-bc1f0b8ecd0e', '07d606b4-9711-4e34-a7be-2de68d17b1ab', 'a387b2d5-dd95-410c-a58f-8a180481db6b', '90841a36-c7f1-4da7-8c4e-2e8d2b6fb07a'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:46:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-520693f5-e251-4fcf-9f39-24c5656ea9f5 tempest-AttachVolumeTestJSON-1155117856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-520693f5-e251-4fcf-9f39-24c5656ea9f5 tempest-AttachVolumeTestJSON-1155117856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:19 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-520693f5-e251-4fcf-9f39-24c5656ea9f5 tempest-AttachVolumeTestJSON-1155117856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:46:19 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-520693f5-e251-4fcf-9f39-24c5656ea9f5 tempest-AttachVolumeTestJSON-1155117856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:46:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-520693f5-e251-4fcf-9f39-24c5656ea9f5 tempest-AttachVolumeTestJSON-1155117856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-520693f5-e251-4fcf-9f39-24c5656ea9f5 tempest-AttachVolumeTestJSON-1155117856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:19 devstack sudo[97793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:46:19 devstack sudo[97793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:19 devstack sudo[97787]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e1924408-cbc6-4aa2-96e3-f308163f2252 tempest-TestInstancesWithCinderVolumes-177535336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8648d0c6-b3a5-4173-a859-20e7c84dc0a5 1073741824" returned: 0 in 0.983s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e1924408-cbc6-4aa2-96e3-f308163f2252 tempest-TestInstancesWithCinderVolumes-177535336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8648d0c6-b3a5-4173-a859-20e7c84dc0a5 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:19 devstack sudo[97797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8648d0c6-b3a5-4173-a859-20e7c84dc0a5 Jul 10 06:46:19 devstack sudo[97797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:20 devstack sudo[97793]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-520693f5-e251-4fcf-9f39-24c5656ea9f5 tempest-AttachVolumeTestJSON-1155117856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.929s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:20 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-520693f5-e251-4fcf-9f39-24c5656ea9f5 tempest-AttachVolumeTestJSON-1155117856 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:46:20 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-520693f5-e251-4fcf-9f39-24c5656ea9f5 tempest-AttachVolumeTestJSON-1155117856 None] Deleted volume successfully. Jul 10 06:46:20 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-520693f5-e251-4fcf-9f39-24c5656ea9f5 tempest-AttachVolumeTestJSON-1155117856 None] Lock "cinder-59f78cb8-a2d0-427f-ab1b-3883e220fbd5-delete_volume" released by "delete_volume" :: held 3.252s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:20 devstack sudo[97797]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e1924408-cbc6-4aa2-96e3-f308163f2252 tempest-TestInstancesWithCinderVolumes-177535336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8648d0c6-b3a5-4173-a859-20e7c84dc0a5" returned: 0 in 1.032s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:20 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-e1924408-cbc6-4aa2-96e3-f308163f2252 tempest-TestInstancesWithCinderVolumes-177535336 None] <== create_volume: return (2067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:46:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e1924408-cbc6-4aa2-96e3-f308163f2252 tempest-TestInstancesWithCinderVolumes-177535336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.070s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5df379f0-521c-4e85-b9e5-f100a92dea95 tempest-VolumesSnapshotListTestJSON-1075097727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.021s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:20 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e1924408-cbc6-4aa2-96e3-f308163f2252 tempest-TestInstancesWithCinderVolumes-177535336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe8e07c7-8705-4e65-a258-2922be299249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8648d0c6-b3a5-4173-a859-20e7c84dc0a5', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:20 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e1924408-cbc6-4aa2-96e3-f308163f2252 tempest-TestInstancesWithCinderVolumes-177535336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c33889a2-1e6d-428e-88bf-d468cc856e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:20 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-5df379f0-521c-4e85-b9e5-f100a92dea95 tempest-VolumesSnapshotListTestJSON-1075097727 None] Creating offline snapshot baaf2482-42b7-456a-a3a9-54f7755336a0 of volume 459ef838-0d55-4822-acaa-5ccfbbf73696 {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:46:20 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-e1924408-cbc6-4aa2-96e3-f308163f2252 tempest-TestInstancesWithCinderVolumes-177535336 None] Volume volume-8648d0c6-b3a5-4173-a859-20e7c84dc0a5 (8648d0c6-b3a5-4173-a859-20e7c84dc0a5): created successfully Jul 10 06:46:20 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e1924408-cbc6-4aa2-96e3-f308163f2252 tempest-TestInstancesWithCinderVolumes-177535336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c33889a2-1e6d-428e-88bf-d468cc856e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:20 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e1924408-cbc6-4aa2-96e3-f308163f2252 tempest-TestInstancesWithCinderVolumes-177535336 None] Flow 'volume_create_manager' (558af951-513f-4680-a24f-793c35b99c64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:46:20 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1dc7c8f-6af2-43f9-960d-ce7a469648c0]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5df379f0-521c-4e85-b9e5-f100a92dea95 tempest-VolumesSnapshotListTestJSON-1075097727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.88b90af9-8239-443c-b84f-1cda88580c6b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:20 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e2eebdb6-90f1-46d6-90c1-ab2692fd22e5_gzhwtq0zdevstack@QuobyteHD, size 20.69 MB, duration 4.87 sec {{(pid=87294) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 06:46:20 devstack cinder-volume[87294]: INFO cinder.image.image_utils [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Image download 20.69 MB at 4.25 MB/s Jul 10 06:46:20 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-e1924408-cbc6-4aa2-96e3-f308163f2252 tempest-TestInstancesWithCinderVolumes-177535336 None] Created volume successfully. Jul 10 06:46:20 devstack sudo[97803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.88b90af9-8239-443c-b84f-1cda88580c6b Jul 10 06:46:20 devstack sudo[97803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:20 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb2a586-8ef1-4ef0-bc18-8dfc9de59c88]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2eebdb6-90f1-46d6-90c1-ab2692fd22e5_gzhwtq0zdevstack@QuobyteHD {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:21 devstack sudo[97805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2eebdb6-90f1-46d6-90c1-ab2692fd22e5_gzhwtq0zdevstack@QuobyteHD Jul 10 06:46:21 devstack sudo[97805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:21 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:46:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:46:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:46:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:21 devstack sudo[97818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:46:21 devstack sudo[97818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:21 devstack sudo[97803]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5df379f0-521c-4e85-b9e5-f100a92dea95 tempest-VolumesSnapshotListTestJSON-1075097727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.88b90af9-8239-443c-b84f-1cda88580c6b" returned: 0 in 1.194s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:22 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-5df379f0-521c-4e85-b9e5-f100a92dea95 tempest-VolumesSnapshotListTestJSON-1075097727 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-459ef838-0d55-4822-acaa-5ccfbbf73696(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:46:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5df379f0-521c-4e85-b9e5-f100a92dea95 tempest-VolumesSnapshotListTestJSON-1075097727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.88b90af9-8239-443c-b84f-1cda88580c6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.baaf2482-42b7-456a-a3a9-54f7755336a0 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:22 devstack sudo[97828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.88b90af9-8239-443c-b84f-1cda88580c6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.baaf2482-42b7-456a-a3a9-54f7755336a0 1G Jul 10 06:46:22 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:22 devstack sudo[97805]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2eebdb6-90f1-46d6-90c1-ab2692fd22e5_gzhwtq0zdevstack@QuobyteHD" returned: 0 in 1.246s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:22 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Temporary image e2eebdb6-90f1-46d6-90c1-ab2692fd22e5 is fetched for user a670d569079a4d9d90a29dee7b429a1e. {{(pid=87294) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 06:46:22 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc82cffd-a743-42f2-a09f-6e5321617769]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2eebdb6-90f1-46d6-90c1-ab2692fd22e5_gzhwtq0zdevstack@QuobyteHD {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:22 devstack sudo[97833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2eebdb6-90f1-46d6-90c1-ab2692fd22e5_gzhwtq0zdevstack@QuobyteHD Jul 10 06:46:22 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:22 devstack sudo[97818]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.975s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:22 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:46:22 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager._thread_info {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:46:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread count: 28 {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:46:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread info: [<_MainThread(MainThread, started 139245706264704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:46:23 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5df379f0-521c-4e85-b9e5-f100a92dea95 tempest-VolumesSnapshotListTestJSON-1075097727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.88b90af9-8239-443c-b84f-1cda88580c6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.baaf2482-42b7-456a-a3a9-54f7755336a0 1G" returned: 0 in 1.359s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5df379f0-521c-4e85-b9e5-f100a92dea95 tempest-VolumesSnapshotListTestJSON-1075097727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-459ef838-0d55-4822-acaa-5ccfbbf73696.88b90af9-8239-443c-b84f-1cda88580c6b -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.baaf2482-42b7-456a-a3a9-54f7755336a0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:23 devstack sudo[97849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-459ef838-0d55-4822-acaa-5ccfbbf73696.88b90af9-8239-443c-b84f-1cda88580c6b -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.baaf2482-42b7-456a-a3a9-54f7755336a0 Jul 10 06:46:23 devstack sudo[97849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:23 devstack sudo[97833]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2eebdb6-90f1-46d6-90c1-ab2692fd22e5_gzhwtq0zdevstack@QuobyteHD" returned: 0 in 1.106s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:24 devstack sudo[97849]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5df379f0-521c-4e85-b9e5-f100a92dea95 tempest-VolumesSnapshotListTestJSON-1075097727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-459ef838-0d55-4822-acaa-5ccfbbf73696.88b90af9-8239-443c-b84f-1cda88580c6b -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.baaf2482-42b7-456a-a3a9-54f7755336a0" returned: 0 in 0.737s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:24 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-5df379f0-521c-4e85-b9e5-f100a92dea95 tempest-VolumesSnapshotListTestJSON-1075097727 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.baaf2482-42b7-456a-a3a9-54f7755336a0 is being set with open permissions: ugo+rw Jul 10 06:46:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5df379f0-521c-4e85-b9e5-f100a92dea95 tempest-VolumesSnapshotListTestJSON-1075097727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.baaf2482-42b7-456a-a3a9-54f7755336a0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:24 devstack sudo[97855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.baaf2482-42b7-456a-a3a9-54f7755336a0 Jul 10 06:46:24 devstack sudo[97855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:24 devstack sudo[97855]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5df379f0-521c-4e85-b9e5-f100a92dea95 tempest-VolumesSnapshotListTestJSON-1075097727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.baaf2482-42b7-456a-a3a9-54f7755336a0" returned: 0 in 0.672s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5df379f0-521c-4e85-b9e5-f100a92dea95 tempest-VolumesSnapshotListTestJSON-1075097727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.151s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.326s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:24 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1299099804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0980f2aa-516f-40a7-8d8f-f0547bb4a8d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='764c282aa53f4c869b3d9ba7becf3733',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:46:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:46:16Z,use_quota=True,user_id='a670d569079a4d9d90a29dee7b429a1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75c099cb-710e-42fe-b3c2-8c40c585a82f),volume_type_id=75c099cb-710e-42fe-b3c2-8c40c585a82f)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:46:24 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Creating volume 0980f2aa-516f-40a7-8d8f-f0547bb4a8d5 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:46:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:24 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:46:24 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:46:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:24 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:46:24 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:46:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:24 devstack sudo[97858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5 1073741824 Jul 10 06:46:24 devstack sudo[97858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:24 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-5df379f0-521c-4e85-b9e5-f100a92dea95 tempest-VolumesSnapshotListTestJSON-1075097727 None] Create snapshot completed successfully Jul 10 06:46:25 devstack sudo[97858]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5 1073741824" returned: 0 in 1.149s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:26 devstack sudo[97863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5 Jul 10 06:46:26 devstack sudo[97863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:26 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b2e59054-f03d-4a8d-b3d8-d208cb9e8ebf tempest-VolumesSnapshotListTestJSON-1075097727 None] Acquiring lock "cinder-baaf2482-42b7-456a-a3a9-54f7755336a0-delete_snapshot" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:26 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b2e59054-f03d-4a8d-b3d8-d208cb9e8ebf tempest-VolumesSnapshotListTestJSON-1075097727 None] Lock "cinder-baaf2482-42b7-456a-a3a9-54f7755336a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:26 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b2e59054-f03d-4a8d-b3d8-d208cb9e8ebf tempest-VolumesSnapshotListTestJSON-1075097727 None] Acquiring lock "cinder-quobyte-459ef838-0d55-4822-acaa-5ccfbbf73696" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:26 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b2e59054-f03d-4a8d-b3d8-d208cb9e8ebf tempest-VolumesSnapshotListTestJSON-1075097727 None] Lock "cinder-quobyte-459ef838-0d55-4822-acaa-5ccfbbf73696" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:26 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b2e59054-f03d-4a8d-b3d8-d208cb9e8ebf tempest-VolumesSnapshotListTestJSON-1075097727 None] Acquiring lock "cinder-quobyte-baaf2482-42b7-456a-a3a9-54f7755336a0" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:26 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b2e59054-f03d-4a8d-b3d8-d208cb9e8ebf tempest-VolumesSnapshotListTestJSON-1075097727 None] Lock "cinder-quobyte-baaf2482-42b7-456a-a3a9-54f7755336a0" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:26 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-b2e59054-f03d-4a8d-b3d8-d208cb9e8ebf tempest-VolumesSnapshotListTestJSON-1075097727 None] Deleting offline snapshot baaf2482-42b7-456a-a3a9-54f7755336a0 of volume 459ef838-0d55-4822-acaa-5ccfbbf73696 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:46:26 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-b2e59054-f03d-4a8d-b3d8-d208cb9e8ebf tempest-VolumesSnapshotListTestJSON-1075097727 None] snapshot_file for this snap is: volume-459ef838-0d55-4822-acaa-5ccfbbf73696.baaf2482-42b7-456a-a3a9-54f7755336a0 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:46:26 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[b900c7cc-3959-4744-9e6a-ba89e498b29a]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b2e59054-f03d-4a8d-b3d8-d208cb9e8ebf tempest-VolumesSnapshotListTestJSON-1075097727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.baaf2482-42b7-456a-a3a9-54f7755336a0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:26 devstack sudo[97866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.baaf2482-42b7-456a-a3a9-54f7755336a0 Jul 10 06:46:26 devstack sudo[97866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:27 devstack sudo[97863]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5" returned: 0 in 1.097s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:27 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] <== create_volume: return (2290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:46:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.293s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:27 devstack cinder-volume[87294]: DEBUG cinder.volume.volume_utils [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Attempting download of e2eebdb6-90f1-46d6-90c1-ab2692fd22e5 ((None, [{'url': 'file:///opt/stack/data/glance/images/e2eebdb6-90f1-46d6-90c1-ab2692fd22e5', 'metadata': {}}])) to volume 0980f2aa-516f-40a7-8d8f-f0547bb4a8d5. {{(pid=87294) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 06:46:27 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[3335bdc7-7355-4d0e-8857-5655ccc8a0d1]: (4, 'raw') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2eebdb6-90f1-46d6-90c1-ab2692fd22e5_jpdig9pv {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:27 devstack sudo[97898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2eebdb6-90f1-46d6-90c1-ab2692fd22e5_jpdig9pv Jul 10 06:46:27 devstack sudo[97898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:27 devstack sudo[97866]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b2e59054-f03d-4a8d-b3d8-d208cb9e8ebf tempest-VolumesSnapshotListTestJSON-1075097727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.baaf2482-42b7-456a-a3a9-54f7755336a0" returned: 0 in 1.360s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:27 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-b2e59054-f03d-4a8d-b3d8-d208cb9e8ebf tempest-VolumesSnapshotListTestJSON-1075097727 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-459ef838-0d55-4822-acaa-5ccfbbf73696(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:46:27 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86123c5-7713-43d2-b829-4bdd86aa14aa]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b2e59054-f03d-4a8d-b3d8-d208cb9e8ebf tempest-VolumesSnapshotListTestJSON-1075097727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.88b90af9-8239-443c-b84f-1cda88580c6b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:28 devstack sudo[97916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.88b90af9-8239-443c-b84f-1cda88580c6b Jul 10 06:46:28 devstack sudo[97916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:28 devstack sudo[97898]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2eebdb6-90f1-46d6-90c1-ab2692fd22e5_jpdig9pv" returned: 0 in 1.131s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2eebdb6-90f1-46d6-90c1-ab2692fd22e5_jpdig9pv {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:28 devstack sudo[97924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2eebdb6-90f1-46d6-90c1-ab2692fd22e5_jpdig9pv Jul 10 06:46:28 devstack sudo[97924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:28 devstack sudo[97916]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b2e59054-f03d-4a8d-b3d8-d208cb9e8ebf tempest-VolumesSnapshotListTestJSON-1075097727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.88b90af9-8239-443c-b84f-1cda88580c6b" returned: 0 in 1.007s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:28 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-b2e59054-f03d-4a8d-b3d8-d208cb9e8ebf tempest-VolumesSnapshotListTestJSON-1075097727 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-459ef838-0d55-4822-acaa-5ccfbbf73696(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:46:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b2e59054-f03d-4a8d-b3d8-d208cb9e8ebf tempest-VolumesSnapshotListTestJSON-1075097727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.baaf2482-42b7-456a-a3a9-54f7755336a0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:28 devstack sudo[97948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.baaf2482-42b7-456a-a3a9-54f7755336a0 Jul 10 06:46:28 devstack sudo[97948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:29 devstack sudo[97924]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2eebdb6-90f1-46d6-90c1-ab2692fd22e5_jpdig9pv" returned: 1 in 1.151s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2eebdb6-90f1-46d6-90c1-ab2692fd22e5_jpdig9pv' failed. Not Retrying. {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:46:29 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebfc90a-d1d4-4673-850a-7e29151b7cb7]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2eebdb6-90f1-46d6-90c1-ab2692fd22e5_gzhwtq0zdevstack@QuobyteHD {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:29 devstack sudo[97953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2eebdb6-90f1-46d6-90c1-ab2692fd22e5_gzhwtq0zdevstack@QuobyteHD Jul 10 06:46:29 devstack sudo[97953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:29 devstack sudo[97948]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b2e59054-f03d-4a8d-b3d8-d208cb9e8ebf tempest-VolumesSnapshotListTestJSON-1075097727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.baaf2482-42b7-456a-a3a9-54f7755336a0" returned: 0 in 1.137s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b2e59054-f03d-4a8d-b3d8-d208cb9e8ebf tempest-VolumesSnapshotListTestJSON-1075097727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.baaf2482-42b7-456a-a3a9-54f7755336a0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:30 devstack sudo[97961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.baaf2482-42b7-456a-a3a9-54f7755336a0 Jul 10 06:46:30 devstack sudo[97961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:30 devstack sudo[97953]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e2eebdb6-90f1-46d6-90c1-ab2692fd22e5_gzhwtq0zdevstack@QuobyteHD" returned: 0 in 1.010s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:30 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] e2eebdb6-90f1-46d6-90c1-ab2692fd22e5 was qcow2, converting to raw {{(pid=87294) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 06:46:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e2eebdb6-90f1-46d6-90c1-ab2692fd22e5_gzhwtq0zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:30 devstack sudo[97968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e2eebdb6-90f1-46d6-90c1-ab2692fd22e5_gzhwtq0zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5 Jul 10 06:46:30 devstack sudo[97968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:31 devstack sudo[97961]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b2e59054-f03d-4a8d-b3d8-d208cb9e8ebf tempest-VolumesSnapshotListTestJSON-1075097727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.baaf2482-42b7-456a-a3a9-54f7755336a0" returned: 0 in 1.278s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:31 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b2e59054-f03d-4a8d-b3d8-d208cb9e8ebf tempest-VolumesSnapshotListTestJSON-1075097727 None] Lock "cinder-quobyte-baaf2482-42b7-456a-a3a9-54f7755336a0" released by "_delete_snapshot" :: held 4.994s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:31 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [req-c042b53a-3261-4389-b099-dd0fe8f9b0e5 req-80ff6236-083d-4924-aa72-572a16484342 tempest-VolumesSnapshotsTestJSON-324896323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:46:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-c042b53a-3261-4389-b099-dd0fe8f9b0e5 req-80ff6236-083d-4924-aa72-572a16484342 tempest-VolumesSnapshotsTestJSON-324896323 None] Flow 'volume_create_manager' (003ed16a-6cce-4d84-bebc-cc962c983358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:46:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-c042b53a-3261-4389-b099-dd0fe8f9b0e5 req-80ff6236-083d-4924-aa72-572a16484342 tempest-VolumesSnapshotsTestJSON-324896323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (845e3214-0c82-4da6-b56a-8954ea16078c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:31 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b2e59054-f03d-4a8d-b3d8-d208cb9e8ebf tempest-VolumesSnapshotListTestJSON-1075097727 None] Lock "cinder-quobyte-459ef838-0d55-4822-acaa-5ccfbbf73696" released by "delete_snapshot" :: held 5.071s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-c042b53a-3261-4389-b099-dd0fe8f9b0e5 req-80ff6236-083d-4924-aa72-572a16484342 tempest-VolumesSnapshotsTestJSON-324896323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (845e3214-0c82-4da6-b56a-8954ea16078c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-812195376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6201e6f5-64e8-4d76-93e3-9c5600ac4f7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf1631f9e31044b49f804d3916d65cea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:46:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:46:31Z,use_quota=True,user_id='c489df766ca14bddacdd508fa1e30340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-c042b53a-3261-4389-b099-dd0fe8f9b0e5 req-80ff6236-083d-4924-aa72-572a16484342 tempest-VolumesSnapshotsTestJSON-324896323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cff0f86-820c-40e9-8568-8cd0fcf774d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-c042b53a-3261-4389-b099-dd0fe8f9b0e5 req-80ff6236-083d-4924-aa72-572a16484342 tempest-VolumesSnapshotsTestJSON-324896323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cff0f86-820c-40e9-8568-8cd0fcf774d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-c042b53a-3261-4389-b099-dd0fe8f9b0e5 req-80ff6236-083d-4924-aa72-572a16484342 tempest-VolumesSnapshotsTestJSON-324896323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37193ef2-b27b-4ccc-9324-877b9138b3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-c042b53a-3261-4389-b099-dd0fe8f9b0e5 req-80ff6236-083d-4924-aa72-572a16484342 tempest-VolumesSnapshotsTestJSON-324896323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37193ef2-b27b-4ccc-9324-877b9138b3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6201e6f5-64e8-4d76-93e3-9c5600ac4f7d', 'volume_name': 'volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-c042b53a-3261-4389-b099-dd0fe8f9b0e5 req-80ff6236-083d-4924-aa72-572a16484342 tempest-VolumesSnapshotsTestJSON-324896323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddcb9b60-10c5-4840-85ec-bf3c93aa3696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-c042b53a-3261-4389-b099-dd0fe8f9b0e5 req-80ff6236-083d-4924-aa72-572a16484342 tempest-VolumesSnapshotsTestJSON-324896323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddcb9b60-10c5-4840-85ec-bf3c93aa3696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-c042b53a-3261-4389-b099-dd0fe8f9b0e5 req-80ff6236-083d-4924-aa72-572a16484342 tempest-VolumesSnapshotsTestJSON-324896323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b30871f-a6d6-4958-8815-1b480dbe72e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:31 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [req-c042b53a-3261-4389-b099-dd0fe8f9b0e5 req-80ff6236-083d-4924-aa72-572a16484342 tempest-VolumesSnapshotsTestJSON-324896323 None] Volume 6201e6f5-64e8-4d76-93e3-9c5600ac4f7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d', 'volume_size': 1} Jul 10 06:46:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-c042b53a-3261-4389-b099-dd0fe8f9b0e5 req-80ff6236-083d-4924-aa72-572a16484342 tempest-VolumesSnapshotsTestJSON-324896323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-c042b53a-3261-4389-b099-dd0fe8f9b0e5 req-80ff6236-083d-4924-aa72-572a16484342 tempest-VolumesSnapshotsTestJSON-324896323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:31 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [req-c042b53a-3261-4389-b099-dd0fe8f9b0e5 req-80ff6236-083d-4924-aa72-572a16484342 tempest-VolumesSnapshotsTestJSON-324896323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-812195376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6201e6f5-64e8-4d76-93e3-9c5600ac4f7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf1631f9e31044b49f804d3916d65cea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:46:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:46:31Z,use_quota=True,user_id='c489df766ca14bddacdd508fa1e30340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:46:31 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [req-c042b53a-3261-4389-b099-dd0fe8f9b0e5 req-80ff6236-083d-4924-aa72-572a16484342 tempest-VolumesSnapshotsTestJSON-324896323 None] Creating volume 6201e6f5-64e8-4d76-93e3-9c5600ac4f7d {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:46:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-c042b53a-3261-4389-b099-dd0fe8f9b0e5 req-80ff6236-083d-4924-aa72-572a16484342 tempest-VolumesSnapshotsTestJSON-324896323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-c042b53a-3261-4389-b099-dd0fe8f9b0e5 req-80ff6236-083d-4924-aa72-572a16484342 tempest-VolumesSnapshotsTestJSON-324896323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:31 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [req-c042b53a-3261-4389-b099-dd0fe8f9b0e5 req-80ff6236-083d-4924-aa72-572a16484342 tempest-VolumesSnapshotsTestJSON-324896323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:46:31 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [req-c042b53a-3261-4389-b099-dd0fe8f9b0e5 req-80ff6236-083d-4924-aa72-572a16484342 tempest-VolumesSnapshotsTestJSON-324896323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:46:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-c042b53a-3261-4389-b099-dd0fe8f9b0e5 req-80ff6236-083d-4924-aa72-572a16484342 tempest-VolumesSnapshotsTestJSON-324896323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:31 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [req-c042b53a-3261-4389-b099-dd0fe8f9b0e5 req-80ff6236-083d-4924-aa72-572a16484342 tempest-VolumesSnapshotsTestJSON-324896323 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:46:31 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [req-c042b53a-3261-4389-b099-dd0fe8f9b0e5 req-80ff6236-083d-4924-aa72-572a16484342 tempest-VolumesSnapshotsTestJSON-324896323 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:46:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-c042b53a-3261-4389-b099-dd0fe8f9b0e5 req-80ff6236-083d-4924-aa72-572a16484342 tempest-VolumesSnapshotsTestJSON-324896323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:31 devstack sudo[97977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d 1073741824 Jul 10 06:46:31 devstack sudo[97977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:31 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-b2e59054-f03d-4a8d-b3d8-d208cb9e8ebf tempest-VolumesSnapshotListTestJSON-1075097727 None] Created reservations ['de40febe-c30c-44a4-99c4-20b7e7332be2', '6e13bc4a-a9c4-4061-856a-207a64ad69eb', '2f53a37f-14bb-45a1-913a-73163e0e508c', 'c6ef5048-ab21-404e-8cf9-f05b68ac6d63'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:46:31 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-b2e59054-f03d-4a8d-b3d8-d208cb9e8ebf tempest-VolumesSnapshotListTestJSON-1075097727 None] Delete snapshot completed successfully. Jul 10 06:46:31 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b2e59054-f03d-4a8d-b3d8-d208cb9e8ebf tempest-VolumesSnapshotListTestJSON-1075097727 None] Lock "cinder-baaf2482-42b7-456a-a3a9-54f7755336a0-delete_snapshot" released by "delete_snapshot" :: held 5.413s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:32 devstack sudo[97977]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-c042b53a-3261-4389-b099-dd0fe8f9b0e5 req-80ff6236-083d-4924-aa72-572a16484342 tempest-VolumesSnapshotsTestJSON-324896323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d 1073741824" returned: 0 in 1.166s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-c042b53a-3261-4389-b099-dd0fe8f9b0e5 req-80ff6236-083d-4924-aa72-572a16484342 tempest-VolumesSnapshotsTestJSON-324896323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:32 devstack sudo[97990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d Jul 10 06:46:32 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:32 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-8368ce45-09a5-4962-8ac9-f5737cbde785 tempest-VolumesSnapshotListTestJSON-1075097727 None] Acquiring lock "cinder-88b90af9-8239-443c-b84f-1cda88580c6b-delete_snapshot" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:32 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-8368ce45-09a5-4962-8ac9-f5737cbde785 tempest-VolumesSnapshotListTestJSON-1075097727 None] Lock "cinder-88b90af9-8239-443c-b84f-1cda88580c6b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:32 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-8368ce45-09a5-4962-8ac9-f5737cbde785 tempest-VolumesSnapshotListTestJSON-1075097727 None] Acquiring lock "cinder-quobyte-459ef838-0d55-4822-acaa-5ccfbbf73696" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:32 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-8368ce45-09a5-4962-8ac9-f5737cbde785 tempest-VolumesSnapshotListTestJSON-1075097727 None] Lock "cinder-quobyte-459ef838-0d55-4822-acaa-5ccfbbf73696" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:32 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-8368ce45-09a5-4962-8ac9-f5737cbde785 tempest-VolumesSnapshotListTestJSON-1075097727 None] Acquiring lock "cinder-quobyte-88b90af9-8239-443c-b84f-1cda88580c6b" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:32 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-8368ce45-09a5-4962-8ac9-f5737cbde785 tempest-VolumesSnapshotListTestJSON-1075097727 None] Lock "cinder-quobyte-88b90af9-8239-443c-b84f-1cda88580c6b" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:32 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-8368ce45-09a5-4962-8ac9-f5737cbde785 tempest-VolumesSnapshotListTestJSON-1075097727 None] Deleting offline snapshot 88b90af9-8239-443c-b84f-1cda88580c6b of volume 459ef838-0d55-4822-acaa-5ccfbbf73696 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:46:32 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-8368ce45-09a5-4962-8ac9-f5737cbde785 tempest-VolumesSnapshotListTestJSON-1075097727 None] snapshot_file for this snap is: volume-459ef838-0d55-4822-acaa-5ccfbbf73696.88b90af9-8239-443c-b84f-1cda88580c6b {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:46:32 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4995cd-7076-486a-a9ca-1a3ae42b7282]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8368ce45-09a5-4962-8ac9-f5737cbde785 tempest-VolumesSnapshotListTestJSON-1075097727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.88b90af9-8239-443c-b84f-1cda88580c6b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:33 devstack sudo[97992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.88b90af9-8239-443c-b84f-1cda88580c6b Jul 10 06:46:33 devstack sudo[97992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:33 devstack sudo[97968]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e2eebdb6-90f1-46d6-90c1-ab2692fd22e5_gzhwtq0zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5" returned: 0 in 2.750s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:33 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e2eebdb6-90f1-46d6-90c1-ab2692fd22e5_gzhwtq0zdevstack@QuobyteHD, size 112.00 MB, duration 2.75 sec, destination /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5 {{(pid=87294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 06:46:33 devstack cinder-volume[87294]: INFO cinder.image.image_utils [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Converted 112.00 MB image at 40.70 MB/s Jul 10 06:46:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:33 devstack sudo[97995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5 1G Jul 10 06:46:33 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:33 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-c042b53a-3261-4389-b099-dd0fe8f9b0e5 req-80ff6236-083d-4924-aa72-572a16484342 tempest-VolumesSnapshotsTestJSON-324896323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d" returned: 0 in 0.899s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:33 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [req-c042b53a-3261-4389-b099-dd0fe8f9b0e5 req-80ff6236-083d-4924-aa72-572a16484342 tempest-VolumesSnapshotsTestJSON-324896323 None] <== create_volume: return (2117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:46:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-c042b53a-3261-4389-b099-dd0fe8f9b0e5 req-80ff6236-083d-4924-aa72-572a16484342 tempest-VolumesSnapshotsTestJSON-324896323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.120s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:33 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-c042b53a-3261-4389-b099-dd0fe8f9b0e5 req-80ff6236-083d-4924-aa72-572a16484342 tempest-VolumesSnapshotsTestJSON-324896323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b30871f-a6d6-4958-8815-1b480dbe72e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:33 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-c042b53a-3261-4389-b099-dd0fe8f9b0e5 req-80ff6236-083d-4924-aa72-572a16484342 tempest-VolumesSnapshotsTestJSON-324896323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a71b0b1f-45fe-4b39-acfa-bfcf15c030f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:33 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [req-c042b53a-3261-4389-b099-dd0fe8f9b0e5 req-80ff6236-083d-4924-aa72-572a16484342 tempest-VolumesSnapshotsTestJSON-324896323 None] Volume volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d (6201e6f5-64e8-4d76-93e3-9c5600ac4f7d): created successfully Jul 10 06:46:33 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-c042b53a-3261-4389-b099-dd0fe8f9b0e5 req-80ff6236-083d-4924-aa72-572a16484342 tempest-VolumesSnapshotsTestJSON-324896323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a71b0b1f-45fe-4b39-acfa-bfcf15c030f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:33 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-c042b53a-3261-4389-b099-dd0fe8f9b0e5 req-80ff6236-083d-4924-aa72-572a16484342 tempest-VolumesSnapshotsTestJSON-324896323 None] Flow 'volume_create_manager' (003ed16a-6cce-4d84-bebc-cc962c983358) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:46:33 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-c042b53a-3261-4389-b099-dd0fe8f9b0e5 req-80ff6236-083d-4924-aa72-572a16484342 tempest-VolumesSnapshotsTestJSON-324896323 None] Created volume successfully. Jul 10 06:46:33 devstack sudo[97992]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8368ce45-09a5-4962-8ac9-f5737cbde785 tempest-VolumesSnapshotListTestJSON-1075097727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.88b90af9-8239-443c-b84f-1cda88580c6b" returned: 0 in 0.939s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:33 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-8368ce45-09a5-4962-8ac9-f5737cbde785 tempest-VolumesSnapshotListTestJSON-1075097727 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-459ef838-0d55-4822-acaa-5ccfbbf73696(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:46:33 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[155d3b3c-69a8-4df6-9577-01215f84b2ce]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8368ce45-09a5-4962-8ac9-f5737cbde785 tempest-VolumesSnapshotListTestJSON-1075097727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.eb4682d1-ef04-408c-b397-77f399b2f43b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:33 devstack sudo[98005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.eb4682d1-ef04-408c-b397-77f399b2f43b Jul 10 06:46:33 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:34 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5 1G" returned: 0 in 0.902s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:34 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[e089c1ac-d069-4f50-b112-5a263aa95efa]: (4, 'raw') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:34 devstack sudo[98025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5 Jul 10 06:46:34 devstack sudo[98025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:34 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8368ce45-09a5-4962-8ac9-f5737cbde785 tempest-VolumesSnapshotListTestJSON-1075097727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.eb4682d1-ef04-408c-b397-77f399b2f43b" returned: 0 in 0.939s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:34 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-8368ce45-09a5-4962-8ac9-f5737cbde785 tempest-VolumesSnapshotListTestJSON-1075097727 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-459ef838-0d55-4822-acaa-5ccfbbf73696(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:46:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8368ce45-09a5-4962-8ac9-f5737cbde785 tempest-VolumesSnapshotListTestJSON-1075097727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.88b90af9-8239-443c-b84f-1cda88580c6b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:34 devstack sudo[98032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.88b90af9-8239-443c-b84f-1cda88580c6b Jul 10 06:46:34 devstack sudo[98032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-da6ae25e-a097-4809-8262-d459dc22d4d4 req-83be3794-9da5-41d3-8444-bb8a23fd0528 tempest-VolumesSnapshotsTestJSON-324896323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-da6ae25e-a097-4809-8262-d459dc22d4d4 req-83be3794-9da5-41d3-8444-bb8a23fd0528 tempest-VolumesSnapshotsTestJSON-324896323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:35 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [req-da6ae25e-a097-4809-8262-d459dc22d4d4 req-83be3794-9da5-41d3-8444-bb8a23fd0528 tempest-VolumesSnapshotsTestJSON-324896323 None] Creating offline snapshot ad48a281-eea9-427c-95f4-751dd5a15b0a of volume 6201e6f5-64e8-4d76-93e3-9c5600ac4f7d {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:46:35 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f00ad41-a5a9-4913-ac8e-e7bc368170bd]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-da6ae25e-a097-4809-8262-d459dc22d4d4 req-83be3794-9da5-41d3-8444-bb8a23fd0528 tempest-VolumesSnapshotsTestJSON-324896323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:35 devstack sudo[98036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d Jul 10 06:46:35 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:35 devstack sudo[98025]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5" returned: 0 in 1.025s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:35 devstack sudo[98038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5 Jul 10 06:46:35 devstack sudo[98038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:35 devstack sudo[98032]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8368ce45-09a5-4962-8ac9-f5737cbde785 tempest-VolumesSnapshotListTestJSON-1075097727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.88b90af9-8239-443c-b84f-1cda88580c6b" returned: 0 in 1.113s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8368ce45-09a5-4962-8ac9-f5737cbde785 tempest-VolumesSnapshotListTestJSON-1075097727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.88b90af9-8239-443c-b84f-1cda88580c6b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:35 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.88b90af9-8239-443c-b84f-1cda88580c6b Jul 10 06:46:35 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:36 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-da6ae25e-a097-4809-8262-d459dc22d4d4 req-83be3794-9da5-41d3-8444-bb8a23fd0528 tempest-VolumesSnapshotsTestJSON-324896323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d" returned: 0 in 0.943s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-da6ae25e-a097-4809-8262-d459dc22d4d4 req-83be3794-9da5-41d3-8444-bb8a23fd0528 tempest-VolumesSnapshotsTestJSON-324896323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d.ad48a281-eea9-427c-95f4-751dd5a15b0a 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:36 devstack sudo[98050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d.ad48a281-eea9-427c-95f4-751dd5a15b0a 1G Jul 10 06:46:36 devstack sudo[98050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:36 devstack sudo[98038]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5" returned: 1 in 0.981s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5' failed. Not Retrying. {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:46:36 devstack cinder-volume[87294]: DEBUG cinder.volume.volume_utils [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Downloaded image e2eebdb6-90f1-46d6-90c1-ab2692fd22e5 ((None, [{'url': 'file:///opt/stack/data/glance/images/e2eebdb6-90f1-46d6-90c1-ab2692fd22e5', 'metadata': {}}])) to volume 0980f2aa-516f-40a7-8d8f-f0547bb4a8d5 successfully. {{(pid=87294) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 06:46:36 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Temporary image e2eebdb6-90f1-46d6-90c1-ab2692fd22e5 for user a670d569079a4d9d90a29dee7b429a1e is deleted. {{(pid=87294) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 06:46:36 devstack cinder-volume[87294]: DEBUG cinder.volume.volume_utils [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Marking volume 0980f2aa-516f-40a7-8d8f-f0547bb4a8d5 as bootable. {{(pid=87294) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 06:46:36 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Copying metadata from image e2eebdb6-90f1-46d6-90c1-ab2692fd22e5 to 0980f2aa-516f-40a7-8d8f-f0547bb4a8d5. {{(pid=87294) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 06:46:36 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Creating volume glance metadata for volume 0980f2aa-516f-40a7-8d8f-f0547bb4a8d5 backed by image e2eebdb6-90f1-46d6-90c1-ab2692fd22e5 with: {'image_id': 'e2eebdb6-90f1-46d6-90c1-ab2692fd22e5', 'image_name': 'tempest-scenario-img--1334229454', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87294) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 06:46:36 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b9f2194-6820-4dab-90b9-93efd32a2bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5', 'volume_size': 1, 'image_id': 'e2eebdb6-90f1-46d6-90c1-ab2692fd22e5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2eebdb6-90f1-46d6-90c1-ab2692fd22e5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1334229454', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '764c282aa53f4c869b3d9ba7becf3733', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e2eebdb6-90f1-46d6-90c1-ab2692fd22e5', 'created_at': datetime.datetime(2026, 7, 10, 4, 46, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 46, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2eebdb6-90f1-46d6-90c1-ab2692fd22e5/file', 'properties': {}}, 'image_service': }' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:36 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0824def5-ea48-4ae1-8eb9-158b89c61257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:36 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Volume volume-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5 (0980f2aa-516f-40a7-8d8f-f0547bb4a8d5): created successfully Jul 10 06:46:36 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0824def5-ea48-4ae1-8eb9-158b89c61257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:36 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Flow 'volume_create_manager' (d8a98fc2-a3d8-40f2-9907-556e74167f61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:46:36 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-5a9fc017-3827-4d2a-8950-f7be41ab9499 tempest-TestInstancesWithCinderVolumes-177535336 None] Created volume successfully. Jul 10 06:46:36 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8368ce45-09a5-4962-8ac9-f5737cbde785 tempest-VolumesSnapshotListTestJSON-1075097727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.88b90af9-8239-443c-b84f-1cda88580c6b" returned: 0 in 0.789s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:36 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-8368ce45-09a5-4962-8ac9-f5737cbde785 tempest-VolumesSnapshotListTestJSON-1075097727 None] Lock "cinder-quobyte-88b90af9-8239-443c-b84f-1cda88580c6b" released by "_delete_snapshot" :: held 3.904s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:36 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-8368ce45-09a5-4962-8ac9-f5737cbde785 tempest-VolumesSnapshotListTestJSON-1075097727 None] Lock "cinder-quobyte-459ef838-0d55-4822-acaa-5ccfbbf73696" released by "delete_snapshot" :: held 3.942s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:36 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-8368ce45-09a5-4962-8ac9-f5737cbde785 tempest-VolumesSnapshotListTestJSON-1075097727 None] Created reservations ['3eb2e8c8-f72f-457d-9c8e-d3a2dee8747a', '11269d1b-6b4e-4d5e-8681-39392a8c70fb', '1fdf1b68-f553-4438-9c30-5a1cb0771437', '3e991d23-2bb5-471b-b330-7cdb897d32cc'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:46:36 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-8368ce45-09a5-4962-8ac9-f5737cbde785 tempest-VolumesSnapshotListTestJSON-1075097727 None] Delete snapshot completed successfully. Jul 10 06:46:36 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-8368ce45-09a5-4962-8ac9-f5737cbde785 tempest-VolumesSnapshotListTestJSON-1075097727 None] Lock "cinder-88b90af9-8239-443c-b84f-1cda88580c6b-delete_snapshot" released by "delete_snapshot" :: held 4.081s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:36 devstack sudo[98050]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-da6ae25e-a097-4809-8262-d459dc22d4d4 req-83be3794-9da5-41d3-8444-bb8a23fd0528 tempest-VolumesSnapshotsTestJSON-324896323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d.ad48a281-eea9-427c-95f4-751dd5a15b0a 1G" returned: 0 in 0.895s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-da6ae25e-a097-4809-8262-d459dc22d4d4 req-83be3794-9da5-41d3-8444-bb8a23fd0528 tempest-VolumesSnapshotsTestJSON-324896323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d.ad48a281-eea9-427c-95f4-751dd5a15b0a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:36 devstack sudo[98060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d.ad48a281-eea9-427c-95f4-751dd5a15b0a Jul 10 06:46:36 devstack sudo[98060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:37 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c171cf10-7af7-4425-b5f9-3343cebd263d tempest-VolumesSnapshotListTestJSON-1075097727 None] Acquiring lock "cinder-eb4682d1-ef04-408c-b397-77f399b2f43b-delete_snapshot" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:37 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c171cf10-7af7-4425-b5f9-3343cebd263d tempest-VolumesSnapshotListTestJSON-1075097727 None] Lock "cinder-eb4682d1-ef04-408c-b397-77f399b2f43b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:37 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c171cf10-7af7-4425-b5f9-3343cebd263d tempest-VolumesSnapshotListTestJSON-1075097727 None] Acquiring lock "cinder-quobyte-459ef838-0d55-4822-acaa-5ccfbbf73696" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:37 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c171cf10-7af7-4425-b5f9-3343cebd263d tempest-VolumesSnapshotListTestJSON-1075097727 None] Lock "cinder-quobyte-459ef838-0d55-4822-acaa-5ccfbbf73696" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:37 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c171cf10-7af7-4425-b5f9-3343cebd263d tempest-VolumesSnapshotListTestJSON-1075097727 None] Acquiring lock "cinder-quobyte-eb4682d1-ef04-408c-b397-77f399b2f43b" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:37 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c171cf10-7af7-4425-b5f9-3343cebd263d tempest-VolumesSnapshotListTestJSON-1075097727 None] Lock "cinder-quobyte-eb4682d1-ef04-408c-b397-77f399b2f43b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:37 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-c171cf10-7af7-4425-b5f9-3343cebd263d tempest-VolumesSnapshotListTestJSON-1075097727 None] Deleting offline snapshot eb4682d1-ef04-408c-b397-77f399b2f43b of volume 459ef838-0d55-4822-acaa-5ccfbbf73696 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:46:37 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-c171cf10-7af7-4425-b5f9-3343cebd263d tempest-VolumesSnapshotListTestJSON-1075097727 None] snapshot_file for this snap is: volume-459ef838-0d55-4822-acaa-5ccfbbf73696.eb4682d1-ef04-408c-b397-77f399b2f43b {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:46:37 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[91df4479-2914-4689-bb3a-d27afa7cca99]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c171cf10-7af7-4425-b5f9-3343cebd263d tempest-VolumesSnapshotListTestJSON-1075097727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.eb4682d1-ef04-408c-b397-77f399b2f43b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:37 devstack sudo[98062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.eb4682d1-ef04-408c-b397-77f399b2f43b Jul 10 06:46:37 devstack sudo[98062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:37 devstack sudo[98060]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-da6ae25e-a097-4809-8262-d459dc22d4d4 req-83be3794-9da5-41d3-8444-bb8a23fd0528 tempest-VolumesSnapshotsTestJSON-324896323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d.ad48a281-eea9-427c-95f4-751dd5a15b0a" returned: 0 in 0.733s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:37 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [req-da6ae25e-a097-4809-8262-d459dc22d4d4 req-83be3794-9da5-41d3-8444-bb8a23fd0528 tempest-VolumesSnapshotsTestJSON-324896323 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d.ad48a281-eea9-427c-95f4-751dd5a15b0a is being set with open permissions: ugo+rw Jul 10 06:46:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-da6ae25e-a097-4809-8262-d459dc22d4d4 req-83be3794-9da5-41d3-8444-bb8a23fd0528 tempest-VolumesSnapshotsTestJSON-324896323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d.ad48a281-eea9-427c-95f4-751dd5a15b0a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:37 devstack sudo[98067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d.ad48a281-eea9-427c-95f4-751dd5a15b0a Jul 10 06:46:37 devstack sudo[98067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:37 devstack sudo[98062]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c171cf10-7af7-4425-b5f9-3343cebd263d tempest-VolumesSnapshotListTestJSON-1075097727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.eb4682d1-ef04-408c-b397-77f399b2f43b" returned: 0 in 0.835s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:37 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-c171cf10-7af7-4425-b5f9-3343cebd263d tempest-VolumesSnapshotListTestJSON-1075097727 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-459ef838-0d55-4822-acaa-5ccfbbf73696(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:46:37 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a51fa4-059f-42d6-9482-f24a413209b5]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c171cf10-7af7-4425-b5f9-3343cebd263d tempest-VolumesSnapshotListTestJSON-1075097727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:38 devstack sudo[98073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696 Jul 10 06:46:38 devstack sudo[98073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:38 devstack sudo[98067]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-da6ae25e-a097-4809-8262-d459dc22d4d4 req-83be3794-9da5-41d3-8444-bb8a23fd0528 tempest-VolumesSnapshotsTestJSON-324896323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d.ad48a281-eea9-427c-95f4-751dd5a15b0a" returned: 0 in 0.662s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-da6ae25e-a097-4809-8262-d459dc22d4d4 req-83be3794-9da5-41d3-8444-bb8a23fd0528 tempest-VolumesSnapshotsTestJSON-324896323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:38 devstack sudo[98076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d.info Jul 10 06:46:38 devstack sudo[98076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:38 devstack sudo[98073]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c171cf10-7af7-4425-b5f9-3343cebd263d tempest-VolumesSnapshotListTestJSON-1075097727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696" returned: 0 in 0.843s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c171cf10-7af7-4425-b5f9-3343cebd263d tempest-VolumesSnapshotListTestJSON-1075097727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.eb4682d1-ef04-408c-b397-77f399b2f43b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:38 devstack sudo[98082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.eb4682d1-ef04-408c-b397-77f399b2f43b Jul 10 06:46:38 devstack sudo[98082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:39 devstack sudo[98076]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-da6ae25e-a097-4809-8262-d459dc22d4d4 req-83be3794-9da5-41d3-8444-bb8a23fd0528 tempest-VolumesSnapshotsTestJSON-324896323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d.info" returned: 0 in 0.845s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:39 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [req-da6ae25e-a097-4809-8262-d459dc22d4d4 req-83be3794-9da5-41d3-8444-bb8a23fd0528 tempest-VolumesSnapshotsTestJSON-324896323 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d.info is being set with open permissions: ugo+rw Jul 10 06:46:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-da6ae25e-a097-4809-8262-d459dc22d4d4 req-83be3794-9da5-41d3-8444-bb8a23fd0528 tempest-VolumesSnapshotsTestJSON-324896323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:39 devstack sudo[98087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d.info Jul 10 06:46:39 devstack sudo[98087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:39 devstack sudo[98082]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c171cf10-7af7-4425-b5f9-3343cebd263d tempest-VolumesSnapshotListTestJSON-1075097727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.eb4682d1-ef04-408c-b397-77f399b2f43b" returned: 0 in 0.866s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c171cf10-7af7-4425-b5f9-3343cebd263d tempest-VolumesSnapshotListTestJSON-1075097727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.eb4682d1-ef04-408c-b397-77f399b2f43b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:39 devstack sudo[98094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.eb4682d1-ef04-408c-b397-77f399b2f43b Jul 10 06:46:39 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:39 devstack sudo[98087]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-da6ae25e-a097-4809-8262-d459dc22d4d4 req-83be3794-9da5-41d3-8444-bb8a23fd0528 tempest-VolumesSnapshotsTestJSON-324896323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d.info" returned: 0 in 0.706s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-da6ae25e-a097-4809-8262-d459dc22d4d4 req-83be3794-9da5-41d3-8444-bb8a23fd0528 tempest-VolumesSnapshotsTestJSON-324896323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.955s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:40 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-da6ae25e-a097-4809-8262-d459dc22d4d4 req-83be3794-9da5-41d3-8444-bb8a23fd0528 tempest-VolumesSnapshotsTestJSON-324896323 None] Create snapshot completed successfully Jul 10 06:46:40 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c171cf10-7af7-4425-b5f9-3343cebd263d tempest-VolumesSnapshotListTestJSON-1075097727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696.eb4682d1-ef04-408c-b397-77f399b2f43b" returned: 0 in 0.709s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:40 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c171cf10-7af7-4425-b5f9-3343cebd263d tempest-VolumesSnapshotListTestJSON-1075097727 None] Lock "cinder-quobyte-eb4682d1-ef04-408c-b397-77f399b2f43b" released by "_delete_snapshot" :: held 3.369s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:40 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c171cf10-7af7-4425-b5f9-3343cebd263d tempest-VolumesSnapshotListTestJSON-1075097727 None] Lock "cinder-quobyte-459ef838-0d55-4822-acaa-5ccfbbf73696" released by "delete_snapshot" :: held 3.397s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:40 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-c171cf10-7af7-4425-b5f9-3343cebd263d tempest-VolumesSnapshotListTestJSON-1075097727 None] Created reservations ['2a3381e7-1e9b-4ba8-af11-6bd6d3cb7bb9', '7ceade07-21ed-4d7a-b3c7-b0db22f6be4a', 'bc5ba9fa-95b5-4b65-bd6c-971e4266c69f', '32ba70df-f5d8-4775-ab97-e77b3cd9fab1'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:46:40 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-c171cf10-7af7-4425-b5f9-3343cebd263d tempest-VolumesSnapshotListTestJSON-1075097727 None] Delete snapshot completed successfully. Jul 10 06:46:40 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c171cf10-7af7-4425-b5f9-3343cebd263d tempest-VolumesSnapshotListTestJSON-1075097727 None] Lock "cinder-eb4682d1-ef04-408c-b397-77f399b2f43b-delete_snapshot" released by "delete_snapshot" :: held 3.551s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:40 devstack cinder-volume[87294]: DEBUG cinder.coordination [req-d455cc1c-af38-4d62-bbc0-1208e408ef80 req-cb3941c4-9c6d-4488-83b7-7aa2d5a2ae34 tempest-VolumesSnapshotsTestJSON-324896323 None] Acquiring lock "cinder-ad48a281-eea9-427c-95f4-751dd5a15b0a-delete_snapshot" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:40 devstack cinder-volume[87294]: DEBUG cinder.coordination [req-d455cc1c-af38-4d62-bbc0-1208e408ef80 req-cb3941c4-9c6d-4488-83b7-7aa2d5a2ae34 tempest-VolumesSnapshotsTestJSON-324896323 None] Lock "cinder-ad48a281-eea9-427c-95f4-751dd5a15b0a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:40 devstack cinder-volume[87294]: DEBUG cinder.coordination [req-d455cc1c-af38-4d62-bbc0-1208e408ef80 req-cb3941c4-9c6d-4488-83b7-7aa2d5a2ae34 tempest-VolumesSnapshotsTestJSON-324896323 None] Acquiring lock "cinder-quobyte-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:40 devstack cinder-volume[87294]: DEBUG cinder.coordination [req-d455cc1c-af38-4d62-bbc0-1208e408ef80 req-cb3941c4-9c6d-4488-83b7-7aa2d5a2ae34 tempest-VolumesSnapshotsTestJSON-324896323 None] Lock "cinder-quobyte-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:40 devstack cinder-volume[87294]: DEBUG cinder.coordination [req-d455cc1c-af38-4d62-bbc0-1208e408ef80 req-cb3941c4-9c6d-4488-83b7-7aa2d5a2ae34 tempest-VolumesSnapshotsTestJSON-324896323 None] Acquiring lock "cinder-quobyte-ad48a281-eea9-427c-95f4-751dd5a15b0a" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:40 devstack cinder-volume[87294]: DEBUG cinder.coordination [req-d455cc1c-af38-4d62-bbc0-1208e408ef80 req-cb3941c4-9c6d-4488-83b7-7aa2d5a2ae34 tempest-VolumesSnapshotsTestJSON-324896323 None] Lock "cinder-quobyte-ad48a281-eea9-427c-95f4-751dd5a15b0a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:40 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [req-d455cc1c-af38-4d62-bbc0-1208e408ef80 req-cb3941c4-9c6d-4488-83b7-7aa2d5a2ae34 tempest-VolumesSnapshotsTestJSON-324896323 None] Deleting offline snapshot ad48a281-eea9-427c-95f4-751dd5a15b0a of volume 6201e6f5-64e8-4d76-93e3-9c5600ac4f7d {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:46:41 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [req-d455cc1c-af38-4d62-bbc0-1208e408ef80 req-cb3941c4-9c6d-4488-83b7-7aa2d5a2ae34 tempest-VolumesSnapshotsTestJSON-324896323 None] snapshot_file for this snap is: volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d.ad48a281-eea9-427c-95f4-751dd5a15b0a {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:46:41 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a875385-b99c-4256-99fd-70ccadaf69d8]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-d455cc1c-af38-4d62-bbc0-1208e408ef80 req-cb3941c4-9c6d-4488-83b7-7aa2d5a2ae34 tempest-VolumesSnapshotsTestJSON-324896323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d.ad48a281-eea9-427c-95f4-751dd5a15b0a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:41 devstack sudo[98098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d.ad48a281-eea9-427c-95f4-751dd5a15b0a Jul 10 06:46:41 devstack sudo[98098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2db91efe-de5b-400b-99e0-571c30445aba tempest-VolumesSnapshotListTestJSON-1075097727 None] Acquiring lock "cinder-459ef838-0d55-4822-acaa-5ccfbbf73696-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2db91efe-de5b-400b-99e0-571c30445aba tempest-VolumesSnapshotListTestJSON-1075097727 None] Lock "cinder-459ef838-0d55-4822-acaa-5ccfbbf73696-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2db91efe-de5b-400b-99e0-571c30445aba tempest-VolumesSnapshotListTestJSON-1075097727 None] Acquiring lock "cinder-quobyte-459ef838-0d55-4822-acaa-5ccfbbf73696" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2db91efe-de5b-400b-99e0-571c30445aba tempest-VolumesSnapshotListTestJSON-1075097727 None] Lock "cinder-quobyte-459ef838-0d55-4822-acaa-5ccfbbf73696" acquired by "delete_volume" :: waited 0.019s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:41 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f588a4-2dae-48a8-bdc0-37ca10e39e61]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2db91efe-de5b-400b-99e0-571c30445aba tempest-VolumesSnapshotListTestJSON-1075097727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:41 devstack sudo[98100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696 Jul 10 06:46:41 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:41 devstack sudo[98098]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-d455cc1c-af38-4d62-bbc0-1208e408ef80 req-cb3941c4-9c6d-4488-83b7-7aa2d5a2ae34 tempest-VolumesSnapshotsTestJSON-324896323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d.ad48a281-eea9-427c-95f4-751dd5a15b0a" returned: 0 in 0.898s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:41 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [req-d455cc1c-af38-4d62-bbc0-1208e408ef80 req-cb3941c4-9c6d-4488-83b7-7aa2d5a2ae34 tempest-VolumesSnapshotsTestJSON-324896323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:46:41 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7f3b62-d75e-458a-9d20-cffc2ea43a27]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-d455cc1c-af38-4d62-bbc0-1208e408ef80 req-cb3941c4-9c6d-4488-83b7-7aa2d5a2ae34 tempest-VolumesSnapshotsTestJSON-324896323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:42 devstack sudo[98105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d Jul 10 06:46:42 devstack sudo[98105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:42 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2db91efe-de5b-400b-99e0-571c30445aba tempest-VolumesSnapshotListTestJSON-1075097727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696" returned: 0 in 0.871s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2db91efe-de5b-400b-99e0-571c30445aba tempest-VolumesSnapshotListTestJSON-1075097727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:42 devstack sudo[98111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696 Jul 10 06:46:42 devstack sudo[98111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:42 devstack sudo[98105]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-d455cc1c-af38-4d62-bbc0-1208e408ef80 req-cb3941c4-9c6d-4488-83b7-7aa2d5a2ae34 tempest-VolumesSnapshotsTestJSON-324896323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d" returned: 0 in 0.895s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-d455cc1c-af38-4d62-bbc0-1208e408ef80 req-cb3941c4-9c6d-4488-83b7-7aa2d5a2ae34 tempest-VolumesSnapshotsTestJSON-324896323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d.ad48a281-eea9-427c-95f4-751dd5a15b0a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:42 devstack sudo[98118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d.ad48a281-eea9-427c-95f4-751dd5a15b0a Jul 10 06:46:42 devstack sudo[98118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:43 devstack sudo[98111]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2db91efe-de5b-400b-99e0-571c30445aba tempest-VolumesSnapshotListTestJSON-1075097727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-459ef838-0d55-4822-acaa-5ccfbbf73696" returned: 0 in 0.751s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:43 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2db91efe-de5b-400b-99e0-571c30445aba tempest-VolumesSnapshotListTestJSON-1075097727 None] Lock "cinder-quobyte-459ef838-0d55-4822-acaa-5ccfbbf73696" released by "delete_volume" :: held 1.693s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:43 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-2db91efe-de5b-400b-99e0-571c30445aba tempest-VolumesSnapshotListTestJSON-1075097727 None] Created reservations ['3282b372-30b3-420b-8c56-6e5ca0dc9ec7', '6e811d83-067a-4f70-a019-a13e3ad1f170', '5cb7983b-a38b-4ea0-a8f1-a9fc9e091a7d', '48cdef2d-446d-4226-ae58-ce7e80e762e5'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:46:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2db91efe-de5b-400b-99e0-571c30445aba tempest-VolumesSnapshotListTestJSON-1075097727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2db91efe-de5b-400b-99e0-571c30445aba tempest-VolumesSnapshotListTestJSON-1075097727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:43 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-2db91efe-de5b-400b-99e0-571c30445aba tempest-VolumesSnapshotListTestJSON-1075097727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:46:43 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-2db91efe-de5b-400b-99e0-571c30445aba tempest-VolumesSnapshotListTestJSON-1075097727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:46:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2db91efe-de5b-400b-99e0-571c30445aba tempest-VolumesSnapshotListTestJSON-1075097727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2db91efe-de5b-400b-99e0-571c30445aba tempest-VolumesSnapshotListTestJSON-1075097727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:43 devstack sudo[98121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:46:43 devstack sudo[98121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:43 devstack sudo[98118]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-d455cc1c-af38-4d62-bbc0-1208e408ef80 req-cb3941c4-9c6d-4488-83b7-7aa2d5a2ae34 tempest-VolumesSnapshotsTestJSON-324896323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d.ad48a281-eea9-427c-95f4-751dd5a15b0a" returned: 0 in 0.905s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-d455cc1c-af38-4d62-bbc0-1208e408ef80 req-cb3941c4-9c6d-4488-83b7-7aa2d5a2ae34 tempest-VolumesSnapshotsTestJSON-324896323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d.ad48a281-eea9-427c-95f4-751dd5a15b0a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:43 devstack sudo[98127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d.ad48a281-eea9-427c-95f4-751dd5a15b0a Jul 10 06:46:43 devstack sudo[98127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:44 devstack sudo[98121]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2db91efe-de5b-400b-99e0-571c30445aba tempest-VolumesSnapshotListTestJSON-1075097727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.037s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:44 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-2db91efe-de5b-400b-99e0-571c30445aba tempest-VolumesSnapshotListTestJSON-1075097727 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:46:44 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-2db91efe-de5b-400b-99e0-571c30445aba tempest-VolumesSnapshotListTestJSON-1075097727 None] Deleted volume successfully. Jul 10 06:46:44 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2db91efe-de5b-400b-99e0-571c30445aba tempest-VolumesSnapshotListTestJSON-1075097727 None] Lock "cinder-459ef838-0d55-4822-acaa-5ccfbbf73696-delete_volume" released by "delete_volume" :: held 3.019s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:44 devstack sudo[98127]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-d455cc1c-af38-4d62-bbc0-1208e408ef80 req-cb3941c4-9c6d-4488-83b7-7aa2d5a2ae34 tempest-VolumesSnapshotsTestJSON-324896323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d.ad48a281-eea9-427c-95f4-751dd5a15b0a" returned: 0 in 1.108s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:44 devstack cinder-volume[87294]: DEBUG cinder.coordination [req-d455cc1c-af38-4d62-bbc0-1208e408ef80 req-cb3941c4-9c6d-4488-83b7-7aa2d5a2ae34 tempest-VolumesSnapshotsTestJSON-324896323 None] Lock "cinder-quobyte-ad48a281-eea9-427c-95f4-751dd5a15b0a" released by "_delete_snapshot" :: held 3.981s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:44 devstack cinder-volume[87294]: DEBUG cinder.coordination [req-d455cc1c-af38-4d62-bbc0-1208e408ef80 req-cb3941c4-9c6d-4488-83b7-7aa2d5a2ae34 tempest-VolumesSnapshotsTestJSON-324896323 None] Lock "cinder-quobyte-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d" released by "delete_snapshot" :: held 4.022s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:45 devstack cinder-volume[87294]: DEBUG cinder.quota [req-d455cc1c-af38-4d62-bbc0-1208e408ef80 req-cb3941c4-9c6d-4488-83b7-7aa2d5a2ae34 tempest-VolumesSnapshotsTestJSON-324896323 None] Created reservations ['22fb2976-926a-46c8-b6df-fb543a1f16d8', 'c6ff8d1b-ddc5-4cc6-b96f-f07d3d6c94ce', '2589370a-2bd2-40ae-aefa-bcf925adc552', '6c7c3564-b203-431c-a3c1-aa54afad84b4'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:46:45 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-d455cc1c-af38-4d62-bbc0-1208e408ef80 req-cb3941c4-9c6d-4488-83b7-7aa2d5a2ae34 tempest-VolumesSnapshotsTestJSON-324896323 None] Delete snapshot completed successfully. Jul 10 06:46:45 devstack cinder-volume[87294]: DEBUG cinder.coordination [req-d455cc1c-af38-4d62-bbc0-1208e408ef80 req-cb3941c4-9c6d-4488-83b7-7aa2d5a2ae34 tempest-VolumesSnapshotsTestJSON-324896323 None] Lock "cinder-ad48a281-eea9-427c-95f4-751dd5a15b0a-delete_snapshot" released by "delete_snapshot" :: held 4.366s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-1a4d00e3-085b-408e-a83f-8d7fc4ca82a7 req-f052daa7-8d14-4670-8d8b-98b6cd956285 tempest-TestInstancesWithCinderVolumes-177535336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-1a4d00e3-085b-408e-a83f-8d7fc4ca82a7 req-f052daa7-8d14-4670-8d8b-98b6cd956285 tempest-TestInstancesWithCinderVolumes-177535336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:45 devstack cinder-volume[87294]: DEBUG cinder.coordination [req-1289ee1f-4213-4e12-ab13-55477b5a9320 req-14dd28e3-dcdb-4824-a281-b1e681b03468 tempest-VolumesSnapshotsTestJSON-324896323 None] Acquiring lock "cinder-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:45 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[9702f0a6-61c0-40ef-8575-99dd1a6695e6]: (4, 'raw') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-1a4d00e3-085b-408e-a83f-8d7fc4ca82a7 req-f052daa7-8d14-4670-8d8b-98b6cd956285 tempest-TestInstancesWithCinderVolumes-177535336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:45 devstack cinder-volume[87294]: DEBUG cinder.coordination [req-1289ee1f-4213-4e12-ab13-55477b5a9320 req-14dd28e3-dcdb-4824-a281-b1e681b03468 tempest-VolumesSnapshotsTestJSON-324896323 None] Lock "cinder-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:45 devstack cinder-volume[87294]: DEBUG cinder.coordination [req-1289ee1f-4213-4e12-ab13-55477b5a9320 req-14dd28e3-dcdb-4824-a281-b1e681b03468 tempest-VolumesSnapshotsTestJSON-324896323 None] Acquiring lock "cinder-quobyte-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:45 devstack cinder-volume[87294]: DEBUG cinder.coordination [req-1289ee1f-4213-4e12-ab13-55477b5a9320 req-14dd28e3-dcdb-4824-a281-b1e681b03468 tempest-VolumesSnapshotsTestJSON-324896323 None] Lock "cinder-quobyte-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d" acquired by "delete_volume" :: waited 0.015s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:45 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88f6cb2-28b3-41e3-a512-6e1858c4dbc6]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-1289ee1f-4213-4e12-ab13-55477b5a9320 req-14dd28e3-dcdb-4824-a281-b1e681b03468 tempest-VolumesSnapshotsTestJSON-324896323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:45 devstack sudo[98140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5 Jul 10 06:46:45 devstack sudo[98140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:45 devstack sudo[98141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d Jul 10 06:46:45 devstack sudo[98141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:46 devstack sudo[98140]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-1a4d00e3-085b-408e-a83f-8d7fc4ca82a7 req-f052daa7-8d14-4670-8d8b-98b6cd956285 tempest-TestInstancesWithCinderVolumes-177535336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5" returned: 0 in 1.172s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-1a4d00e3-085b-408e-a83f-8d7fc4ca82a7 req-f052daa7-8d14-4670-8d8b-98b6cd956285 tempest-TestInstancesWithCinderVolumes-177535336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:46 devstack sudo[98141]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:46 devstack sudo[98150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5 Jul 10 06:46:46 devstack sudo[98150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-1289ee1f-4213-4e12-ab13-55477b5a9320 req-14dd28e3-dcdb-4824-a281-b1e681b03468 tempest-VolumesSnapshotsTestJSON-324896323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d" returned: 0 in 1.169s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-1289ee1f-4213-4e12-ab13-55477b5a9320 req-14dd28e3-dcdb-4824-a281-b1e681b03468 tempest-VolumesSnapshotsTestJSON-324896323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:46 devstack sudo[98152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d Jul 10 06:46:46 devstack sudo[98152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:47 devstack sudo[98152]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-1289ee1f-4213-4e12-ab13-55477b5a9320 req-14dd28e3-dcdb-4824-a281-b1e681b03468 tempest-VolumesSnapshotsTestJSON-324896323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d" returned: 0 in 0.838s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:47 devstack cinder-volume[87294]: DEBUG cinder.coordination [req-1289ee1f-4213-4e12-ab13-55477b5a9320 req-14dd28e3-dcdb-4824-a281-b1e681b03468 tempest-VolumesSnapshotsTestJSON-324896323 None] Lock "cinder-quobyte-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d" released by "delete_volume" :: held 2.107s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:47 devstack sudo[98150]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-1a4d00e3-085b-408e-a83f-8d7fc4ca82a7 req-f052daa7-8d14-4670-8d8b-98b6cd956285 tempest-TestInstancesWithCinderVolumes-177535336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5" returned: 1 in 1.098s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-1a4d00e3-085b-408e-a83f-8d7fc4ca82a7 req-f052daa7-8d14-4670-8d8b-98b6cd956285 tempest-TestInstancesWithCinderVolumes-177535336 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5' failed. Not Retrying. {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:46:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-1a4d00e3-085b-408e-a83f-8d7fc4ca82a7 req-f052daa7-8d14-4670-8d8b-98b6cd956285 tempest-TestInstancesWithCinderVolumes-177535336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.349s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:47 devstack cinder-volume[87294]: DEBUG cinder.quota [req-1289ee1f-4213-4e12-ab13-55477b5a9320 req-14dd28e3-dcdb-4824-a281-b1e681b03468 tempest-VolumesSnapshotsTestJSON-324896323 None] Created reservations ['4dd0e165-534e-41a6-85cf-3ad3f0859dd3', 'e03df2b2-f6dc-4260-b07e-224fdf16b18d', '031f1e27-1888-47fc-8a8f-cd1c72ae8db2', '0b5c55e4-6b4f-49f3-a28f-69fc7ba611d3'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:46:47 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-1a4d00e3-085b-408e-a83f-8d7fc4ca82a7 req-f052daa7-8d14-4670-8d8b-98b6cd956285 tempest-TestInstancesWithCinderVolumes-177535336 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804', 'name': 'volume-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '05f9f444-abc3-44e1-bbb9-558f0ba7fc99', 'enforce_multipath': True} {{(pid=87294) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:46:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-1289ee1f-4213-4e12-ab13-55477b5a9320 req-14dd28e3-dcdb-4824-a281-b1e681b03468 tempest-VolumesSnapshotsTestJSON-324896323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-1289ee1f-4213-4e12-ab13-55477b5a9320 req-14dd28e3-dcdb-4824-a281-b1e681b03468 tempest-VolumesSnapshotsTestJSON-324896323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:47 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [req-1289ee1f-4213-4e12-ab13-55477b5a9320 req-14dd28e3-dcdb-4824-a281-b1e681b03468 tempest-VolumesSnapshotsTestJSON-324896323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:46:47 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [req-1289ee1f-4213-4e12-ab13-55477b5a9320 req-14dd28e3-dcdb-4824-a281-b1e681b03468 tempest-VolumesSnapshotsTestJSON-324896323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:46:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-1289ee1f-4213-4e12-ab13-55477b5a9320 req-14dd28e3-dcdb-4824-a281-b1e681b03468 tempest-VolumesSnapshotsTestJSON-324896323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-1289ee1f-4213-4e12-ab13-55477b5a9320 req-14dd28e3-dcdb-4824-a281-b1e681b03468 tempest-VolumesSnapshotsTestJSON-324896323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:47 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-1a4d00e3-085b-408e-a83f-8d7fc4ca82a7 req-f052daa7-8d14-4670-8d8b-98b6cd956285 tempest-TestInstancesWithCinderVolumes-177535336 None] attachment_update completed successfully. Jul 10 06:46:47 devstack sudo[98158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:46:47 devstack sudo[98158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:48 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-779ea6b3-ae58-4a68-9acc-6ad594311e12 tempest-VolumesNegativeTest-48208343 None] Acquiring lock "cinder-f34fe795-881d-43f1-8567-20ee39a71e3e-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:48 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-779ea6b3-ae58-4a68-9acc-6ad594311e12 tempest-VolumesNegativeTest-48208343 None] Lock "cinder-f34fe795-881d-43f1-8567-20ee39a71e3e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:48 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-779ea6b3-ae58-4a68-9acc-6ad594311e12 tempest-VolumesNegativeTest-48208343 None] Acquiring lock "cinder-quobyte-f34fe795-881d-43f1-8567-20ee39a71e3e" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:46:48 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-779ea6b3-ae58-4a68-9acc-6ad594311e12 tempest-VolumesNegativeTest-48208343 None] Lock "cinder-quobyte-f34fe795-881d-43f1-8567-20ee39a71e3e" acquired by "delete_volume" :: waited 0.019s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:46:48 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[982ec651-242a-4248-a05d-0f16d20b0abd]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:46:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-779ea6b3-ae58-4a68-9acc-6ad594311e12 tempest-VolumesNegativeTest-48208343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f34fe795-881d-43f1-8567-20ee39a71e3e {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:48 devstack sudo[98160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f34fe795-881d-43f1-8567-20ee39a71e3e Jul 10 06:46:48 devstack sudo[98160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:48 devstack sudo[98158]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-1289ee1f-4213-4e12-ab13-55477b5a9320 req-14dd28e3-dcdb-4824-a281-b1e681b03468 tempest-VolumesSnapshotsTestJSON-324896323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.794s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:48 devstack cinder-volume[87294]: DEBUG cinder.manager [req-1289ee1f-4213-4e12-ab13-55477b5a9320 req-14dd28e3-dcdb-4824-a281-b1e681b03468 tempest-VolumesSnapshotsTestJSON-324896323 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:46:48 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-1289ee1f-4213-4e12-ab13-55477b5a9320 req-14dd28e3-dcdb-4824-a281-b1e681b03468 tempest-VolumesSnapshotsTestJSON-324896323 None] Deleted volume successfully. Jul 10 06:46:48 devstack cinder-volume[87294]: DEBUG cinder.coordination [req-1289ee1f-4213-4e12-ab13-55477b5a9320 req-14dd28e3-dcdb-4824-a281-b1e681b03468 tempest-VolumesSnapshotsTestJSON-324896323 None] Lock "cinder-6201e6f5-64e8-4d76-93e3-9c5600ac4f7d-delete_volume" released by "delete_volume" :: held 3.218s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:49 devstack sudo[98160]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-779ea6b3-ae58-4a68-9acc-6ad594311e12 tempest-VolumesNegativeTest-48208343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f34fe795-881d-43f1-8567-20ee39a71e3e" returned: 0 in 1.058s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-779ea6b3-ae58-4a68-9acc-6ad594311e12 tempest-VolumesNegativeTest-48208343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f34fe795-881d-43f1-8567-20ee39a71e3e {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:49 devstack sudo[98166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f34fe795-881d-43f1-8567-20ee39a71e3e Jul 10 06:46:49 devstack sudo[98166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:49 devstack sudo[98166]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-779ea6b3-ae58-4a68-9acc-6ad594311e12 tempest-VolumesNegativeTest-48208343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f34fe795-881d-43f1-8567-20ee39a71e3e" returned: 0 in 0.792s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:50 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-779ea6b3-ae58-4a68-9acc-6ad594311e12 tempest-VolumesNegativeTest-48208343 None] Lock "cinder-quobyte-f34fe795-881d-43f1-8567-20ee39a71e3e" released by "delete_volume" :: held 1.905s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:50 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-779ea6b3-ae58-4a68-9acc-6ad594311e12 tempest-VolumesNegativeTest-48208343 None] Created reservations ['e83bddf5-03c9-4483-8122-5ae0785c6a40', 'f7c68815-a33d-4cb4-8a70-7248903a34c5', '98757ada-19e5-4d3d-acf6-d747ed00c1ea', 'f5c95ff8-afbe-40d9-b311-952e2e807a3a'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:46:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-779ea6b3-ae58-4a68-9acc-6ad594311e12 tempest-VolumesNegativeTest-48208343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-779ea6b3-ae58-4a68-9acc-6ad594311e12 tempest-VolumesNegativeTest-48208343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:50 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-779ea6b3-ae58-4a68-9acc-6ad594311e12 tempest-VolumesNegativeTest-48208343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:46:50 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-779ea6b3-ae58-4a68-9acc-6ad594311e12 tempest-VolumesNegativeTest-48208343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:46:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-779ea6b3-ae58-4a68-9acc-6ad594311e12 tempest-VolumesNegativeTest-48208343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-779ea6b3-ae58-4a68-9acc-6ad594311e12 tempest-VolumesNegativeTest-48208343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:50 devstack sudo[98170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:46:50 devstack sudo[98170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:51 devstack sudo[98170]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-779ea6b3-ae58-4a68-9acc-6ad594311e12 tempest-VolumesNegativeTest-48208343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.855s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:51 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-779ea6b3-ae58-4a68-9acc-6ad594311e12 tempest-VolumesNegativeTest-48208343 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:46:51 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-779ea6b3-ae58-4a68-9acc-6ad594311e12 tempest-VolumesNegativeTest-48208343 None] Deleted volume successfully. Jul 10 06:46:51 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-779ea6b3-ae58-4a68-9acc-6ad594311e12 tempest-VolumesNegativeTest-48208343 None] Lock "cinder-f34fe795-881d-43f1-8567-20ee39a71e3e-delete_volume" released by "delete_volume" :: held 3.042s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:46:54 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cbcdfa7-cc91-4718-9159-858857d7f56d tempest-VolumesTestJSON-1610010168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:46:54 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9cbcdfa7-cc91-4718-9159-858857d7f56d tempest-VolumesTestJSON-1610010168 None] Flow 'volume_create_manager' (a807e94f-2068-424c-b2d5-0078d9e85aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:46:54 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9cbcdfa7-cc91-4718-9159-858857d7f56d tempest-VolumesTestJSON-1610010168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8323491-b7a1-43c2-a1ce-ae0a4ae24306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:54 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9cbcdfa7-cc91-4718-9159-858857d7f56d tempest-VolumesTestJSON-1610010168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8323491-b7a1-43c2-a1ce-ae0a4ae24306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-52858480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6184210e-d193-4277-9ac6-854978fb86e0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='707aa3a552ab41c7bb52a2f75278c98c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:46:54Z,use_quota=True,user_id='bc44d0909736406680932595edd4f28d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:54 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9cbcdfa7-cc91-4718-9159-858857d7f56d tempest-VolumesTestJSON-1610010168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (067043b9-da84-4846-82a1-17b22cef55a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:54 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9cbcdfa7-cc91-4718-9159-858857d7f56d tempest-VolumesTestJSON-1610010168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (067043b9-da84-4846-82a1-17b22cef55a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:54 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9cbcdfa7-cc91-4718-9159-858857d7f56d tempest-VolumesTestJSON-1610010168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a94f9616-6bfc-4505-a0fe-cb9869cdf995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:54 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9cbcdfa7-cc91-4718-9159-858857d7f56d tempest-VolumesTestJSON-1610010168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a94f9616-6bfc-4505-a0fe-cb9869cdf995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6184210e-d193-4277-9ac6-854978fb86e0', 'volume_name': 'volume-6184210e-d193-4277-9ac6-854978fb86e0', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:54 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9cbcdfa7-cc91-4718-9159-858857d7f56d tempest-VolumesTestJSON-1610010168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a217e2f3-e578-41d9-b899-d1bfa0616b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:54 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9cbcdfa7-cc91-4718-9159-858857d7f56d tempest-VolumesTestJSON-1610010168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a217e2f3-e578-41d9-b899-d1bfa0616b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:54 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9cbcdfa7-cc91-4718-9159-858857d7f56d tempest-VolumesTestJSON-1610010168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cb7b356-b4a0-4dfa-9d98-90494e72fedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:54 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-9cbcdfa7-cc91-4718-9159-858857d7f56d tempest-VolumesTestJSON-1610010168 None] Volume 6184210e-d193-4277-9ac6-854978fb86e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6184210e-d193-4277-9ac6-854978fb86e0', 'volume_size': 1} Jul 10 06:46:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9cbcdfa7-cc91-4718-9159-858857d7f56d tempest-VolumesTestJSON-1610010168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9cbcdfa7-cc91-4718-9159-858857d7f56d tempest-VolumesTestJSON-1610010168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:54 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9cbcdfa7-cc91-4718-9159-858857d7f56d tempest-VolumesTestJSON-1610010168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-52858480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6184210e-d193-4277-9ac6-854978fb86e0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='707aa3a552ab41c7bb52a2f75278c98c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:46:54Z,use_quota=True,user_id='bc44d0909736406680932595edd4f28d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:46:54 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-9cbcdfa7-cc91-4718-9159-858857d7f56d tempest-VolumesTestJSON-1610010168 None] Creating volume 6184210e-d193-4277-9ac6-854978fb86e0 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:46:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9cbcdfa7-cc91-4718-9159-858857d7f56d tempest-VolumesTestJSON-1610010168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9cbcdfa7-cc91-4718-9159-858857d7f56d tempest-VolumesTestJSON-1610010168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:54 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9cbcdfa7-cc91-4718-9159-858857d7f56d tempest-VolumesTestJSON-1610010168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:46:54 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9cbcdfa7-cc91-4718-9159-858857d7f56d tempest-VolumesTestJSON-1610010168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:46:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9cbcdfa7-cc91-4718-9159-858857d7f56d tempest-VolumesTestJSON-1610010168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:54 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9cbcdfa7-cc91-4718-9159-858857d7f56d tempest-VolumesTestJSON-1610010168 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:46:54 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-9cbcdfa7-cc91-4718-9159-858857d7f56d tempest-VolumesTestJSON-1610010168 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:46:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9cbcdfa7-cc91-4718-9159-858857d7f56d tempest-VolumesTestJSON-1610010168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6184210e-d193-4277-9ac6-854978fb86e0 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:54 devstack sudo[98618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6184210e-d193-4277-9ac6-854978fb86e0 1073741824 Jul 10 06:46:54 devstack sudo[98618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:55 devstack sudo[98618]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9cbcdfa7-cc91-4718-9159-858857d7f56d tempest-VolumesTestJSON-1610010168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6184210e-d193-4277-9ac6-854978fb86e0 1073741824" returned: 0 in 1.247s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9cbcdfa7-cc91-4718-9159-858857d7f56d tempest-VolumesTestJSON-1610010168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6184210e-d193-4277-9ac6-854978fb86e0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:56 devstack sudo[98626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6184210e-d193-4277-9ac6-854978fb86e0 Jul 10 06:46:56 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:46:57 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root Jul 10 06:46:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9cbcdfa7-cc91-4718-9159-858857d7f56d tempest-VolumesTestJSON-1610010168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6184210e-d193-4277-9ac6-854978fb86e0" returned: 0 in 1.003s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:46:57 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9cbcdfa7-cc91-4718-9159-858857d7f56d tempest-VolumesTestJSON-1610010168 None] <== create_volume: return (2348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:46:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9cbcdfa7-cc91-4718-9159-858857d7f56d tempest-VolumesTestJSON-1610010168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.354s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9cbcdfa7-cc91-4718-9159-858857d7f56d tempest-VolumesTestJSON-1610010168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cb7b356-b4a0-4dfa-9d98-90494e72fedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6184210e-d193-4277-9ac6-854978fb86e0', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9cbcdfa7-cc91-4718-9159-858857d7f56d tempest-VolumesTestJSON-1610010168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (705e037e-8a7e-49d6-93f3-e78c9fdb2b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:57 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-9cbcdfa7-cc91-4718-9159-858857d7f56d tempest-VolumesTestJSON-1610010168 None] Volume volume-6184210e-d193-4277-9ac6-854978fb86e0 (6184210e-d193-4277-9ac6-854978fb86e0): created successfully Jul 10 06:46:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9cbcdfa7-cc91-4718-9159-858857d7f56d tempest-VolumesTestJSON-1610010168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (705e037e-8a7e-49d6-93f3-e78c9fdb2b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9cbcdfa7-cc91-4718-9159-858857d7f56d tempest-VolumesTestJSON-1610010168 None] Flow 'volume_create_manager' (a807e94f-2068-424c-b2d5-0078d9e85aec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:46:57 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-9cbcdfa7-cc91-4718-9159-858857d7f56d tempest-VolumesTestJSON-1610010168 None] Created volume successfully. Jul 10 06:46:58 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:UPDATE=108,cinder:SELECT=93,cinder:INSERT=30,cinder:DELETE=8 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:46:58 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-387ca23d-8c26-4681-a1fa-fcca846d260d tempest-VolumesTestJSON-1610010168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:46:58 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-387ca23d-8c26-4681-a1fa-fcca846d260d tempest-VolumesTestJSON-1610010168 None] Flow 'volume_create_manager' (89830229-69f9-410c-8458-48466e5a8021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:46:58 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-387ca23d-8c26-4681-a1fa-fcca846d260d tempest-VolumesTestJSON-1610010168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81ce8d28-b1c4-456e-a077-9bc8189ca3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:58 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-387ca23d-8c26-4681-a1fa-fcca846d260d tempest-VolumesTestJSON-1610010168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81ce8d28-b1c4-456e-a077-9bc8189ca3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-738087892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=016999ae-4c6f-4879-af7f-0785e3a09cc7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='707aa3a552ab41c7bb52a2f75278c98c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:46:59Z,use_quota=True,user_id='bc44d0909736406680932595edd4f28d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:58 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-387ca23d-8c26-4681-a1fa-fcca846d260d tempest-VolumesTestJSON-1610010168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7ac2c0b-793a-443b-98b0-457796872da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:58 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-387ca23d-8c26-4681-a1fa-fcca846d260d tempest-VolumesTestJSON-1610010168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7ac2c0b-793a-443b-98b0-457796872da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:58 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-387ca23d-8c26-4681-a1fa-fcca846d260d tempest-VolumesTestJSON-1610010168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88f3a4e8-1888-4830-97ac-0bc5e108def1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:58 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-387ca23d-8c26-4681-a1fa-fcca846d260d tempest-VolumesTestJSON-1610010168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88f3a4e8-1888-4830-97ac-0bc5e108def1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '016999ae-4c6f-4879-af7f-0785e3a09cc7', 'volume_name': 'volume-016999ae-4c6f-4879-af7f-0785e3a09cc7', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:58 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-387ca23d-8c26-4681-a1fa-fcca846d260d tempest-VolumesTestJSON-1610010168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ad87bb8-44ad-463b-9bf7-9999fa648c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:58 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-387ca23d-8c26-4681-a1fa-fcca846d260d tempest-VolumesTestJSON-1610010168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ad87bb8-44ad-463b-9bf7-9999fa648c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:46:58 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-387ca23d-8c26-4681-a1fa-fcca846d260d tempest-VolumesTestJSON-1610010168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7ca781a-5526-47c8-965f-2e6a0eb9c34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:46:58 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-387ca23d-8c26-4681-a1fa-fcca846d260d tempest-VolumesTestJSON-1610010168 None] Volume 016999ae-4c6f-4879-af7f-0785e3a09cc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-016999ae-4c6f-4879-af7f-0785e3a09cc7', 'volume_size': 1} Jul 10 06:46:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-387ca23d-8c26-4681-a1fa-fcca846d260d tempest-VolumesTestJSON-1610010168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-387ca23d-8c26-4681-a1fa-fcca846d260d tempest-VolumesTestJSON-1610010168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:59 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-387ca23d-8c26-4681-a1fa-fcca846d260d tempest-VolumesTestJSON-1610010168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-738087892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=016999ae-4c6f-4879-af7f-0785e3a09cc7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='707aa3a552ab41c7bb52a2f75278c98c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:46:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:46:59Z,use_quota=True,user_id='bc44d0909736406680932595edd4f28d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:46:59 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-387ca23d-8c26-4681-a1fa-fcca846d260d tempest-VolumesTestJSON-1610010168 None] Creating volume 016999ae-4c6f-4879-af7f-0785e3a09cc7 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:46:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-387ca23d-8c26-4681-a1fa-fcca846d260d tempest-VolumesTestJSON-1610010168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:46:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-387ca23d-8c26-4681-a1fa-fcca846d260d tempest-VolumesTestJSON-1610010168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:46:59 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-387ca23d-8c26-4681-a1fa-fcca846d260d tempest-VolumesTestJSON-1610010168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:46:59 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-387ca23d-8c26-4681-a1fa-fcca846d260d tempest-VolumesTestJSON-1610010168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:46:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-387ca23d-8c26-4681-a1fa-fcca846d260d tempest-VolumesTestJSON-1610010168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:46:59 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-387ca23d-8c26-4681-a1fa-fcca846d260d tempest-VolumesTestJSON-1610010168 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:46:59 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-387ca23d-8c26-4681-a1fa-fcca846d260d tempest-VolumesTestJSON-1610010168 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:46:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-387ca23d-8c26-4681-a1fa-fcca846d260d tempest-VolumesTestJSON-1610010168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-016999ae-4c6f-4879-af7f-0785e3a09cc7 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:46:59 devstack sudo[98632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-016999ae-4c6f-4879-af7f-0785e3a09cc7 1073741824 Jul 10 06:46:59 devstack sudo[98632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:00 devstack sudo[98632]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-387ca23d-8c26-4681-a1fa-fcca846d260d tempest-VolumesTestJSON-1610010168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-016999ae-4c6f-4879-af7f-0785e3a09cc7 1073741824" returned: 0 in 1.560s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-387ca23d-8c26-4681-a1fa-fcca846d260d tempest-VolumesTestJSON-1610010168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-016999ae-4c6f-4879-af7f-0785e3a09cc7 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:00 devstack sudo[98640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-016999ae-4c6f-4879-af7f-0785e3a09cc7 Jul 10 06:47:00 devstack sudo[98640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:01 devstack sudo[98640]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-387ca23d-8c26-4681-a1fa-fcca846d260d tempest-VolumesTestJSON-1610010168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-016999ae-4c6f-4879-af7f-0785e3a09cc7" returned: 0 in 0.769s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:01 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-387ca23d-8c26-4681-a1fa-fcca846d260d tempest-VolumesTestJSON-1610010168 None] <== create_volume: return (2415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:47:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-387ca23d-8c26-4681-a1fa-fcca846d260d tempest-VolumesTestJSON-1610010168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.419s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-387ca23d-8c26-4681-a1fa-fcca846d260d tempest-VolumesTestJSON-1610010168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7ca781a-5526-47c8-965f-2e6a0eb9c34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-016999ae-4c6f-4879-af7f-0785e3a09cc7', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-387ca23d-8c26-4681-a1fa-fcca846d260d tempest-VolumesTestJSON-1610010168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5e4081d-16c8-4fdb-afb3-b40e5f3ec2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:01 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-387ca23d-8c26-4681-a1fa-fcca846d260d tempest-VolumesTestJSON-1610010168 None] Volume volume-016999ae-4c6f-4879-af7f-0785e3a09cc7 (016999ae-4c6f-4879-af7f-0785e3a09cc7): created successfully Jul 10 06:47:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-387ca23d-8c26-4681-a1fa-fcca846d260d tempest-VolumesTestJSON-1610010168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5e4081d-16c8-4fdb-afb3-b40e5f3ec2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-387ca23d-8c26-4681-a1fa-fcca846d260d tempest-VolumesTestJSON-1610010168 None] Flow 'volume_create_manager' (89830229-69f9-410c-8458-48466e5a8021) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:47:01 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-387ca23d-8c26-4681-a1fa-fcca846d260d tempest-VolumesTestJSON-1610010168 None] Created volume successfully. Jul 10 06:47:02 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-94ed5e48-da87-4d74-990d-5dce4f2c13aa tempest-VolumesTestJSON-1610010168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:47:03 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-94ed5e48-da87-4d74-990d-5dce4f2c13aa tempest-VolumesTestJSON-1610010168 None] Flow 'volume_create_manager' (43e54b5a-bdb2-4768-8c9d-4546e780da7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:47:03 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-94ed5e48-da87-4d74-990d-5dce4f2c13aa tempest-VolumesTestJSON-1610010168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fd6edfc-ead1-44c1-a1db-9286293ad378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:03 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-94ed5e48-da87-4d74-990d-5dce4f2c13aa tempest-VolumesTestJSON-1610010168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fd6edfc-ead1-44c1-a1db-9286293ad378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:47:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-328130540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b16b9fc-43af-4dbe-8214-72683337a23f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='707aa3a552ab41c7bb52a2f75278c98c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:47:03Z,use_quota=True,user_id='bc44d0909736406680932595edd4f28d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:03 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-94ed5e48-da87-4d74-990d-5dce4f2c13aa tempest-VolumesTestJSON-1610010168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed2b6c1a-7f4a-4959-8298-da39d32431ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:03 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-94ed5e48-da87-4d74-990d-5dce4f2c13aa tempest-VolumesTestJSON-1610010168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed2b6c1a-7f4a-4959-8298-da39d32431ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:03 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-94ed5e48-da87-4d74-990d-5dce4f2c13aa tempest-VolumesTestJSON-1610010168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b0d604a-fa41-4d1b-8592-0d6b01bf0906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:03 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-94ed5e48-da87-4d74-990d-5dce4f2c13aa tempest-VolumesTestJSON-1610010168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b0d604a-fa41-4d1b-8592-0d6b01bf0906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b16b9fc-43af-4dbe-8214-72683337a23f', 'volume_name': 'volume-6b16b9fc-43af-4dbe-8214-72683337a23f', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:03 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-94ed5e48-da87-4d74-990d-5dce4f2c13aa tempest-VolumesTestJSON-1610010168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a96ad638-8e86-4a5e-a850-4ad9ab9f73c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:03 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-94ed5e48-da87-4d74-990d-5dce4f2c13aa tempest-VolumesTestJSON-1610010168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a96ad638-8e86-4a5e-a850-4ad9ab9f73c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:03 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-94ed5e48-da87-4d74-990d-5dce4f2c13aa tempest-VolumesTestJSON-1610010168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2efc037-b6bb-4b17-9523-eda55f199df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:03 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-94ed5e48-da87-4d74-990d-5dce4f2c13aa tempest-VolumesTestJSON-1610010168 None] Volume 6b16b9fc-43af-4dbe-8214-72683337a23f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b16b9fc-43af-4dbe-8214-72683337a23f', 'volume_size': 1} Jul 10 06:47:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-94ed5e48-da87-4d74-990d-5dce4f2c13aa tempest-VolumesTestJSON-1610010168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-94ed5e48-da87-4d74-990d-5dce4f2c13aa tempest-VolumesTestJSON-1610010168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:03 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-94ed5e48-da87-4d74-990d-5dce4f2c13aa tempest-VolumesTestJSON-1610010168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:47:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-328130540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b16b9fc-43af-4dbe-8214-72683337a23f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='707aa3a552ab41c7bb52a2f75278c98c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:47:03Z,use_quota=True,user_id='bc44d0909736406680932595edd4f28d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:47:03 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-94ed5e48-da87-4d74-990d-5dce4f2c13aa tempest-VolumesTestJSON-1610010168 None] Creating volume 6b16b9fc-43af-4dbe-8214-72683337a23f {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:47:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-94ed5e48-da87-4d74-990d-5dce4f2c13aa tempest-VolumesTestJSON-1610010168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-94ed5e48-da87-4d74-990d-5dce4f2c13aa tempest-VolumesTestJSON-1610010168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:03 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-94ed5e48-da87-4d74-990d-5dce4f2c13aa tempest-VolumesTestJSON-1610010168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:47:03 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-94ed5e48-da87-4d74-990d-5dce4f2c13aa tempest-VolumesTestJSON-1610010168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:47:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-94ed5e48-da87-4d74-990d-5dce4f2c13aa tempest-VolumesTestJSON-1610010168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:03 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-94ed5e48-da87-4d74-990d-5dce4f2c13aa tempest-VolumesTestJSON-1610010168 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:47:03 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-94ed5e48-da87-4d74-990d-5dce4f2c13aa tempest-VolumesTestJSON-1610010168 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:47:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-94ed5e48-da87-4d74-990d-5dce4f2c13aa tempest-VolumesTestJSON-1610010168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6b16b9fc-43af-4dbe-8214-72683337a23f 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:03 devstack sudo[98643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6b16b9fc-43af-4dbe-8214-72683337a23f 1073741824 Jul 10 06:47:03 devstack sudo[98643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:04 devstack sudo[98643]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-94ed5e48-da87-4d74-990d-5dce4f2c13aa tempest-VolumesTestJSON-1610010168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6b16b9fc-43af-4dbe-8214-72683337a23f 1073741824" returned: 0 in 1.508s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-94ed5e48-da87-4d74-990d-5dce4f2c13aa tempest-VolumesTestJSON-1610010168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6b16b9fc-43af-4dbe-8214-72683337a23f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:04 devstack sudo[98649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6b16b9fc-43af-4dbe-8214-72683337a23f Jul 10 06:47:04 devstack sudo[98649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:05 devstack sudo[98649]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-94ed5e48-da87-4d74-990d-5dce4f2c13aa tempest-VolumesTestJSON-1610010168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6b16b9fc-43af-4dbe-8214-72683337a23f" returned: 0 in 1.071s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:05 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-94ed5e48-da87-4d74-990d-5dce4f2c13aa tempest-VolumesTestJSON-1610010168 None] <== create_volume: return (2643ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:47:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-94ed5e48-da87-4d74-990d-5dce4f2c13aa tempest-VolumesTestJSON-1610010168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.649s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:05 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-94ed5e48-da87-4d74-990d-5dce4f2c13aa tempest-VolumesTestJSON-1610010168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2efc037-b6bb-4b17-9523-eda55f199df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b16b9fc-43af-4dbe-8214-72683337a23f', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:05 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-94ed5e48-da87-4d74-990d-5dce4f2c13aa tempest-VolumesTestJSON-1610010168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a293c33b-4460-4c31-902f-598d6ba1531d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:05 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-94ed5e48-da87-4d74-990d-5dce4f2c13aa tempest-VolumesTestJSON-1610010168 None] Volume volume-6b16b9fc-43af-4dbe-8214-72683337a23f (6b16b9fc-43af-4dbe-8214-72683337a23f): created successfully Jul 10 06:47:05 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-94ed5e48-da87-4d74-990d-5dce4f2c13aa tempest-VolumesTestJSON-1610010168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a293c33b-4460-4c31-902f-598d6ba1531d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:05 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-94ed5e48-da87-4d74-990d-5dce4f2c13aa tempest-VolumesTestJSON-1610010168 None] Flow 'volume_create_manager' (43e54b5a-bdb2-4768-8c9d-4546e780da7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:47:05 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-94ed5e48-da87-4d74-990d-5dce4f2c13aa tempest-VolumesTestJSON-1610010168 None] Created volume successfully. Jul 10 06:47:07 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f37c7d07-48e9-404e-a409-df3af4bb2967 tempest-VolumesTestJSON-1610010168 None] Acquiring lock "cinder-6b16b9fc-43af-4dbe-8214-72683337a23f-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:47:07 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f37c7d07-48e9-404e-a409-df3af4bb2967 tempest-VolumesTestJSON-1610010168 None] Lock "cinder-6b16b9fc-43af-4dbe-8214-72683337a23f-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:47:07 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f37c7d07-48e9-404e-a409-df3af4bb2967 tempest-VolumesTestJSON-1610010168 None] Acquiring lock "cinder-quobyte-6b16b9fc-43af-4dbe-8214-72683337a23f" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:47:07 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f37c7d07-48e9-404e-a409-df3af4bb2967 tempest-VolumesTestJSON-1610010168 None] Lock "cinder-quobyte-6b16b9fc-43af-4dbe-8214-72683337a23f" acquired by "delete_volume" :: waited 0.016s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:47:07 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bfae48-52e9-4644-b04a-f4e00795ec56]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:47:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f37c7d07-48e9-404e-a409-df3af4bb2967 tempest-VolumesTestJSON-1610010168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6b16b9fc-43af-4dbe-8214-72683337a23f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:08 devstack sudo[98652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6b16b9fc-43af-4dbe-8214-72683337a23f Jul 10 06:47:08 devstack sudo[98652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:09 devstack sudo[98652]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f37c7d07-48e9-404e-a409-df3af4bb2967 tempest-VolumesTestJSON-1610010168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6b16b9fc-43af-4dbe-8214-72683337a23f" returned: 0 in 1.192s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f37c7d07-48e9-404e-a409-df3af4bb2967 tempest-VolumesTestJSON-1610010168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6b16b9fc-43af-4dbe-8214-72683337a23f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:09 devstack sudo[98657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6b16b9fc-43af-4dbe-8214-72683337a23f Jul 10 06:47:09 devstack sudo[98657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:10 devstack sudo[98657]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f37c7d07-48e9-404e-a409-df3af4bb2967 tempest-VolumesTestJSON-1610010168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6b16b9fc-43af-4dbe-8214-72683337a23f" returned: 0 in 0.932s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:10 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f37c7d07-48e9-404e-a409-df3af4bb2967 tempest-VolumesTestJSON-1610010168 None] Lock "cinder-quobyte-6b16b9fc-43af-4dbe-8214-72683337a23f" released by "delete_volume" :: held 2.197s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:47:10 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-f37c7d07-48e9-404e-a409-df3af4bb2967 tempest-VolumesTestJSON-1610010168 None] Created reservations ['8ee19376-af86-4eaf-927c-1810f826831d', '6ef918bb-39ed-4d46-8ff0-a1ede574bb6a', 'f34458c3-971b-4d48-86cf-b90423dc67af', 'a61b9afc-fd83-4d0f-aa83-6ac1ee824434'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:47:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f37c7d07-48e9-404e-a409-df3af4bb2967 tempest-VolumesTestJSON-1610010168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f37c7d07-48e9-404e-a409-df3af4bb2967 tempest-VolumesTestJSON-1610010168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:10 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f37c7d07-48e9-404e-a409-df3af4bb2967 tempest-VolumesTestJSON-1610010168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:47:10 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f37c7d07-48e9-404e-a409-df3af4bb2967 tempest-VolumesTestJSON-1610010168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:47:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f37c7d07-48e9-404e-a409-df3af4bb2967 tempest-VolumesTestJSON-1610010168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f37c7d07-48e9-404e-a409-df3af4bb2967 tempest-VolumesTestJSON-1610010168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:10 devstack sudo[98687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:47:10 devstack sudo[98687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:11 devstack sudo[98687]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f37c7d07-48e9-404e-a409-df3af4bb2967 tempest-VolumesTestJSON-1610010168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.995s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:11 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-f37c7d07-48e9-404e-a409-df3af4bb2967 tempest-VolumesTestJSON-1610010168 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:47:11 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-f37c7d07-48e9-404e-a409-df3af4bb2967 tempest-VolumesTestJSON-1610010168 None] Deleted volume successfully. Jul 10 06:47:11 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:UPDATE=110,cinder:SELECT=84,cinder:DELETE=11,cinder:INSERT=33 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:47:11 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f37c7d07-48e9-404e-a409-df3af4bb2967 tempest-VolumesTestJSON-1610010168 None] Lock "cinder-6b16b9fc-43af-4dbe-8214-72683337a23f-delete_volume" released by "delete_volume" :: held 3.594s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:47:11 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e9b1e7af-34bf-4aee-ac5f-d1cc66fef1ac tempest-VolumesTestJSON-1610010168 None] Acquiring lock "cinder-016999ae-4c6f-4879-af7f-0785e3a09cc7-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:47:11 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e9b1e7af-34bf-4aee-ac5f-d1cc66fef1ac tempest-VolumesTestJSON-1610010168 None] Lock "cinder-016999ae-4c6f-4879-af7f-0785e3a09cc7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:47:11 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e9b1e7af-34bf-4aee-ac5f-d1cc66fef1ac tempest-VolumesTestJSON-1610010168 None] Acquiring lock "cinder-quobyte-016999ae-4c6f-4879-af7f-0785e3a09cc7" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:47:11 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e9b1e7af-34bf-4aee-ac5f-d1cc66fef1ac tempest-VolumesTestJSON-1610010168 None] Lock "cinder-quobyte-016999ae-4c6f-4879-af7f-0785e3a09cc7" acquired by "delete_volume" :: waited 0.035s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:47:11 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7d6c61-c2e9-49d3-8b47-3d80d2e63540]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:47:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e9b1e7af-34bf-4aee-ac5f-d1cc66fef1ac tempest-VolumesTestJSON-1610010168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-016999ae-4c6f-4879-af7f-0785e3a09cc7 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:11 devstack sudo[98755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-016999ae-4c6f-4879-af7f-0785e3a09cc7 Jul 10 06:47:11 devstack sudo[98755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:12 devstack sudo[98755]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e9b1e7af-34bf-4aee-ac5f-d1cc66fef1ac tempest-VolumesTestJSON-1610010168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-016999ae-4c6f-4879-af7f-0785e3a09cc7" returned: 0 in 1.200s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e9b1e7af-34bf-4aee-ac5f-d1cc66fef1ac tempest-VolumesTestJSON-1610010168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-016999ae-4c6f-4879-af7f-0785e3a09cc7 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:12 devstack sudo[98760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-016999ae-4c6f-4879-af7f-0785e3a09cc7 Jul 10 06:47:12 devstack sudo[98760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:13 devstack sudo[98760]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e9b1e7af-34bf-4aee-ac5f-d1cc66fef1ac tempest-VolumesTestJSON-1610010168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-016999ae-4c6f-4879-af7f-0785e3a09cc7" returned: 0 in 0.804s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:13 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e9b1e7af-34bf-4aee-ac5f-d1cc66fef1ac tempest-VolumesTestJSON-1610010168 None] Lock "cinder-quobyte-016999ae-4c6f-4879-af7f-0785e3a09cc7" released by "delete_volume" :: held 2.073s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:47:13 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-e9b1e7af-34bf-4aee-ac5f-d1cc66fef1ac tempest-VolumesTestJSON-1610010168 None] Created reservations ['aed56dc2-88e6-41e4-a1e5-97f9bcbcf897', 'edbe13e4-3835-4b98-907d-273976116c22', '8cb98c64-fc70-41b4-a480-339367f51bb3', 'b2031feb-2a8c-456d-9c16-1ba544b18677'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:47:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e9b1e7af-34bf-4aee-ac5f-d1cc66fef1ac tempest-VolumesTestJSON-1610010168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e9b1e7af-34bf-4aee-ac5f-d1cc66fef1ac tempest-VolumesTestJSON-1610010168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:13 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-e9b1e7af-34bf-4aee-ac5f-d1cc66fef1ac tempest-VolumesTestJSON-1610010168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:47:13 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-e9b1e7af-34bf-4aee-ac5f-d1cc66fef1ac tempest-VolumesTestJSON-1610010168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:47:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e9b1e7af-34bf-4aee-ac5f-d1cc66fef1ac tempest-VolumesTestJSON-1610010168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e9b1e7af-34bf-4aee-ac5f-d1cc66fef1ac tempest-VolumesTestJSON-1610010168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:13 devstack sudo[98763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:47:13 devstack sudo[98763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:14 devstack sudo[98763]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e9b1e7af-34bf-4aee-ac5f-d1cc66fef1ac tempest-VolumesTestJSON-1610010168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.794s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:14 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-e9b1e7af-34bf-4aee-ac5f-d1cc66fef1ac tempest-VolumesTestJSON-1610010168 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:47:14 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-e9b1e7af-34bf-4aee-ac5f-d1cc66fef1ac tempest-VolumesTestJSON-1610010168 None] Deleted volume successfully. Jul 10 06:47:14 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e9b1e7af-34bf-4aee-ac5f-d1cc66fef1ac tempest-VolumesTestJSON-1610010168 None] Lock "cinder-016999ae-4c6f-4879-af7f-0785e3a09cc7-delete_volume" released by "delete_volume" :: held 3.219s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:47:14 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-870adfff-c730-41fc-8d0b-05e9a19dbfc9 tempest-VolumesTestJSON-1610010168 None] Acquiring lock "cinder-6184210e-d193-4277-9ac6-854978fb86e0-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:47:14 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-870adfff-c730-41fc-8d0b-05e9a19dbfc9 tempest-VolumesTestJSON-1610010168 None] Lock "cinder-6184210e-d193-4277-9ac6-854978fb86e0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:47:15 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-870adfff-c730-41fc-8d0b-05e9a19dbfc9 tempest-VolumesTestJSON-1610010168 None] Acquiring lock "cinder-quobyte-6184210e-d193-4277-9ac6-854978fb86e0" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:47:15 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-870adfff-c730-41fc-8d0b-05e9a19dbfc9 tempest-VolumesTestJSON-1610010168 None] Lock "cinder-quobyte-6184210e-d193-4277-9ac6-854978fb86e0" acquired by "delete_volume" :: waited 0.020s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:47:15 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb77847b-f409-44c6-bad2-7ebcb1830d2d]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:47:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-870adfff-c730-41fc-8d0b-05e9a19dbfc9 tempest-VolumesTestJSON-1610010168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6184210e-d193-4277-9ac6-854978fb86e0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:15 devstack sudo[98767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6184210e-d193-4277-9ac6-854978fb86e0 Jul 10 06:47:15 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:16 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-870adfff-c730-41fc-8d0b-05e9a19dbfc9 tempest-VolumesTestJSON-1610010168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6184210e-d193-4277-9ac6-854978fb86e0" returned: 0 in 1.090s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-870adfff-c730-41fc-8d0b-05e9a19dbfc9 tempest-VolumesTestJSON-1610010168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6184210e-d193-4277-9ac6-854978fb86e0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:16 devstack sudo[98772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6184210e-d193-4277-9ac6-854978fb86e0 Jul 10 06:47:16 devstack sudo[98772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:17 devstack sudo[98772]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-870adfff-c730-41fc-8d0b-05e9a19dbfc9 tempest-VolumesTestJSON-1610010168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6184210e-d193-4277-9ac6-854978fb86e0" returned: 0 in 0.929s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:17 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-870adfff-c730-41fc-8d0b-05e9a19dbfc9 tempest-VolumesTestJSON-1610010168 None] Lock "cinder-quobyte-6184210e-d193-4277-9ac6-854978fb86e0" released by "delete_volume" :: held 2.092s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:47:17 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-870adfff-c730-41fc-8d0b-05e9a19dbfc9 tempest-VolumesTestJSON-1610010168 None] Created reservations ['e48a3284-482d-43b2-a45c-0c1fa556c71c', '874a7e35-9904-475e-a297-a88ba6deedea', '5b6a18d4-8824-4f4b-ad8c-01c5a284e086', '75a6321b-c006-4f1b-b77d-770898e05086'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:47:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-870adfff-c730-41fc-8d0b-05e9a19dbfc9 tempest-VolumesTestJSON-1610010168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-870adfff-c730-41fc-8d0b-05e9a19dbfc9 tempest-VolumesTestJSON-1610010168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:17 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-870adfff-c730-41fc-8d0b-05e9a19dbfc9 tempest-VolumesTestJSON-1610010168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:47:17 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-870adfff-c730-41fc-8d0b-05e9a19dbfc9 tempest-VolumesTestJSON-1610010168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:47:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-870adfff-c730-41fc-8d0b-05e9a19dbfc9 tempest-VolumesTestJSON-1610010168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-870adfff-c730-41fc-8d0b-05e9a19dbfc9 tempest-VolumesTestJSON-1610010168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:17 devstack sudo[98775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:47:17 devstack sudo[98775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:18 devstack sudo[98775]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-870adfff-c730-41fc-8d0b-05e9a19dbfc9 tempest-VolumesTestJSON-1610010168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.059s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:18 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-870adfff-c730-41fc-8d0b-05e9a19dbfc9 tempest-VolumesTestJSON-1610010168 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:47:18 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-870adfff-c730-41fc-8d0b-05e9a19dbfc9 tempest-VolumesTestJSON-1610010168 None] Deleted volume successfully. Jul 10 06:47:18 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-870adfff-c730-41fc-8d0b-05e9a19dbfc9 tempest-VolumesTestJSON-1610010168 None] Lock "cinder-6184210e-d193-4277-9ac6-854978fb86e0-delete_volume" released by "delete_volume" :: held 3.603s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:47:21 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:47:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:47:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:47:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:21 devstack sudo[98818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:47:21 devstack sudo[98818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:23 devstack sudo[98818]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.141s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:23 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:47:23 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager._thread_info {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:47:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread count: 28 {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:47:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread info: [<_MainThread(MainThread, started 139245706264704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:47:24 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-90dc5dbd-2fb0-4692-aea5-4609c1137d8c tempest-TestStampPattern-1951221454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:47:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-90dc5dbd-2fb0-4692-aea5-4609c1137d8c tempest-TestStampPattern-1951221454 None] Flow 'volume_create_manager' (373060ab-faee-4e4b-a858-46e88fdf8ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:47:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-90dc5dbd-2fb0-4692-aea5-4609c1137d8c tempest-TestStampPattern-1951221454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1d4cd73-5d50-49b0-adbf-d158d97fa423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-90dc5dbd-2fb0-4692-aea5-4609c1137d8c tempest-TestStampPattern-1951221454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1d4cd73-5d50-49b0-adbf-d158d97fa423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-457744532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01abf5b3c15c4a19aa038505bd0b68e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:47:24Z,use_quota=True,user_id='d3d93bd21b904e01ae44515bc78d151f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-90dc5dbd-2fb0-4692-aea5-4609c1137d8c tempest-TestStampPattern-1951221454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74d4e213-90bf-4fca-b360-a863a9a1b9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-90dc5dbd-2fb0-4692-aea5-4609c1137d8c tempest-TestStampPattern-1951221454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74d4e213-90bf-4fca-b360-a863a9a1b9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-90dc5dbd-2fb0-4692-aea5-4609c1137d8c tempest-TestStampPattern-1951221454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f444aa1f-39ec-48f6-9710-a3ba96c2f754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-90dc5dbd-2fb0-4692-aea5-4609c1137d8c tempest-TestStampPattern-1951221454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f444aa1f-39ec-48f6-9710-a3ba96c2f754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8', 'volume_name': 'volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-90dc5dbd-2fb0-4692-aea5-4609c1137d8c tempest-TestStampPattern-1951221454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44d0ec23-c11d-43da-8860-8522fa04a834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-90dc5dbd-2fb0-4692-aea5-4609c1137d8c tempest-TestStampPattern-1951221454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44d0ec23-c11d-43da-8860-8522fa04a834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-90dc5dbd-2fb0-4692-aea5-4609c1137d8c tempest-TestStampPattern-1951221454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fac0cc2-f65f-44df-907f-b041f44a5e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:24 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-90dc5dbd-2fb0-4692-aea5-4609c1137d8c tempest-TestStampPattern-1951221454 None] Volume 2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8', 'volume_size': 1} Jul 10 06:47:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-90dc5dbd-2fb0-4692-aea5-4609c1137d8c tempest-TestStampPattern-1951221454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-90dc5dbd-2fb0-4692-aea5-4609c1137d8c tempest-TestStampPattern-1951221454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:24 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-90dc5dbd-2fb0-4692-aea5-4609c1137d8c tempest-TestStampPattern-1951221454 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-457744532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01abf5b3c15c4a19aa038505bd0b68e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:47:24Z,use_quota=True,user_id='d3d93bd21b904e01ae44515bc78d151f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:47:24 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-90dc5dbd-2fb0-4692-aea5-4609c1137d8c tempest-TestStampPattern-1951221454 None] Creating volume 2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:47:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-90dc5dbd-2fb0-4692-aea5-4609c1137d8c tempest-TestStampPattern-1951221454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-90dc5dbd-2fb0-4692-aea5-4609c1137d8c tempest-TestStampPattern-1951221454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:24 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-90dc5dbd-2fb0-4692-aea5-4609c1137d8c tempest-TestStampPattern-1951221454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:47:24 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-90dc5dbd-2fb0-4692-aea5-4609c1137d8c tempest-TestStampPattern-1951221454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:47:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-90dc5dbd-2fb0-4692-aea5-4609c1137d8c tempest-TestStampPattern-1951221454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:24 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-90dc5dbd-2fb0-4692-aea5-4609c1137d8c tempest-TestStampPattern-1951221454 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:47:24 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-90dc5dbd-2fb0-4692-aea5-4609c1137d8c tempest-TestStampPattern-1951221454 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:47:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-90dc5dbd-2fb0-4692-aea5-4609c1137d8c tempest-TestStampPattern-1951221454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:24 devstack sudo[98823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8 1073741824 Jul 10 06:47:24 devstack sudo[98823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:25 devstack sudo[98823]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-90dc5dbd-2fb0-4692-aea5-4609c1137d8c tempest-TestStampPattern-1951221454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8 1073741824" returned: 0 in 1.170s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-90dc5dbd-2fb0-4692-aea5-4609c1137d8c tempest-TestStampPattern-1951221454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:25 devstack sudo[98830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8 Jul 10 06:47:25 devstack sudo[98830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:26 devstack sudo[98830]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-90dc5dbd-2fb0-4692-aea5-4609c1137d8c tempest-TestStampPattern-1951221454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8" returned: 0 in 1.005s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:26 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-90dc5dbd-2fb0-4692-aea5-4609c1137d8c tempest-TestStampPattern-1951221454 None] <== create_volume: return (2268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:47:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-90dc5dbd-2fb0-4692-aea5-4609c1137d8c tempest-TestStampPattern-1951221454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.271s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-90dc5dbd-2fb0-4692-aea5-4609c1137d8c tempest-TestStampPattern-1951221454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fac0cc2-f65f-44df-907f-b041f44a5e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-90dc5dbd-2fb0-4692-aea5-4609c1137d8c tempest-TestStampPattern-1951221454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e55fb8a-8eae-4a3b-9ee8-3093453b8369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:26 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-90dc5dbd-2fb0-4692-aea5-4609c1137d8c tempest-TestStampPattern-1951221454 None] Volume volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8 (2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8): created successfully Jul 10 06:47:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-90dc5dbd-2fb0-4692-aea5-4609c1137d8c tempest-TestStampPattern-1951221454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e55fb8a-8eae-4a3b-9ee8-3093453b8369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-90dc5dbd-2fb0-4692-aea5-4609c1137d8c tempest-TestStampPattern-1951221454 None] Flow 'volume_create_manager' (373060ab-faee-4e4b-a858-46e88fdf8ea4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:47:26 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-90dc5dbd-2fb0-4692-aea5-4609c1137d8c tempest-TestStampPattern-1951221454 None] Created volume successfully. Jul 10 06:47:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-d38ccc44-77f7-46fc-bd8b-bb7dc62aa0f6 req-e80e7e6f-ae3e-4f96-b4b7-7116d311e6e0 tempest-TestInstancesWithCinderVolumes-177535336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-d38ccc44-77f7-46fc-bd8b-bb7dc62aa0f6 req-e80e7e6f-ae3e-4f96-b4b7-7116d311e6e0 tempest-TestInstancesWithCinderVolumes-177535336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:29 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[35359396-5096-4d32-b8d3-c6c2d5def66e]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:47:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-d38ccc44-77f7-46fc-bd8b-bb7dc62aa0f6 req-e80e7e6f-ae3e-4f96-b4b7-7116d311e6e0 tempest-TestInstancesWithCinderVolumes-177535336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-653c787e-bd21-4fd0-abd9-4de9209cfe7a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:30 devstack sudo[98852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-653c787e-bd21-4fd0-abd9-4de9209cfe7a Jul 10 06:47:30 devstack sudo[98852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:31 devstack sudo[98852]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-d38ccc44-77f7-46fc-bd8b-bb7dc62aa0f6 req-e80e7e6f-ae3e-4f96-b4b7-7116d311e6e0 tempest-TestInstancesWithCinderVolumes-177535336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-653c787e-bd21-4fd0-abd9-4de9209cfe7a" returned: 0 in 1.216s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-d38ccc44-77f7-46fc-bd8b-bb7dc62aa0f6 req-e80e7e6f-ae3e-4f96-b4b7-7116d311e6e0 tempest-TestInstancesWithCinderVolumes-177535336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.243s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-d38ccc44-77f7-46fc-bd8b-bb7dc62aa0f6 req-e80e7e6f-ae3e-4f96-b4b7-7116d311e6e0 tempest-TestInstancesWithCinderVolumes-177535336 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804', 'name': 'volume-653c787e-bd21-4fd0-abd9-4de9209cfe7a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fa2dc6a4-09ae-4d6d-9e1f-f73f8f5e7578', 'enforce_multipath': True} {{(pid=87294) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:47:31 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-d38ccc44-77f7-46fc-bd8b-bb7dc62aa0f6 req-e80e7e6f-ae3e-4f96-b4b7-7116d311e6e0 tempest-TestInstancesWithCinderVolumes-177535336 None] attachment_update completed successfully. Jul 10 06:47:32 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-627bf314-9787-4277-8a98-86a56c3d6485 tempest-GroupSnapshotsTest-440840859 None] Group tempest-GroupSnapshotsTest-Group-742854168: creating Jul 10 06:47:33 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-627bf314-9787-4277-8a98-86a56c3d6485 tempest-GroupSnapshotsTest-440840859 None] Group tempest-GroupSnapshotsTest-Group-742854168: created successfully Jul 10 06:47:33 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-627bf314-9787-4277-8a98-86a56c3d6485 tempest-GroupSnapshotsTest-440840859 None] Create group completed successfully. Jul 10 06:47:34 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f89cf69-1531-4698-9280-dcb915a36428 tempest-GroupSnapshotsTest-440840859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:47:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6f89cf69-1531-4698-9280-dcb915a36428 tempest-GroupSnapshotsTest-440840859 None] Flow 'volume_create_manager' (17968db0-aacc-4384-a918-d6b75d3f07b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:47:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6f89cf69-1531-4698-9280-dcb915a36428 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a612a88-eff3-429e-94b2-584ac368e0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6f89cf69-1531-4698-9280-dcb915a36428 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a612a88-eff3-429e-94b2-584ac368e0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:47:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1741142235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=41728542-50e5-4be2-97b8-ddcb917c3514,host='devstack@QuobyteHD#QuobyteHD',id=43a1fd7b-50fc-428b-9b00-1fa39ea0489f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d433420cfd44bd99269f5c8cbd29d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:47:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:47:35Z,use_quota=True,user_id='5ab5cf40b4b0457990e4198e0c84b17d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c65ec4-3328-4475-b4c0-81f6775ed5cb),volume_type_id=57c65ec4-3328-4475-b4c0-81f6775ed5cb)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6f89cf69-1531-4698-9280-dcb915a36428 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (067241e9-cc1e-49cd-be8e-4658084429e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6f89cf69-1531-4698-9280-dcb915a36428 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (067241e9-cc1e-49cd-be8e-4658084429e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6f89cf69-1531-4698-9280-dcb915a36428 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4e8a36d-2310-443d-9895-4116e7ad353c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6f89cf69-1531-4698-9280-dcb915a36428 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4e8a36d-2310-443d-9895-4116e7ad353c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43a1fd7b-50fc-428b-9b00-1fa39ea0489f', 'volume_name': 'volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6f89cf69-1531-4698-9280-dcb915a36428 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0373e3c-9f1e-4b88-ada1-401ac83cd121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6f89cf69-1531-4698-9280-dcb915a36428 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0373e3c-9f1e-4b88-ada1-401ac83cd121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6f89cf69-1531-4698-9280-dcb915a36428 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (072668c4-31ae-4d70-a50a-67ca3a508818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:35 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-6f89cf69-1531-4698-9280-dcb915a36428 tempest-GroupSnapshotsTest-440840859 None] Volume 43a1fd7b-50fc-428b-9b00-1fa39ea0489f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f', 'volume_size': 1} Jul 10 06:47:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-6f89cf69-1531-4698-9280-dcb915a36428 tempest-GroupSnapshotsTest-440840859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-6f89cf69-1531-4698-9280-dcb915a36428 tempest-GroupSnapshotsTest-440840859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:35 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-6f89cf69-1531-4698-9280-dcb915a36428 tempest-GroupSnapshotsTest-440840859 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=41728542-50e5-4be2-97b8-ddcb917c3514,created_at=2026-07-10T04:47:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1741142235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=41728542-50e5-4be2-97b8-ddcb917c3514,host='devstack@QuobyteHD#QuobyteHD',id=43a1fd7b-50fc-428b-9b00-1fa39ea0489f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d433420cfd44bd99269f5c8cbd29d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:47:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:47:35Z,use_quota=True,user_id='5ab5cf40b4b0457990e4198e0c84b17d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c65ec4-3328-4475-b4c0-81f6775ed5cb),volume_type_id=57c65ec4-3328-4475-b4c0-81f6775ed5cb)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:47:35 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-6f89cf69-1531-4698-9280-dcb915a36428 tempest-GroupSnapshotsTest-440840859 None] Creating volume 43a1fd7b-50fc-428b-9b00-1fa39ea0489f {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:47:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-6f89cf69-1531-4698-9280-dcb915a36428 tempest-GroupSnapshotsTest-440840859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-6f89cf69-1531-4698-9280-dcb915a36428 tempest-GroupSnapshotsTest-440840859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:35 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-6f89cf69-1531-4698-9280-dcb915a36428 tempest-GroupSnapshotsTest-440840859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:47:35 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-6f89cf69-1531-4698-9280-dcb915a36428 tempest-GroupSnapshotsTest-440840859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:47:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-6f89cf69-1531-4698-9280-dcb915a36428 tempest-GroupSnapshotsTest-440840859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:35 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-6f89cf69-1531-4698-9280-dcb915a36428 tempest-GroupSnapshotsTest-440840859 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:47:35 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-6f89cf69-1531-4698-9280-dcb915a36428 tempest-GroupSnapshotsTest-440840859 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:47:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6f89cf69-1531-4698-9280-dcb915a36428 tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:35 devstack sudo[98884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f 1073741824 Jul 10 06:47:35 devstack sudo[98884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:35 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a358b92-5670-4c27-b1b9-48fbbf700602 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:47:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7a358b92-5670-4c27-b1b9-48fbbf700602 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Flow 'volume_create_manager' (03eb48e5-a252-4cd9-9ee9-162247f7d2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:47:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7a358b92-5670-4c27-b1b9-48fbbf700602 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b311aac6-77ac-47e1-86bc-3bca998cf43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7a358b92-5670-4c27-b1b9-48fbbf700602 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b311aac6-77ac-47e1-86bc-3bca998cf43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:47:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-544853924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a65c7665-8867-4a0a-8c90-dac792e801bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4c8312243a8469ba000bd2413cad633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:47:36Z,use_quota=True,user_id='d381d14075f940e197c25a7c12ab5b2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7a358b92-5670-4c27-b1b9-48fbbf700602 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24b3ef13-96f1-4841-b3e0-1b80a10c7fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7a358b92-5670-4c27-b1b9-48fbbf700602 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24b3ef13-96f1-4841-b3e0-1b80a10c7fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7a358b92-5670-4c27-b1b9-48fbbf700602 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb9b7c8b-7446-442d-a4bf-9a6491d800d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7a358b92-5670-4c27-b1b9-48fbbf700602 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb9b7c8b-7446-442d-a4bf-9a6491d800d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a65c7665-8867-4a0a-8c90-dac792e801bb', 'volume_name': 'volume-a65c7665-8867-4a0a-8c90-dac792e801bb', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7a358b92-5670-4c27-b1b9-48fbbf700602 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f095a21c-bd18-45d3-bb64-af0ce139a728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7a358b92-5670-4c27-b1b9-48fbbf700602 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f095a21c-bd18-45d3-bb64-af0ce139a728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7a358b92-5670-4c27-b1b9-48fbbf700602 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baca44f2-3971-401d-a3e4-dccfcbf6dd59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:35 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-7a358b92-5670-4c27-b1b9-48fbbf700602 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Volume a65c7665-8867-4a0a-8c90-dac792e801bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a65c7665-8867-4a0a-8c90-dac792e801bb', 'volume_size': 1} Jul 10 06:47:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7a358b92-5670-4c27-b1b9-48fbbf700602 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:36 devstack sudo[98884]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6f89cf69-1531-4698-9280-dcb915a36428 tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f 1073741824" returned: 0 in 1.218s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6f89cf69-1531-4698-9280-dcb915a36428 tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:36 devstack sudo[98898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f Jul 10 06:47:36 devstack sudo[98898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:36 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-b82d228d-c720-41ef-ba4d-f7f13843a0d5 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:47:36 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b82d228d-c720-41ef-ba4d-f7f13843a0d5 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Flow 'volume_create_manager' (cdb53947-0736-4bd3-a84b-86af45f61e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:47:36 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b82d228d-c720-41ef-ba4d-f7f13843a0d5 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0273de6b-d484-4d3e-b907-71e521b1982c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:36 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b82d228d-c720-41ef-ba4d-f7f13843a0d5 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0273de6b-d484-4d3e-b907-71e521b1982c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:47:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2145759937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=097fce46-4bd1-4005-839c-cc6c88225274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4c8312243a8469ba000bd2413cad633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:47:36Z,use_quota=True,user_id='d381d14075f940e197c25a7c12ab5b2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:36 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b82d228d-c720-41ef-ba4d-f7f13843a0d5 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e1eb1b-6bda-4ffc-b834-cf0583506490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:36 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b82d228d-c720-41ef-ba4d-f7f13843a0d5 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56e1eb1b-6bda-4ffc-b834-cf0583506490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:36 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b82d228d-c720-41ef-ba4d-f7f13843a0d5 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (523b9e10-f288-40c0-8bff-9158c72072ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:36 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b82d228d-c720-41ef-ba4d-f7f13843a0d5 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (523b9e10-f288-40c0-8bff-9158c72072ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '097fce46-4bd1-4005-839c-cc6c88225274', 'volume_name': 'volume-097fce46-4bd1-4005-839c-cc6c88225274', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:36 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b82d228d-c720-41ef-ba4d-f7f13843a0d5 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bebafe03-4833-456a-aa67-53b1d9a9c72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:36 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b82d228d-c720-41ef-ba4d-f7f13843a0d5 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bebafe03-4833-456a-aa67-53b1d9a9c72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:36 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b82d228d-c720-41ef-ba4d-f7f13843a0d5 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05d72b88-6f13-4f50-83ae-f9a86c91cb37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:36 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-b82d228d-c720-41ef-ba4d-f7f13843a0d5 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Volume 097fce46-4bd1-4005-839c-cc6c88225274: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-097fce46-4bd1-4005-839c-cc6c88225274', 'volume_size': 1} Jul 10 06:47:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b82d228d-c720-41ef-ba4d-f7f13843a0d5 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:37 devstack sudo[98898]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6f89cf69-1531-4698-9280-dcb915a36428 tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f" returned: 0 in 0.988s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:37 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-6f89cf69-1531-4698-9280-dcb915a36428 tempest-GroupSnapshotsTest-440840859 None] <== create_volume: return (2276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:47:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-6f89cf69-1531-4698-9280-dcb915a36428 tempest-GroupSnapshotsTest-440840859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.281s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7a358b92-5670-4c27-b1b9-48fbbf700602 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.554s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:37 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-7a358b92-5670-4c27-b1b9-48fbbf700602 tempest-TestServerVolumeAttachmentScenario-1734695340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:47:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-544853924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a65c7665-8867-4a0a-8c90-dac792e801bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4c8312243a8469ba000bd2413cad633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:47:36Z,use_quota=True,user_id='d381d14075f940e197c25a7c12ab5b2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:47:37 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-7a358b92-5670-4c27-b1b9-48fbbf700602 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Creating volume a65c7665-8867-4a0a-8c90-dac792e801bb {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:47:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7a358b92-5670-4c27-b1b9-48fbbf700602 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7a358b92-5670-4c27-b1b9-48fbbf700602 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:37 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-7a358b92-5670-4c27-b1b9-48fbbf700602 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:47:37 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-7a358b92-5670-4c27-b1b9-48fbbf700602 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:47:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7a358b92-5670-4c27-b1b9-48fbbf700602 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:37 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-7a358b92-5670-4c27-b1b9-48fbbf700602 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:47:37 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-7a358b92-5670-4c27-b1b9-48fbbf700602 tempest-TestServerVolumeAttachmentScenario-1734695340 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:47:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7a358b92-5670-4c27-b1b9-48fbbf700602 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a65c7665-8867-4a0a-8c90-dac792e801bb 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:37 devstack sudo[98901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a65c7665-8867-4a0a-8c90-dac792e801bb 1073741824 Jul 10 06:47:37 devstack sudo[98901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6f89cf69-1531-4698-9280-dcb915a36428 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (072668c4-31ae-4d70-a50a-67ca3a508818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6f89cf69-1531-4698-9280-dcb915a36428 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f66f9c50-3b69-487c-b913-b5b2a56f2c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:37 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-6f89cf69-1531-4698-9280-dcb915a36428 tempest-GroupSnapshotsTest-440840859 None] Volume volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f (43a1fd7b-50fc-428b-9b00-1fa39ea0489f): created successfully Jul 10 06:47:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6f89cf69-1531-4698-9280-dcb915a36428 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f66f9c50-3b69-487c-b913-b5b2a56f2c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6f89cf69-1531-4698-9280-dcb915a36428 tempest-GroupSnapshotsTest-440840859 None] Flow 'volume_create_manager' (17968db0-aacc-4384-a918-d6b75d3f07b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:47:37 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-6f89cf69-1531-4698-9280-dcb915a36428 tempest-GroupSnapshotsTest-440840859 None] Created volume successfully. Jul 10 06:47:38 devstack sudo[98901]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7a358b92-5670-4c27-b1b9-48fbbf700602 tempest-TestServerVolumeAttachmentScenario-1734695340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a65c7665-8867-4a0a-8c90-dac792e801bb 1073741824" returned: 0 in 1.075s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7a358b92-5670-4c27-b1b9-48fbbf700602 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a65c7665-8867-4a0a-8c90-dac792e801bb {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:38 devstack sudo[98907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a65c7665-8867-4a0a-8c90-dac792e801bb Jul 10 06:47:38 devstack sudo[98907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:38 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-1fe35e3d-eb97-4703-a298-c6fb6cc0452f tempest-GroupSnapshotsTest-440840859 None] GroupSnapshot bf93958e-d090-4433-aaaa-8c999247d458: creating. Jul 10 06:47:38 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-1fe35e3d-eb97-4703-a298-c6fb6cc0452f tempest-GroupSnapshotsTest-440840859 None] Group snapshot bf93958e-d090-4433-aaaa-8c999247d458: creating. {{(pid=87294) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 10 06:47:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-1fe35e3d-eb97-4703-a298-c6fb6cc0452f tempest-GroupSnapshotsTest-440840859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-55566bf4-b016-4f15-b3f3-7b08026a3818 req-96bef8d7-22c8-4923-ac09-733bac2c7cd4 tempest-TestInstancesWithCinderVolumes-177535336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:39 devstack sudo[98907]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7a358b92-5670-4c27-b1b9-48fbbf700602 tempest-TestServerVolumeAttachmentScenario-1734695340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a65c7665-8867-4a0a-8c90-dac792e801bb" returned: 0 in 0.860s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:39 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-7a358b92-5670-4c27-b1b9-48fbbf700602 tempest-TestServerVolumeAttachmentScenario-1734695340 None] <== create_volume: return (2002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:47:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7a358b92-5670-4c27-b1b9-48fbbf700602 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.004s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b82d228d-c720-41ef-ba4d-f7f13843a0d5 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.643s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:39 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b82d228d-c720-41ef-ba4d-f7f13843a0d5 tempest-TestServerVolumeAttachmentScenario-1734695340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:47:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2145759937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=097fce46-4bd1-4005-839c-cc6c88225274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4c8312243a8469ba000bd2413cad633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:47:36Z,use_quota=True,user_id='d381d14075f940e197c25a7c12ab5b2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:47:39 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-b82d228d-c720-41ef-ba4d-f7f13843a0d5 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Creating volume 097fce46-4bd1-4005-839c-cc6c88225274 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:47:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b82d228d-c720-41ef-ba4d-f7f13843a0d5 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b82d228d-c720-41ef-ba4d-f7f13843a0d5 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:39 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b82d228d-c720-41ef-ba4d-f7f13843a0d5 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:47:39 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b82d228d-c720-41ef-ba4d-f7f13843a0d5 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:47:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b82d228d-c720-41ef-ba4d-f7f13843a0d5 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:39 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b82d228d-c720-41ef-ba4d-f7f13843a0d5 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:47:39 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-b82d228d-c720-41ef-ba4d-f7f13843a0d5 tempest-TestServerVolumeAttachmentScenario-1734695340 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:47:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b82d228d-c720-41ef-ba4d-f7f13843a0d5 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-097fce46-4bd1-4005-839c-cc6c88225274 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7a358b92-5670-4c27-b1b9-48fbbf700602 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baca44f2-3971-401d-a3e4-dccfcbf6dd59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a65c7665-8867-4a0a-8c90-dac792e801bb', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7a358b92-5670-4c27-b1b9-48fbbf700602 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5845a62-596c-446c-8b24-3b95c3d6c8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:39 devstack sudo[98918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-097fce46-4bd1-4005-839c-cc6c88225274 1073741824 Jul 10 06:47:39 devstack sudo[98918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:39 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-7a358b92-5670-4c27-b1b9-48fbbf700602 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Volume volume-a65c7665-8867-4a0a-8c90-dac792e801bb (a65c7665-8867-4a0a-8c90-dac792e801bb): created successfully Jul 10 06:47:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7a358b92-5670-4c27-b1b9-48fbbf700602 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5845a62-596c-446c-8b24-3b95c3d6c8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7a358b92-5670-4c27-b1b9-48fbbf700602 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Flow 'volume_create_manager' (03eb48e5-a252-4cd9-9ee9-162247f7d2dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:47:39 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-7a358b92-5670-4c27-b1b9-48fbbf700602 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Created volume successfully. Jul 10 06:47:40 devstack sudo[98918]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b82d228d-c720-41ef-ba4d-f7f13843a0d5 tempest-TestServerVolumeAttachmentScenario-1734695340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-097fce46-4bd1-4005-839c-cc6c88225274 1073741824" returned: 0 in 1.423s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b82d228d-c720-41ef-ba4d-f7f13843a0d5 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-097fce46-4bd1-4005-839c-cc6c88225274 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:40 devstack sudo[98974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-097fce46-4bd1-4005-839c-cc6c88225274 Jul 10 06:47:40 devstack sudo[98974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:41 devstack sudo[98974]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b82d228d-c720-41ef-ba4d-f7f13843a0d5 tempest-TestServerVolumeAttachmentScenario-1734695340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-097fce46-4bd1-4005-839c-cc6c88225274" returned: 0 in 0.748s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:41 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b82d228d-c720-41ef-ba4d-f7f13843a0d5 tempest-TestServerVolumeAttachmentScenario-1734695340 None] <== create_volume: return (2212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:47:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b82d228d-c720-41ef-ba4d-f7f13843a0d5 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.216s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-1fe35e3d-eb97-4703-a298-c6fb6cc0452f tempest-GroupSnapshotsTest-440840859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.708s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:41 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-1fe35e3d-eb97-4703-a298-c6fb6cc0452f tempest-GroupSnapshotsTest-440840859 None] Creating offline snapshot 9896b63b-a0d8-4e86-8a07-a420ab06cfa5 of volume 43a1fd7b-50fc-428b-9b00-1fa39ea0489f {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:47:41 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b82d228d-c720-41ef-ba4d-f7f13843a0d5 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05d72b88-6f13-4f50-83ae-f9a86c91cb37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-097fce46-4bd1-4005-839c-cc6c88225274', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:41 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b82d228d-c720-41ef-ba4d-f7f13843a0d5 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47420198-84d7-4caa-8a34-8e7d52e341b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:47:41 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[624c01d3-41e5-4956-87af-18c553507265]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:47:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1fe35e3d-eb97-4703-a298-c6fb6cc0452f tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:41 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-b82d228d-c720-41ef-ba4d-f7f13843a0d5 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Volume volume-097fce46-4bd1-4005-839c-cc6c88225274 (097fce46-4bd1-4005-839c-cc6c88225274): created successfully Jul 10 06:47:41 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b82d228d-c720-41ef-ba4d-f7f13843a0d5 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47420198-84d7-4caa-8a34-8e7d52e341b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:47:41 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b82d228d-c720-41ef-ba4d-f7f13843a0d5 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Flow 'volume_create_manager' (cdb53947-0736-4bd3-a84b-86af45f61e15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:47:41 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-b82d228d-c720-41ef-ba4d-f7f13843a0d5 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Created volume successfully. Jul 10 06:47:41 devstack sudo[98996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f Jul 10 06:47:41 devstack sudo[98996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:42 devstack sudo[98996]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1fe35e3d-eb97-4703-a298-c6fb6cc0452f tempest-GroupSnapshotsTest-440840859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f" returned: 0 in 0.796s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1fe35e3d-eb97-4703-a298-c6fb6cc0452f tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f.9896b63b-a0d8-4e86-8a07-a420ab06cfa5 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:42 devstack sudo[99003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f.9896b63b-a0d8-4e86-8a07-a420ab06cfa5 1G Jul 10 06:47:42 devstack sudo[99003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:43 devstack sudo[99003]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1fe35e3d-eb97-4703-a298-c6fb6cc0452f tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f.9896b63b-a0d8-4e86-8a07-a420ab06cfa5 1G" returned: 0 in 1.010s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1fe35e3d-eb97-4703-a298-c6fb6cc0452f tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f.9896b63b-a0d8-4e86-8a07-a420ab06cfa5 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:43 devstack sudo[99008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f.9896b63b-a0d8-4e86-8a07-a420ab06cfa5 Jul 10 06:47:43 devstack sudo[99008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:44 devstack sudo[99008]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1fe35e3d-eb97-4703-a298-c6fb6cc0452f tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f.9896b63b-a0d8-4e86-8a07-a420ab06cfa5" returned: 0 in 0.750s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:44 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-1fe35e3d-eb97-4703-a298-c6fb6cc0452f tempest-GroupSnapshotsTest-440840859 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f.9896b63b-a0d8-4e86-8a07-a420ab06cfa5 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 06:47:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1fe35e3d-eb97-4703-a298-c6fb6cc0452f tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f.9896b63b-a0d8-4e86-8a07-a420ab06cfa5 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:44 devstack sudo[99014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f.9896b63b-a0d8-4e86-8a07-a420ab06cfa5 Jul 10 06:47:44 devstack sudo[99014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:45 devstack sudo[99014]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1fe35e3d-eb97-4703-a298-c6fb6cc0452f tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f.9896b63b-a0d8-4e86-8a07-a420ab06cfa5" returned: 0 in 0.786s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1fe35e3d-eb97-4703-a298-c6fb6cc0452f tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:45 devstack sudo[99017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f.info Jul 10 06:47:45 devstack sudo[99017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:46 devstack sudo[99017]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1fe35e3d-eb97-4703-a298-c6fb6cc0452f tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f.info" returned: 0 in 0.928s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:46 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-1fe35e3d-eb97-4703-a298-c6fb6cc0452f tempest-GroupSnapshotsTest-440840859 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 06:47:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1fe35e3d-eb97-4703-a298-c6fb6cc0452f tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:46 devstack sudo[99021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f.info Jul 10 06:47:46 devstack sudo[99021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:46 devstack sudo[99021]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1fe35e3d-eb97-4703-a298-c6fb6cc0452f tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f.info" returned: 0 in 0.895s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-1fe35e3d-eb97-4703-a298-c6fb6cc0452f tempest-GroupSnapshotsTest-440840859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.312s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-55566bf4-b016-4f15-b3f3-7b08026a3818 req-96bef8d7-22c8-4923-ac09-733bac2c7cd4 tempest-TestInstancesWithCinderVolumes-177535336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.723s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:47 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a5c257-2c6f-4476-97b8-01899fe27c27]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:47:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-55566bf4-b016-4f15-b3f3-7b08026a3818 req-96bef8d7-22c8-4923-ac09-733bac2c7cd4 tempest-TestInstancesWithCinderVolumes-177535336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8648d0c6-b3a5-4173-a859-20e7c84dc0a5 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:47 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-1fe35e3d-eb97-4703-a298-c6fb6cc0452f tempest-GroupSnapshotsTest-440840859 None] group_snapshot bf93958e-d090-4433-aaaa-8c999247d458: created successfully Jul 10 06:47:47 devstack sudo[99025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8648d0c6-b3a5-4173-a859-20e7c84dc0a5 Jul 10 06:47:47 devstack sudo[99025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:48 devstack sudo[99025]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-55566bf4-b016-4f15-b3f3-7b08026a3818 req-96bef8d7-22c8-4923-ac09-733bac2c7cd4 tempest-TestInstancesWithCinderVolumes-177535336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8648d0c6-b3a5-4173-a859-20e7c84dc0a5" returned: 0 in 1.295s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-55566bf4-b016-4f15-b3f3-7b08026a3818 req-96bef8d7-22c8-4923-ac09-733bac2c7cd4 tempest-TestInstancesWithCinderVolumes-177535336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.336s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:48 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-55566bf4-b016-4f15-b3f3-7b08026a3818 req-96bef8d7-22c8-4923-ac09-733bac2c7cd4 tempest-TestInstancesWithCinderVolumes-177535336 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804', 'name': 'volume-8648d0c6-b3a5-4173-a859-20e7c84dc0a5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ff866ba3-77bb-4af4-8dae-0fa4e1ee224a', 'enforce_multipath': True} {{(pid=87294) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:47:48 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-55566bf4-b016-4f15-b3f3-7b08026a3818 req-96bef8d7-22c8-4923-ac09-733bac2c7cd4 tempest-TestInstancesWithCinderVolumes-177535336 None] attachment_update completed successfully. Jul 10 06:47:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-fcd33574-46cf-4b8b-b672-5beabb19de6c tempest-GroupSnapshotsTest-440840859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-fcd33574-46cf-4b8b-b672-5beabb19de6c tempest-GroupSnapshotsTest-440840859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:49 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-fcd33574-46cf-4b8b-b672-5beabb19de6c tempest-GroupSnapshotsTest-440840859 None] Acquiring lock "cinder-quobyte-9896b63b-a0d8-4e86-8a07-a420ab06cfa5-b42193af-596c-4fcb-bfef-bd1b958805fb" by "_create_volume_from_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:47:49 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-fcd33574-46cf-4b8b-b672-5beabb19de6c tempest-GroupSnapshotsTest-440840859 None] Lock "cinder-quobyte-9896b63b-a0d8-4e86-8a07-a420ab06cfa5-b42193af-596c-4fcb-bfef-bd1b958805fb" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:47:49 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-fcd33574-46cf-4b8b-b672-5beabb19de6c tempest-GroupSnapshotsTest-440840859 None] Creating volume b42193af-596c-4fcb-bfef-bd1b958805fb from snapshot 9896b63b-a0d8-4e86-8a07-a420ab06cfa5 {{(pid=87294) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 06:47:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-fcd33574-46cf-4b8b-b672-5beabb19de6c tempest-GroupSnapshotsTest-440840859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-fcd33574-46cf-4b8b-b672-5beabb19de6c tempest-GroupSnapshotsTest-440840859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:49 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-fcd33574-46cf-4b8b-b672-5beabb19de6c tempest-GroupSnapshotsTest-440840859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:47:49 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-fcd33574-46cf-4b8b-b672-5beabb19de6c tempest-GroupSnapshotsTest-440840859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:47:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-fcd33574-46cf-4b8b-b672-5beabb19de6c tempest-GroupSnapshotsTest-440840859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:49 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-fcd33574-46cf-4b8b-b672-5beabb19de6c tempest-GroupSnapshotsTest-440840859 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:47:49 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-fcd33574-46cf-4b8b-b672-5beabb19de6c tempest-GroupSnapshotsTest-440840859 None] Acquiring lock "cinder-quobyte-b42193af-596c-4fcb-bfef-bd1b958805fb" by "_copy_volume_from_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:47:49 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-fcd33574-46cf-4b8b-b672-5beabb19de6c tempest-GroupSnapshotsTest-440840859 None] Lock "cinder-quobyte-b42193af-596c-4fcb-bfef-bd1b958805fb" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:47:49 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-fcd33574-46cf-4b8b-b672-5beabb19de6c tempest-GroupSnapshotsTest-440840859 None] snapshot: 9896b63b-a0d8-4e86-8a07-a420ab06cfa5, volume: b42193af-596c-4fcb-bfef-bd1b958805fb, {{(pid=87294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 06:47:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-fcd33574-46cf-4b8b-b672-5beabb19de6c tempest-GroupSnapshotsTest-440840859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:47:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-fcd33574-46cf-4b8b-b672-5beabb19de6c tempest-GroupSnapshotsTest-440840859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:47:49 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-fcd33574-46cf-4b8b-b672-5beabb19de6c tempest-GroupSnapshotsTest-440840859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:47:49 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-fcd33574-46cf-4b8b-b672-5beabb19de6c tempest-GroupSnapshotsTest-440840859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:47:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-fcd33574-46cf-4b8b-b672-5beabb19de6c tempest-GroupSnapshotsTest-440840859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:47:49 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1f558e-a4e8-43de-9c6d-f46062c7b232]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:47:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-fcd33574-46cf-4b8b-b672-5beabb19de6c tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f.9896b63b-a0d8-4e86-8a07-a420ab06cfa5 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:49 devstack sudo[99048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f.9896b63b-a0d8-4e86-8a07-a420ab06cfa5 Jul 10 06:47:49 devstack sudo[99048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:50 devstack sudo[99048]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-fcd33574-46cf-4b8b-b672-5beabb19de6c tempest-GroupSnapshotsTest-440840859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f.9896b63b-a0d8-4e86-8a07-a420ab06cfa5" returned: 0 in 1.119s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:50 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-fcd33574-46cf-4b8b-b672-5beabb19de6c tempest-GroupSnapshotsTest-440840859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:47:50 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-fcd33574-46cf-4b8b-b672-5beabb19de6c tempest-GroupSnapshotsTest-440840859 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f {{(pid=87294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 06:47:50 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-fcd33574-46cf-4b8b-b672-5beabb19de6c tempest-GroupSnapshotsTest-440840859 None] Creating direct copy from snapshot {{(pid=87294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 06:47:50 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c2b20b-2a6d-4ae8-a141-99b00afb22fc]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:47:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-fcd33574-46cf-4b8b-b672-5beabb19de6c tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:50 devstack sudo[99056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f Jul 10 06:47:50 devstack sudo[99056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:51 devstack sudo[99056]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-fcd33574-46cf-4b8b-b672-5beabb19de6c tempest-GroupSnapshotsTest-440840859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f" returned: 0 in 0.786s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:51 devstack cinder-volume[87294]: DEBUG cinder.utils [None req-fcd33574-46cf-4b8b-b672-5beabb19de6c tempest-GroupSnapshotsTest-440840859 None] Path /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b42193af-596c-4fcb-bfef-bd1b958805fb not found in is_blk_device check {{(pid=87294) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 06:47:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-fcd33574-46cf-4b8b-b672-5beabb19de6c tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b42193af-596c-4fcb-bfef-bd1b958805fb {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:51 devstack sudo[99062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b42193af-596c-4fcb-bfef-bd1b958805fb Jul 10 06:47:51 devstack sudo[99062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:58 devstack sudo[99062]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-fcd33574-46cf-4b8b-b672-5beabb19de6c tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b42193af-596c-4fcb-bfef-bd1b958805fb" returned: 0 in 7.639s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:58 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e48b35-81dc-4a4a-9f30-04d84d82999f]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:47:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-fcd33574-46cf-4b8b-b672-5beabb19de6c tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:58 devstack sudo[99178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f Jul 10 06:47:58 devstack sudo[99178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:47:59 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:SELECT=53,cinder:UPDATE=53,cinder:INSERT=9,cinder:DELETE=3 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:47:59 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:UPDATE=30,cinder:SELECT=37,cinder:INSERT=6,cinder:DELETE=4 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:47:59 devstack sudo[99178]: pam_unix(sudo:session): session closed for user root Jul 10 06:47:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-fcd33574-46cf-4b8b-b672-5beabb19de6c tempest-GroupSnapshotsTest-440840859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f" returned: 0 in 1.149s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:47:59 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-fcd33574-46cf-4b8b-b672-5beabb19de6c tempest-GroupSnapshotsTest-440840859 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f, size 1024.00 MB, duration 7.64 sec, destination /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b42193af-596c-4fcb-bfef-bd1b958805fb {{(pid=87294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 06:47:59 devstack cinder-volume[87294]: INFO cinder.image.image_utils [None req-fcd33574-46cf-4b8b-b672-5beabb19de6c tempest-GroupSnapshotsTest-440840859 None] Converted 1024.00 MB image at 134.01 MB/s Jul 10 06:47:59 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-fcd33574-46cf-4b8b-b672-5beabb19de6c tempest-GroupSnapshotsTest-440840859 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b42193af-596c-4fcb-bfef-bd1b958805fb is being set with open permissions: ugo+rw: NotImplementedError Jul 10 06:47:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-fcd33574-46cf-4b8b-b672-5beabb19de6c tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b42193af-596c-4fcb-bfef-bd1b958805fb {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:47:59 devstack sudo[99203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b42193af-596c-4fcb-bfef-bd1b958805fb Jul 10 06:47:59 devstack sudo[99203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:00 devstack sudo[99203]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-fcd33574-46cf-4b8b-b672-5beabb19de6c tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b42193af-596c-4fcb-bfef-bd1b958805fb" returned: 0 in 0.824s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:00 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-fcd33574-46cf-4b8b-b672-5beabb19de6c tempest-GroupSnapshotsTest-440840859 None] Lock "cinder-quobyte-b42193af-596c-4fcb-bfef-bd1b958805fb" released by "_copy_volume_from_snapshot" :: held 11.649s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:00 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-fcd33574-46cf-4b8b-b672-5beabb19de6c tempest-GroupSnapshotsTest-440840859 None] Lock "cinder-quobyte-9896b63b-a0d8-4e86-8a07-a420ab06cfa5-b42193af-596c-4fcb-bfef-bd1b958805fb" released by "_create_volume_from_snapshot" :: held 11.698s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-fcd33574-46cf-4b8b-b672-5beabb19de6c tempest-GroupSnapshotsTest-440840859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.719s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:00 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-fcd33574-46cf-4b8b-b672-5beabb19de6c tempest-GroupSnapshotsTest-440840859 None] Create group from source-snapshot-bf93958e-d090-4433-aaaa-8c999247d458 completed successfully. Jul 10 06:48:01 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-cc325243-4fae-4de7-ae57-0727a43f81d1 req-a5d6a525-5bcc-4fcc-ab2d-babd6db11e0b tempest-TestInstancesWithCinderVolumes-177535336 None] Terminate volume connection completed successfully. Jul 10 06:48:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-cc325243-4fae-4de7-ae57-0727a43f81d1 req-a5d6a525-5bcc-4fcc-ab2d-babd6db11e0b tempest-TestInstancesWithCinderVolumes-177535336 None] Deleting attachment fa2dc6a4-09ae-4d6d-9e1f-f73f8f5e7578. {{(pid=87294) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:48:02 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-ac8bee13-5bc0-4b6f-905d-d5dc67fc842c tempest-GroupSnapshotsTest-440840859 None] Acquiring lock "cinder-quobyte-b42193af-596c-4fcb-bfef-bd1b958805fb" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:48:02 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-ac8bee13-5bc0-4b6f-905d-d5dc67fc842c tempest-GroupSnapshotsTest-440840859 None] Lock "cinder-quobyte-b42193af-596c-4fcb-bfef-bd1b958805fb" acquired by "delete_volume" :: waited 0.022s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:48:02 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f90f4e8-e56f-44c5-a88d-e2f0fce97aab]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ac8bee13-5bc0-4b6f-905d-d5dc67fc842c tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b42193af-596c-4fcb-bfef-bd1b958805fb {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:02 devstack sudo[99211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b42193af-596c-4fcb-bfef-bd1b958805fb Jul 10 06:48:02 devstack sudo[99211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:03 devstack sudo[99211]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ac8bee13-5bc0-4b6f-905d-d5dc67fc842c tempest-GroupSnapshotsTest-440840859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b42193af-596c-4fcb-bfef-bd1b958805fb" returned: 0 in 0.810s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ac8bee13-5bc0-4b6f-905d-d5dc67fc842c tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b42193af-596c-4fcb-bfef-bd1b958805fb {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:03 devstack sudo[99216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b42193af-596c-4fcb-bfef-bd1b958805fb Jul 10 06:48:03 devstack sudo[99216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:03 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-5de36729-4861-41fa-80dc-e9300320b32d tempest-TestInstancesWithCinderVolumes-177535336 None] Acquiring lock "cinder-653c787e-bd21-4fd0-abd9-4de9209cfe7a-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:48:03 devstack sudo[99216]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:03 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-5de36729-4861-41fa-80dc-e9300320b32d tempest-TestInstancesWithCinderVolumes-177535336 None] Lock "cinder-653c787e-bd21-4fd0-abd9-4de9209cfe7a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:48:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ac8bee13-5bc0-4b6f-905d-d5dc67fc842c tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b42193af-596c-4fcb-bfef-bd1b958805fb" returned: 0 in 0.781s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:03 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-ac8bee13-5bc0-4b6f-905d-d5dc67fc842c tempest-GroupSnapshotsTest-440840859 None] Lock "cinder-quobyte-b42193af-596c-4fcb-bfef-bd1b958805fb" released by "delete_volume" :: held 1.649s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:03 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-5de36729-4861-41fa-80dc-e9300320b32d tempest-TestInstancesWithCinderVolumes-177535336 None] Acquiring lock "cinder-quobyte-653c787e-bd21-4fd0-abd9-4de9209cfe7a" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:48:03 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-5de36729-4861-41fa-80dc-e9300320b32d tempest-TestInstancesWithCinderVolumes-177535336 None] Lock "cinder-quobyte-653c787e-bd21-4fd0-abd9-4de9209cfe7a" acquired by "delete_volume" :: waited 0.032s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:48:03 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[9866dfce-361b-4d27-a048-14e67f3173dc]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5de36729-4861-41fa-80dc-e9300320b32d tempest-TestInstancesWithCinderVolumes-177535336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-653c787e-bd21-4fd0-abd9-4de9209cfe7a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:03 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-ac8bee13-5bc0-4b6f-905d-d5dc67fc842c tempest-GroupSnapshotsTest-440840859 None] Created reservations ['662c310c-1b30-4b2f-8ddc-4dae634d053d'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:48:04 devstack cinder-volume[87294]: WARNING cinder.quota [None req-ac8bee13-5bc0-4b6f-905d-d5dc67fc842c tempest-GroupSnapshotsTest-440840859 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1747528819 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1747528819, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:48:04 devstack cinder-volume[87294]: WARNING cinder.quota [None req-ac8bee13-5bc0-4b6f-905d-d5dc67fc842c tempest-GroupSnapshotsTest-440840859 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1747528819 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1747528819, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:48:04 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-ac8bee13-5bc0-4b6f-905d-d5dc67fc842c tempest-GroupSnapshotsTest-440840859 None] Created reservations ['794e3fe2-6463-4d22-bb13-62914c19b992', '21dc718b-d33b-40d2-a595-ca4b70704b27', '53a371c9-78c3-44fd-a862-541854244c0a', '4f168f03-1ce7-4ee8-b679-0cf79eaa8a5c'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:48:04 devstack sudo[99223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-653c787e-bd21-4fd0-abd9-4de9209cfe7a Jul 10 06:48:04 devstack sudo[99223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ac8bee13-5bc0-4b6f-905d-d5dc67fc842c tempest-GroupSnapshotsTest-440840859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ac8bee13-5bc0-4b6f-905d-d5dc67fc842c tempest-GroupSnapshotsTest-440840859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:04 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-ac8bee13-5bc0-4b6f-905d-d5dc67fc842c tempest-GroupSnapshotsTest-440840859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:48:04 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-ac8bee13-5bc0-4b6f-905d-d5dc67fc842c tempest-GroupSnapshotsTest-440840859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:48:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ac8bee13-5bc0-4b6f-905d-d5dc67fc842c tempest-GroupSnapshotsTest-440840859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ac8bee13-5bc0-4b6f-905d-d5dc67fc842c tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:04 devstack sudo[99225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:48:04 devstack sudo[99225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:04 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-95fc95d0-8885-402d-8086-d44563464366 tempest-GroupSnapshotsTest-440840859 None] group_snapshot bf93958e-d090-4433-aaaa-8c999247d458: deleting Jul 10 06:48:04 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-95fc95d0-8885-402d-8086-d44563464366 tempest-GroupSnapshotsTest-440840859 None] group_snapshot bf93958e-d090-4433-aaaa-8c999247d458: deleting {{(pid=87294) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 10 06:48:04 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-95fc95d0-8885-402d-8086-d44563464366 tempest-GroupSnapshotsTest-440840859 None] Acquiring lock "cinder-quobyte-43a1fd7b-50fc-428b-9b00-1fa39ea0489f" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:48:05 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-95fc95d0-8885-402d-8086-d44563464366 tempest-GroupSnapshotsTest-440840859 None] Lock "cinder-quobyte-43a1fd7b-50fc-428b-9b00-1fa39ea0489f" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:48:05 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-95fc95d0-8885-402d-8086-d44563464366 tempest-GroupSnapshotsTest-440840859 None] Acquiring lock "cinder-quobyte-9896b63b-a0d8-4e86-8a07-a420ab06cfa5" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:48:05 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-95fc95d0-8885-402d-8086-d44563464366 tempest-GroupSnapshotsTest-440840859 None] Lock "cinder-quobyte-9896b63b-a0d8-4e86-8a07-a420ab06cfa5" acquired by "_delete_snapshot" :: waited 0.055s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:48:05 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-95fc95d0-8885-402d-8086-d44563464366 tempest-GroupSnapshotsTest-440840859 None] Deleting offline snapshot 9896b63b-a0d8-4e86-8a07-a420ab06cfa5 of volume 43a1fd7b-50fc-428b-9b00-1fa39ea0489f {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:48:05 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-95fc95d0-8885-402d-8086-d44563464366 tempest-GroupSnapshotsTest-440840859 None] snapshot_file for this snap is: volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f.9896b63b-a0d8-4e86-8a07-a420ab06cfa5 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:48:05 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cca7d66-bb1c-4354-a592-67be33c9cc59]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-95fc95d0-8885-402d-8086-d44563464366 tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f.9896b63b-a0d8-4e86-8a07-a420ab06cfa5 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:05 devstack sudo[99231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f.9896b63b-a0d8-4e86-8a07-a420ab06cfa5 Jul 10 06:48:05 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:05 devstack sudo[99223]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5de36729-4861-41fa-80dc-e9300320b32d tempest-TestInstancesWithCinderVolumes-177535336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-653c787e-bd21-4fd0-abd9-4de9209cfe7a" returned: 0 in 1.503s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5de36729-4861-41fa-80dc-e9300320b32d tempest-TestInstancesWithCinderVolumes-177535336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-653c787e-bd21-4fd0-abd9-4de9209cfe7a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:05 devstack sudo[99225]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ac8bee13-5bc0-4b6f-905d-d5dc67fc842c tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.183s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:05 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-ac8bee13-5bc0-4b6f-905d-d5dc67fc842c tempest-GroupSnapshotsTest-440840859 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:48:05 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-ac8bee13-5bc0-4b6f-905d-d5dc67fc842c tempest-GroupSnapshotsTest-440840859 None] Delete group completed successfully. Jul 10 06:48:05 devstack sudo[99233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-653c787e-bd21-4fd0-abd9-4de9209cfe7a Jul 10 06:48:05 devstack sudo[99233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:06 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-95fc95d0-8885-402d-8086-d44563464366 tempest-GroupSnapshotsTest-440840859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f.9896b63b-a0d8-4e86-8a07-a420ab06cfa5" returned: 0 in 1.078s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:06 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-95fc95d0-8885-402d-8086-d44563464366 tempest-GroupSnapshotsTest-440840859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:48:06 devstack sudo[99233]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5de36729-4861-41fa-80dc-e9300320b32d tempest-TestInstancesWithCinderVolumes-177535336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-653c787e-bd21-4fd0-abd9-4de9209cfe7a" returned: 0 in 0.814s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:06 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f12a65f-13d3-4851-97bf-489533393025]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-95fc95d0-8885-402d-8086-d44563464366 tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:06 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-5de36729-4861-41fa-80dc-e9300320b32d tempest-TestInstancesWithCinderVolumes-177535336 None] Lock "cinder-quobyte-653c787e-bd21-4fd0-abd9-4de9209cfe7a" released by "delete_volume" :: held 2.389s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:06 devstack cinder-volume[87294]: WARNING cinder.quota [None req-5de36729-4861-41fa-80dc-e9300320b32d tempest-TestInstancesWithCinderVolumes-177535336 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-746934332-844263798 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-746934332-844263798, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:48:06 devstack cinder-volume[87294]: WARNING cinder.quota [None req-5de36729-4861-41fa-80dc-e9300320b32d tempest-TestInstancesWithCinderVolumes-177535336 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-746934332-844263798 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-746934332-844263798, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:48:06 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-5de36729-4861-41fa-80dc-e9300320b32d tempest-TestInstancesWithCinderVolumes-177535336 None] Created reservations ['064aa5bb-f84e-4f4d-ac26-925ba7eedb4f', 'f063163f-4bcc-4831-9dae-241cd7f7b431', '377d6911-a142-40a3-aec4-9635d51b9b50', 'd14e9280-0636-4b05-9d9f-fcc7e7717844'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:48:06 devstack sudo[99240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f Jul 10 06:48:06 devstack sudo[99240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5de36729-4861-41fa-80dc-e9300320b32d tempest-TestInstancesWithCinderVolumes-177535336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5de36729-4861-41fa-80dc-e9300320b32d tempest-TestInstancesWithCinderVolumes-177535336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:06 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5de36729-4861-41fa-80dc-e9300320b32d tempest-TestInstancesWithCinderVolumes-177535336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:48:06 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5de36729-4861-41fa-80dc-e9300320b32d tempest-TestInstancesWithCinderVolumes-177535336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:48:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5de36729-4861-41fa-80dc-e9300320b32d tempest-TestInstancesWithCinderVolumes-177535336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5de36729-4861-41fa-80dc-e9300320b32d tempest-TestInstancesWithCinderVolumes-177535336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:06 devstack sudo[99242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:48:06 devstack sudo[99242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:07 devstack sudo[99242]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5de36729-4861-41fa-80dc-e9300320b32d tempest-TestInstancesWithCinderVolumes-177535336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.732s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:07 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-5de36729-4861-41fa-80dc-e9300320b32d tempest-TestInstancesWithCinderVolumes-177535336 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:48:07 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-5de36729-4861-41fa-80dc-e9300320b32d tempest-TestInstancesWithCinderVolumes-177535336 None] Deleted volume successfully. Jul 10 06:48:07 devstack sudo[99240]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-95fc95d0-8885-402d-8086-d44563464366 tempest-GroupSnapshotsTest-440840859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f" returned: 0 in 0.980s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-95fc95d0-8885-402d-8086-d44563464366 tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f.9896b63b-a0d8-4e86-8a07-a420ab06cfa5 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:07 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-5de36729-4861-41fa-80dc-e9300320b32d tempest-TestInstancesWithCinderVolumes-177535336 None] Lock "cinder-653c787e-bd21-4fd0-abd9-4de9209cfe7a-delete_volume" released by "delete_volume" :: held 3.457s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:07 devstack sudo[99261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f.9896b63b-a0d8-4e86-8a07-a420ab06cfa5 Jul 10 06:48:07 devstack sudo[99261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:08 devstack sudo[99261]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-95fc95d0-8885-402d-8086-d44563464366 tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f.9896b63b-a0d8-4e86-8a07-a420ab06cfa5" returned: 0 in 0.823s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-95fc95d0-8885-402d-8086-d44563464366 tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f.9896b63b-a0d8-4e86-8a07-a420ab06cfa5 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:08 devstack sudo[99277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f.9896b63b-a0d8-4e86-8a07-a420ab06cfa5 Jul 10 06:48:08 devstack sudo[99277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:08 devstack sudo[99277]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-95fc95d0-8885-402d-8086-d44563464366 tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f.9896b63b-a0d8-4e86-8a07-a420ab06cfa5" returned: 0 in 0.750s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:08 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-95fc95d0-8885-402d-8086-d44563464366 tempest-GroupSnapshotsTest-440840859 None] Lock "cinder-quobyte-9896b63b-a0d8-4e86-8a07-a420ab06cfa5" released by "_delete_snapshot" :: held 3.824s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:08 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-95fc95d0-8885-402d-8086-d44563464366 tempest-GroupSnapshotsTest-440840859 None] Lock "cinder-quobyte-43a1fd7b-50fc-428b-9b00-1fa39ea0489f" released by "delete_snapshot" :: held 3.887s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:08 devstack cinder-volume[87294]: WARNING cinder.quota [None req-95fc95d0-8885-402d-8086-d44563464366 tempest-GroupSnapshotsTest-440840859 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1747528819 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1747528819, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:48:08 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-95fc95d0-8885-402d-8086-d44563464366 tempest-GroupSnapshotsTest-440840859 None] Created reservations ['70cafca5-174f-4306-a0c6-4a4610557f0d', '30ca826a-d721-4659-869e-310980cbfe0c', '2c8262a1-4fa6-435f-aa0c-3f150f5dfb14', '9b36ec5d-900a-49ac-8d71-97f59d7eb260'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:48:09 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-95fc95d0-8885-402d-8086-d44563464366 tempest-GroupSnapshotsTest-440840859 None] group_snapshot bf93958e-d090-4433-aaaa-8c999247d458: deleted successfully Jul 10 06:48:09 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-8ff26090-c6f0-4e7c-9c7d-badf378265ed req-4f9156e7-5352-4bf9-aaa9-5eb46c74e2ab tempest-TestInstancesWithCinderVolumes-177535336 None] Terminate volume connection completed successfully. Jul 10 06:48:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-8ff26090-c6f0-4e7c-9c7d-badf378265ed req-4f9156e7-5352-4bf9-aaa9-5eb46c74e2ab tempest-TestInstancesWithCinderVolumes-177535336 None] Deleting attachment ff866ba3-77bb-4af4-8dae-0fa4e1ee224a. {{(pid=87294) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:48:09 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-5ce6149c-2419-4fdf-8090-b51b2311a027 tempest-GroupSnapshotsTest-440840859 None] Acquiring lock "cinder-quobyte-43a1fd7b-50fc-428b-9b00-1fa39ea0489f" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:48:09 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-5ce6149c-2419-4fdf-8090-b51b2311a027 tempest-GroupSnapshotsTest-440840859 None] Lock "cinder-quobyte-43a1fd7b-50fc-428b-9b00-1fa39ea0489f" acquired by "delete_volume" :: waited 0.018s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:48:10 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ddbc78-2591-4c7a-8da1-bfcae355357f]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5ce6149c-2419-4fdf-8090-b51b2311a027 tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:10 devstack sudo[99315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f Jul 10 06:48:10 devstack sudo[99315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:10 devstack sudo[99315]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5ce6149c-2419-4fdf-8090-b51b2311a027 tempest-GroupSnapshotsTest-440840859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f" returned: 0 in 0.882s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5ce6149c-2419-4fdf-8090-b51b2311a027 tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:10 devstack sudo[99321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f Jul 10 06:48:10 devstack sudo[99321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:11 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7477fed0-b8b7-4ccc-929b-5e3aa0bad2ea tempest-TestInstancesWithCinderVolumes-177535336 None] Acquiring lock "cinder-8648d0c6-b3a5-4173-a859-20e7c84dc0a5-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:48:11 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7477fed0-b8b7-4ccc-929b-5e3aa0bad2ea tempest-TestInstancesWithCinderVolumes-177535336 None] Lock "cinder-8648d0c6-b3a5-4173-a859-20e7c84dc0a5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:48:11 devstack sudo[99321]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5ce6149c-2419-4fdf-8090-b51b2311a027 tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-43a1fd7b-50fc-428b-9b00-1fa39ea0489f" returned: 0 in 0.685s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:11 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-5ce6149c-2419-4fdf-8090-b51b2311a027 tempest-GroupSnapshotsTest-440840859 None] Lock "cinder-quobyte-43a1fd7b-50fc-428b-9b00-1fa39ea0489f" released by "delete_volume" :: held 1.662s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:11 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7477fed0-b8b7-4ccc-929b-5e3aa0bad2ea tempest-TestInstancesWithCinderVolumes-177535336 None] Acquiring lock "cinder-quobyte-8648d0c6-b3a5-4173-a859-20e7c84dc0a5" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:48:11 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7477fed0-b8b7-4ccc-929b-5e3aa0bad2ea tempest-TestInstancesWithCinderVolumes-177535336 None] Lock "cinder-quobyte-8648d0c6-b3a5-4173-a859-20e7c84dc0a5" acquired by "delete_volume" :: waited 0.029s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:48:11 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[138c76b9-f1d3-477f-a20d-e30c23ea0164]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7477fed0-b8b7-4ccc-929b-5e3aa0bad2ea tempest-TestInstancesWithCinderVolumes-177535336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8648d0c6-b3a5-4173-a859-20e7c84dc0a5 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-a1de24a3-6559-41db-81b1-b1008ffd9b7b req-24a391c9-a3ea-45ac-b942-1fc2da7c6345 tempest-TestStampPattern-1951221454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-a1de24a3-6559-41db-81b1-b1008ffd9b7b req-24a391c9-a3ea-45ac-b942-1fc2da7c6345 tempest-TestStampPattern-1951221454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:11 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[44cdfe81-4a37-4c1b-9d2b-8abf2a6cb863]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-a1de24a3-6559-41db-81b1-b1008ffd9b7b req-24a391c9-a3ea-45ac-b942-1fc2da7c6345 tempest-TestStampPattern-1951221454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:11 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-5ce6149c-2419-4fdf-8090-b51b2311a027 tempest-GroupSnapshotsTest-440840859 None] Created reservations ['7fd5a637-8368-4bb0-8184-d6ea9f55e423'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:48:11 devstack sudo[99333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8648d0c6-b3a5-4173-a859-20e7c84dc0a5 Jul 10 06:48:11 devstack sudo[99333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:11 devstack cinder-volume[87294]: WARNING cinder.db.api [None req-5ce6149c-2419-4fdf-8090-b51b2311a027 tempest-GroupSnapshotsTest-440840859 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1747528819'] Jul 10 06:48:11 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-5ce6149c-2419-4fdf-8090-b51b2311a027 tempest-GroupSnapshotsTest-440840859 None] Created reservations ['1ff974e8-f32a-43ed-bde7-18976fcfe10b', '576c57aa-ada5-4bec-97be-ee25f0f8dc90', 'c3e0f849-e80f-4bbc-99b4-6229fcdfc522', 'c7d6ea39-4e4c-43da-a956-d57f1cbb70e3'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:48:11 devstack sudo[99334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8 Jul 10 06:48:11 devstack sudo[99334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5ce6149c-2419-4fdf-8090-b51b2311a027 tempest-GroupSnapshotsTest-440840859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5ce6149c-2419-4fdf-8090-b51b2311a027 tempest-GroupSnapshotsTest-440840859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:12 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5ce6149c-2419-4fdf-8090-b51b2311a027 tempest-GroupSnapshotsTest-440840859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:48:12 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5ce6149c-2419-4fdf-8090-b51b2311a027 tempest-GroupSnapshotsTest-440840859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:48:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5ce6149c-2419-4fdf-8090-b51b2311a027 tempest-GroupSnapshotsTest-440840859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5ce6149c-2419-4fdf-8090-b51b2311a027 tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:12 devstack sudo[99337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:48:12 devstack sudo[99337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:12 devstack sudo[99333]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7477fed0-b8b7-4ccc-929b-5e3aa0bad2ea tempest-TestInstancesWithCinderVolumes-177535336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8648d0c6-b3a5-4173-a859-20e7c84dc0a5" returned: 0 in 0.959s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7477fed0-b8b7-4ccc-929b-5e3aa0bad2ea tempest-TestInstancesWithCinderVolumes-177535336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8648d0c6-b3a5-4173-a859-20e7c84dc0a5 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:12 devstack sudo[99342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8648d0c6-b3a5-4173-a859-20e7c84dc0a5 Jul 10 06:48:12 devstack sudo[99342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:12 devstack sudo[99334]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-a1de24a3-6559-41db-81b1-b1008ffd9b7b req-24a391c9-a3ea-45ac-b942-1fc2da7c6345 tempest-TestStampPattern-1951221454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8" returned: 0 in 1.200s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-a1de24a3-6559-41db-81b1-b1008ffd9b7b req-24a391c9-a3ea-45ac-b942-1fc2da7c6345 tempest-TestStampPattern-1951221454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.234s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:13 devstack sudo[99337]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:13 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-a1de24a3-6559-41db-81b1-b1008ffd9b7b req-24a391c9-a3ea-45ac-b942-1fc2da7c6345 tempest-TestStampPattern-1951221454 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804', 'name': 'volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cb38eba9-3060-4250-b4dd-c7ccb04e3141', 'enforce_multipath': True} {{(pid=87294) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:48:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5ce6149c-2419-4fdf-8090-b51b2311a027 tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.011s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:13 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-5ce6149c-2419-4fdf-8090-b51b2311a027 tempest-GroupSnapshotsTest-440840859 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:48:13 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-5ce6149c-2419-4fdf-8090-b51b2311a027 tempest-GroupSnapshotsTest-440840859 None] Delete group completed successfully. Jul 10 06:48:13 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-3bcdfc71-c8d3-4319-a445-eeab13cb6bce tempest-GroupSnapshotsTest-440840859 None] Group tempest-GroupSnapshotsTest-Group-731179752: creating Jul 10 06:48:13 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-a1de24a3-6559-41db-81b1-b1008ffd9b7b req-24a391c9-a3ea-45ac-b942-1fc2da7c6345 tempest-TestStampPattern-1951221454 None] attachment_update completed successfully. Jul 10 06:48:13 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-3bcdfc71-c8d3-4319-a445-eeab13cb6bce tempest-GroupSnapshotsTest-440840859 None] Group tempest-GroupSnapshotsTest-Group-731179752: created successfully Jul 10 06:48:13 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-3bcdfc71-c8d3-4319-a445-eeab13cb6bce tempest-GroupSnapshotsTest-440840859 None] Create group completed successfully. Jul 10 06:48:13 devstack sudo[99342]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7477fed0-b8b7-4ccc-929b-5e3aa0bad2ea tempest-TestInstancesWithCinderVolumes-177535336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8648d0c6-b3a5-4173-a859-20e7c84dc0a5" returned: 0 in 0.871s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:13 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7477fed0-b8b7-4ccc-929b-5e3aa0bad2ea tempest-TestInstancesWithCinderVolumes-177535336 None] Lock "cinder-quobyte-8648d0c6-b3a5-4173-a859-20e7c84dc0a5" released by "delete_volume" :: held 1.899s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:13 devstack cinder-volume[87294]: WARNING cinder.quota [None req-7477fed0-b8b7-4ccc-929b-5e3aa0bad2ea tempest-TestInstancesWithCinderVolumes-177535336 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1018364275-1832942344 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1018364275-1832942344, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:48:13 devstack cinder-volume[87294]: WARNING cinder.quota [None req-7477fed0-b8b7-4ccc-929b-5e3aa0bad2ea tempest-TestInstancesWithCinderVolumes-177535336 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1018364275-1832942344 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1018364275-1832942344, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:48:13 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-7477fed0-b8b7-4ccc-929b-5e3aa0bad2ea tempest-TestInstancesWithCinderVolumes-177535336 None] Created reservations ['744f4858-4ceb-4208-b9b8-7de744f30650', '681fee18-cad5-43ce-bb2d-7eafa8546061', '215a557c-4be7-4c83-8161-154f1a3a46e6', '04a62a05-23a1-4d7b-9e08-cd0d994aae1c'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:48:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7477fed0-b8b7-4ccc-929b-5e3aa0bad2ea tempest-TestInstancesWithCinderVolumes-177535336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7477fed0-b8b7-4ccc-929b-5e3aa0bad2ea tempest-TestInstancesWithCinderVolumes-177535336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:13 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-7477fed0-b8b7-4ccc-929b-5e3aa0bad2ea tempest-TestInstancesWithCinderVolumes-177535336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:48:13 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-7477fed0-b8b7-4ccc-929b-5e3aa0bad2ea tempest-TestInstancesWithCinderVolumes-177535336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:48:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7477fed0-b8b7-4ccc-929b-5e3aa0bad2ea tempest-TestInstancesWithCinderVolumes-177535336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7477fed0-b8b7-4ccc-929b-5e3aa0bad2ea tempest-TestInstancesWithCinderVolumes-177535336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:13 devstack sudo[99350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:48:13 devstack sudo[99350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:14 devstack sudo[99350]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7477fed0-b8b7-4ccc-929b-5e3aa0bad2ea tempest-TestInstancesWithCinderVolumes-177535336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.706s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:14 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-7477fed0-b8b7-4ccc-929b-5e3aa0bad2ea tempest-TestInstancesWithCinderVolumes-177535336 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:48:14 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-7477fed0-b8b7-4ccc-929b-5e3aa0bad2ea tempest-TestInstancesWithCinderVolumes-177535336 None] Deleted volume successfully. Jul 10 06:48:14 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7477fed0-b8b7-4ccc-929b-5e3aa0bad2ea tempest-TestInstancesWithCinderVolumes-177535336 None] Lock "cinder-8648d0c6-b3a5-4173-a859-20e7c84dc0a5-delete_volume" released by "delete_volume" :: held 2.887s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:14 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-8621cc5e-d29e-4dae-b97e-804d163a1529 tempest-GroupSnapshotsTest-440840859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:48:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-8621cc5e-d29e-4dae-b97e-804d163a1529 tempest-GroupSnapshotsTest-440840859 None] Flow 'volume_create_manager' (f241da75-ca22-4553-bbc4-dda96daec520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:48:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-8621cc5e-d29e-4dae-b97e-804d163a1529 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (301317b8-fc8c-4ac9-a180-ff0e8282da12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-8621cc5e-d29e-4dae-b97e-804d163a1529 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (301317b8-fc8c-4ac9-a180-ff0e8282da12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-230043385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=903b4b19-f787-48a1-b372-ceb033bb7a71,host='devstack@QuobyteHD#QuobyteHD',id=74bf8a7f-4a0e-4909-bd75-2669f5423227,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d433420cfd44bd99269f5c8cbd29d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:48:15Z,use_quota=True,user_id='5ab5cf40b4b0457990e4198e0c84b17d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f64fd1-4895-43ce-81f3-0ed8ba9f3f02),volume_type_id=98f64fd1-4895-43ce-81f3-0ed8ba9f3f02)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-8621cc5e-d29e-4dae-b97e-804d163a1529 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f26a18-e73b-4277-a095-28f146fbe24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-8621cc5e-d29e-4dae-b97e-804d163a1529 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f26a18-e73b-4277-a095-28f146fbe24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-8621cc5e-d29e-4dae-b97e-804d163a1529 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8922c4b-de71-4a5f-bb68-2dd574b453ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-8621cc5e-d29e-4dae-b97e-804d163a1529 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8922c4b-de71-4a5f-bb68-2dd574b453ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74bf8a7f-4a0e-4909-bd75-2669f5423227', 'volume_name': 'volume-74bf8a7f-4a0e-4909-bd75-2669f5423227', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-8621cc5e-d29e-4dae-b97e-804d163a1529 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c9b770b-0026-40ea-9b18-1248d1a46de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-8621cc5e-d29e-4dae-b97e-804d163a1529 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c9b770b-0026-40ea-9b18-1248d1a46de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-8621cc5e-d29e-4dae-b97e-804d163a1529 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (513c596e-e62d-4cc1-b204-10a95f49b229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:15 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-8621cc5e-d29e-4dae-b97e-804d163a1529 tempest-GroupSnapshotsTest-440840859 None] Volume 74bf8a7f-4a0e-4909-bd75-2669f5423227: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74bf8a7f-4a0e-4909-bd75-2669f5423227', 'volume_size': 1} Jul 10 06:48:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-8621cc5e-d29e-4dae-b97e-804d163a1529 tempest-GroupSnapshotsTest-440840859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-8621cc5e-d29e-4dae-b97e-804d163a1529 tempest-GroupSnapshotsTest-440840859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:15 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-8621cc5e-d29e-4dae-b97e-804d163a1529 tempest-GroupSnapshotsTest-440840859 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=903b4b19-f787-48a1-b372-ceb033bb7a71,created_at=2026-07-10T04:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-230043385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=903b4b19-f787-48a1-b372-ceb033bb7a71,host='devstack@QuobyteHD#QuobyteHD',id=74bf8a7f-4a0e-4909-bd75-2669f5423227,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d433420cfd44bd99269f5c8cbd29d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:48:15Z,use_quota=True,user_id='5ab5cf40b4b0457990e4198e0c84b17d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f64fd1-4895-43ce-81f3-0ed8ba9f3f02),volume_type_id=98f64fd1-4895-43ce-81f3-0ed8ba9f3f02)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:48:15 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-8621cc5e-d29e-4dae-b97e-804d163a1529 tempest-GroupSnapshotsTest-440840859 None] Creating volume 74bf8a7f-4a0e-4909-bd75-2669f5423227 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:48:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-8621cc5e-d29e-4dae-b97e-804d163a1529 tempest-GroupSnapshotsTest-440840859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-8621cc5e-d29e-4dae-b97e-804d163a1529 tempest-GroupSnapshotsTest-440840859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:15 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-8621cc5e-d29e-4dae-b97e-804d163a1529 tempest-GroupSnapshotsTest-440840859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:48:15 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-8621cc5e-d29e-4dae-b97e-804d163a1529 tempest-GroupSnapshotsTest-440840859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:48:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-8621cc5e-d29e-4dae-b97e-804d163a1529 tempest-GroupSnapshotsTest-440840859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:15 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-8621cc5e-d29e-4dae-b97e-804d163a1529 tempest-GroupSnapshotsTest-440840859 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:48:15 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-8621cc5e-d29e-4dae-b97e-804d163a1529 tempest-GroupSnapshotsTest-440840859 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:48:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8621cc5e-d29e-4dae-b97e-804d163a1529 tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:15 devstack sudo[99357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227 1073741824 Jul 10 06:48:15 devstack sudo[99357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:15 devstack sudo[99357]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8621cc5e-d29e-4dae-b97e-804d163a1529 tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227 1073741824" returned: 0 in 0.872s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8621cc5e-d29e-4dae-b97e-804d163a1529 tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:16 devstack sudo[99365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227 Jul 10 06:48:16 devstack sudo[99365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:17 devstack sudo[99365]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8621cc5e-d29e-4dae-b97e-804d163a1529 tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227" returned: 0 in 1.041s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:17 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-8621cc5e-d29e-4dae-b97e-804d163a1529 tempest-GroupSnapshotsTest-440840859 None] <== create_volume: return (1962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:48:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-8621cc5e-d29e-4dae-b97e-804d163a1529 tempest-GroupSnapshotsTest-440840859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.964s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-8621cc5e-d29e-4dae-b97e-804d163a1529 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (513c596e-e62d-4cc1-b204-10a95f49b229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74bf8a7f-4a0e-4909-bd75-2669f5423227', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-8621cc5e-d29e-4dae-b97e-804d163a1529 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (911e21f1-3404-4e82-9d18-051e88f51f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:17 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-8621cc5e-d29e-4dae-b97e-804d163a1529 tempest-GroupSnapshotsTest-440840859 None] Volume volume-74bf8a7f-4a0e-4909-bd75-2669f5423227 (74bf8a7f-4a0e-4909-bd75-2669f5423227): created successfully Jul 10 06:48:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-8621cc5e-d29e-4dae-b97e-804d163a1529 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (911e21f1-3404-4e82-9d18-051e88f51f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-8621cc5e-d29e-4dae-b97e-804d163a1529 tempest-GroupSnapshotsTest-440840859 None] Flow 'volume_create_manager' (f241da75-ca22-4553-bbc4-dda96daec520) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:48:17 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-8621cc5e-d29e-4dae-b97e-804d163a1529 tempest-GroupSnapshotsTest-440840859 None] Created volume successfully. Jul 10 06:48:18 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-15c57ef8-d8ec-42dd-9383-152167b0aae4 tempest-GroupSnapshotsTest-440840859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:48:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-15c57ef8-d8ec-42dd-9383-152167b0aae4 tempest-GroupSnapshotsTest-440840859 None] Flow 'volume_create_manager' (f8188f2f-48c8-442f-be4a-6e3368885406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:48:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-15c57ef8-d8ec-42dd-9383-152167b0aae4 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c04a4a0b-376f-446e-9e8c-439e28e18de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-15c57ef8-d8ec-42dd-9383-152167b0aae4 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c04a4a0b-376f-446e-9e8c-439e28e18de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1707570843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=903b4b19-f787-48a1-b372-ceb033bb7a71,host='devstack@QuobyteHD#QuobyteHD',id=e5c09ff7-98b0-4f0f-b665-5d05beffd1ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d433420cfd44bd99269f5c8cbd29d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:48:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:48:18Z,use_quota=True,user_id='5ab5cf40b4b0457990e4198e0c84b17d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f64fd1-4895-43ce-81f3-0ed8ba9f3f02),volume_type_id=98f64fd1-4895-43ce-81f3-0ed8ba9f3f02)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-15c57ef8-d8ec-42dd-9383-152167b0aae4 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1a8564b-e35f-41c2-aa53-5aaef4ed96f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-15c57ef8-d8ec-42dd-9383-152167b0aae4 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1a8564b-e35f-41c2-aa53-5aaef4ed96f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-15c57ef8-d8ec-42dd-9383-152167b0aae4 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d179374-0af9-4c15-b307-d671bf4912fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-15c57ef8-d8ec-42dd-9383-152167b0aae4 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d179374-0af9-4c15-b307-d671bf4912fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5c09ff7-98b0-4f0f-b665-5d05beffd1ed', 'volume_name': 'volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-15c57ef8-d8ec-42dd-9383-152167b0aae4 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06625058-5368-448f-82f9-902b6771edaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-15c57ef8-d8ec-42dd-9383-152167b0aae4 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06625058-5368-448f-82f9-902b6771edaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-15c57ef8-d8ec-42dd-9383-152167b0aae4 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3b3a7a8-4eb4-40c9-8d57-05175215cf1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:18 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-15c57ef8-d8ec-42dd-9383-152167b0aae4 tempest-GroupSnapshotsTest-440840859 None] Volume e5c09ff7-98b0-4f0f-b665-5d05beffd1ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed', 'volume_size': 1} Jul 10 06:48:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-15c57ef8-d8ec-42dd-9383-152167b0aae4 tempest-GroupSnapshotsTest-440840859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-15c57ef8-d8ec-42dd-9383-152167b0aae4 tempest-GroupSnapshotsTest-440840859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:18 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-15c57ef8-d8ec-42dd-9383-152167b0aae4 tempest-GroupSnapshotsTest-440840859 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=903b4b19-f787-48a1-b372-ceb033bb7a71,created_at=2026-07-10T04:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1707570843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=903b4b19-f787-48a1-b372-ceb033bb7a71,host='devstack@QuobyteHD#QuobyteHD',id=e5c09ff7-98b0-4f0f-b665-5d05beffd1ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d433420cfd44bd99269f5c8cbd29d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:48:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:48:18Z,use_quota=True,user_id='5ab5cf40b4b0457990e4198e0c84b17d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98f64fd1-4895-43ce-81f3-0ed8ba9f3f02),volume_type_id=98f64fd1-4895-43ce-81f3-0ed8ba9f3f02)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:48:18 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-15c57ef8-d8ec-42dd-9383-152167b0aae4 tempest-GroupSnapshotsTest-440840859 None] Creating volume e5c09ff7-98b0-4f0f-b665-5d05beffd1ed {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:48:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-15c57ef8-d8ec-42dd-9383-152167b0aae4 tempest-GroupSnapshotsTest-440840859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-15c57ef8-d8ec-42dd-9383-152167b0aae4 tempest-GroupSnapshotsTest-440840859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:18 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-15c57ef8-d8ec-42dd-9383-152167b0aae4 tempest-GroupSnapshotsTest-440840859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:48:18 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-15c57ef8-d8ec-42dd-9383-152167b0aae4 tempest-GroupSnapshotsTest-440840859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:48:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-15c57ef8-d8ec-42dd-9383-152167b0aae4 tempest-GroupSnapshotsTest-440840859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:18 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-15c57ef8-d8ec-42dd-9383-152167b0aae4 tempest-GroupSnapshotsTest-440840859 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:48:18 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-15c57ef8-d8ec-42dd-9383-152167b0aae4 tempest-GroupSnapshotsTest-440840859 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:48:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-15c57ef8-d8ec-42dd-9383-152167b0aae4 tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:18 devstack sudo[99399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed 1073741824 Jul 10 06:48:18 devstack sudo[99399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:19 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-feb0f766-6901-40b1-a5c5-acaf40e32d27 req-923425f8-ca66-484d-a456-13a9532d9dc9 tempest-TestInstancesWithCinderVolumes-177535336 None] Terminate volume connection completed successfully. Jul 10 06:48:19 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-feb0f766-6901-40b1-a5c5-acaf40e32d27 req-923425f8-ca66-484d-a456-13a9532d9dc9 tempest-TestInstancesWithCinderVolumes-177535336 None] Deleting attachment 05f9f444-abc3-44e1-bbb9-558f0ba7fc99. {{(pid=87294) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:48:19 devstack sudo[99399]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-15c57ef8-d8ec-42dd-9383-152167b0aae4 tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed 1073741824" returned: 0 in 1.014s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-15c57ef8-d8ec-42dd-9383-152167b0aae4 tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:19 devstack sudo[99441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed Jul 10 06:48:19 devstack sudo[99441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:20 devstack sudo[99441]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-15c57ef8-d8ec-42dd-9383-152167b0aae4 tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed" returned: 0 in 0.739s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:20 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-15c57ef8-d8ec-42dd-9383-152167b0aae4 tempest-GroupSnapshotsTest-440840859 None] <== create_volume: return (1798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:48:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-15c57ef8-d8ec-42dd-9383-152167b0aae4 tempest-GroupSnapshotsTest-440840859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.801s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:20 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-15c57ef8-d8ec-42dd-9383-152167b0aae4 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3b3a7a8-4eb4-40c9-8d57-05175215cf1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:20 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-15c57ef8-d8ec-42dd-9383-152167b0aae4 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d12ab4-339b-44d0-9bb7-b447047d4e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:20 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-15c57ef8-d8ec-42dd-9383-152167b0aae4 tempest-GroupSnapshotsTest-440840859 None] Volume volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed (e5c09ff7-98b0-4f0f-b665-5d05beffd1ed): created successfully Jul 10 06:48:20 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-15c57ef8-d8ec-42dd-9383-152167b0aae4 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d12ab4-339b-44d0-9bb7-b447047d4e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:20 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-15c57ef8-d8ec-42dd-9383-152167b0aae4 tempest-GroupSnapshotsTest-440840859 None] Flow 'volume_create_manager' (f8188f2f-48c8-442f-be4a-6e3368885406) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:48:20 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-15c57ef8-d8ec-42dd-9383-152167b0aae4 tempest-GroupSnapshotsTest-440840859 None] Created volume successfully. Jul 10 06:48:20 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-43874863-d9e3-4944-a40a-4394cce1a888 tempest-GroupSnapshotsTest-440840859 None] Update group completed successfully. Jul 10 06:48:21 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:48:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:48:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:48:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:21 devstack sudo[99461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:48:21 devstack sudo[99461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:21 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-02ef1e5c-4347-4183-a3b4-b47936375e80 tempest-GroupSnapshotsTest-440840859 None] Update group completed successfully. Jul 10 06:48:22 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b2616708-1cd7-44ea-ac23-acb8a467656a tempest-TestInstancesWithCinderVolumes-177535336 None] Acquiring lock "cinder-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:48:22 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b2616708-1cd7-44ea-ac23-acb8a467656a tempest-TestInstancesWithCinderVolumes-177535336 None] Lock "cinder-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:48:22 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b2616708-1cd7-44ea-ac23-acb8a467656a tempest-TestInstancesWithCinderVolumes-177535336 None] Acquiring lock "cinder-quobyte-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:48:22 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b2616708-1cd7-44ea-ac23-acb8a467656a tempest-TestInstancesWithCinderVolumes-177535336 None] Lock "cinder-quobyte-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5" acquired by "delete_volume" :: waited 0.029s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:48:22 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-453b8a48-3d1d-49bd-b1c3-84a3bf253b0f req-0604c735-3e66-481a-9cd6-addb6731d550 tempest-TestStampPattern-1951221454 None] Terminate volume connection completed successfully. Jul 10 06:48:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-453b8a48-3d1d-49bd-b1c3-84a3bf253b0f req-0604c735-3e66-481a-9cd6-addb6731d550 tempest-TestStampPattern-1951221454 None] Deleting attachment cb38eba9-3060-4250-b4dd-c7ccb04e3141. {{(pid=87294) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:48:22 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a0ba29-b554-4372-a9c3-a1caf45254a1]: (4, 'raw') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b2616708-1cd7-44ea-ac23-acb8a467656a tempest-TestInstancesWithCinderVolumes-177535336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:22 devstack sudo[99461]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.778s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:22 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:48:22 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager._thread_info {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:48:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread count: 28 {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:48:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread info: [<_MainThread(MainThread, started 139245706264704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:48:22 devstack sudo[99467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5 Jul 10 06:48:22 devstack sudo[99467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:23 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-664e74eb-4580-4f7e-bb67-20f56117cdd5 tempest-GroupSnapshotsTest-440840859 None] Update group completed successfully. Jul 10 06:48:23 devstack sudo[99467]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b2616708-1cd7-44ea-ac23-acb8a467656a tempest-TestInstancesWithCinderVolumes-177535336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5" returned: 0 in 0.806s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b2616708-1cd7-44ea-ac23-acb8a467656a tempest-TestInstancesWithCinderVolumes-177535336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:23 devstack sudo[99485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5 Jul 10 06:48:23 devstack sudo[99485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:24 devstack sudo[99485]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b2616708-1cd7-44ea-ac23-acb8a467656a tempest-TestInstancesWithCinderVolumes-177535336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5" returned: 1 in 0.787s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b2616708-1cd7-44ea-ac23-acb8a467656a tempest-TestInstancesWithCinderVolumes-177535336 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5' failed. Not Retrying. {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:48:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b2616708-1cd7-44ea-ac23-acb8a467656a tempest-TestInstancesWithCinderVolumes-177535336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:24 devstack sudo[99498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5 Jul 10 06:48:24 devstack sudo[99498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:24 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-dd11e09e-f5a8-4e36-98f3-74d5d282ead0 tempest-GroupSnapshotsTest-440840859 None] Update group completed successfully. Jul 10 06:48:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-8ea2ddac-8ce1-4702-952b-d7f0046498dc req-65aa8e13-2ce9-415d-9bad-5de58f0a38cb tempest-TestServerVolumeAttachmentScenario-1734695340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-8ea2ddac-8ce1-4702-952b-d7f0046498dc req-65aa8e13-2ce9-415d-9bad-5de58f0a38cb tempest-TestServerVolumeAttachmentScenario-1734695340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:24 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c58e175-036a-4480-85f2-012c95a036f5]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-8ea2ddac-8ce1-4702-952b-d7f0046498dc req-65aa8e13-2ce9-415d-9bad-5de58f0a38cb tempest-TestServerVolumeAttachmentScenario-1734695340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a65c7665-8867-4a0a-8c90-dac792e801bb {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:24 devstack sudo[99500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a65c7665-8867-4a0a-8c90-dac792e801bb Jul 10 06:48:24 devstack sudo[99500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9b21ce9f-3505-45cc-be8c-f11afa919329 tempest-TestStampPattern-1951221454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:24 devstack sudo[99498]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b2616708-1cd7-44ea-ac23-acb8a467656a tempest-TestInstancesWithCinderVolumes-177535336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5" returned: 0 in 0.739s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:24 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b2616708-1cd7-44ea-ac23-acb8a467656a tempest-TestInstancesWithCinderVolumes-177535336 None] Lock "cinder-quobyte-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5" released by "delete_volume" :: held 2.416s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:24 devstack cinder-volume[87294]: WARNING cinder.quota [None req-b2616708-1cd7-44ea-ac23-acb8a467656a tempest-TestInstancesWithCinderVolumes-177535336 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-615956426-798465927 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-615956426-798465927, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:48:24 devstack cinder-volume[87294]: WARNING cinder.quota [None req-b2616708-1cd7-44ea-ac23-acb8a467656a tempest-TestInstancesWithCinderVolumes-177535336 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-615956426-798465927 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-615956426-798465927, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:48:24 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-b2616708-1cd7-44ea-ac23-acb8a467656a tempest-TestInstancesWithCinderVolumes-177535336 None] Created reservations ['bb8c07bb-5fa4-4aef-a222-b7aa8d84ca21', '88609e05-0994-4ff8-8227-d5bcde25b557', '81298b68-ee2f-4b94-af4c-01e10bfec53e', 'e343e1fd-af8d-436b-ac8f-b925ec3b671e'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:48:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b2616708-1cd7-44ea-ac23-acb8a467656a tempest-TestInstancesWithCinderVolumes-177535336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b2616708-1cd7-44ea-ac23-acb8a467656a tempest-TestInstancesWithCinderVolumes-177535336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:25 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b2616708-1cd7-44ea-ac23-acb8a467656a tempest-TestInstancesWithCinderVolumes-177535336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:48:25 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b2616708-1cd7-44ea-ac23-acb8a467656a tempest-TestInstancesWithCinderVolumes-177535336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:48:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b2616708-1cd7-44ea-ac23-acb8a467656a tempest-TestInstancesWithCinderVolumes-177535336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b2616708-1cd7-44ea-ac23-acb8a467656a tempest-TestInstancesWithCinderVolumes-177535336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:25 devstack sudo[99505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:48:25 devstack sudo[99505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:25 devstack sudo[99500]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-8ea2ddac-8ce1-4702-952b-d7f0046498dc req-65aa8e13-2ce9-415d-9bad-5de58f0a38cb tempest-TestServerVolumeAttachmentScenario-1734695340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a65c7665-8867-4a0a-8c90-dac792e801bb" returned: 0 in 0.854s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-8ea2ddac-8ce1-4702-952b-d7f0046498dc req-65aa8e13-2ce9-415d-9bad-5de58f0a38cb tempest-TestServerVolumeAttachmentScenario-1734695340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.896s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9b21ce9f-3505-45cc-be8c-f11afa919329 tempest-TestStampPattern-1951221454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.532s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:25 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-9b21ce9f-3505-45cc-be8c-f11afa919329 tempest-TestStampPattern-1951221454 None] Creating offline snapshot b1e902ea-f893-442d-be2c-e4a2c06bdd35 of volume 2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8 {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:48:25 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b45be55-4d0a-41fa-aa70-1175774424db]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9b21ce9f-3505-45cc-be8c-f11afa919329 tempest-TestStampPattern-1951221454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:25 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-8ea2ddac-8ce1-4702-952b-d7f0046498dc req-65aa8e13-2ce9-415d-9bad-5de58f0a38cb tempest-TestServerVolumeAttachmentScenario-1734695340 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804', 'name': 'volume-a65c7665-8867-4a0a-8c90-dac792e801bb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ccd9e132-76aa-4a98-bd20-368d6dfbe205', 'enforce_multipath': True} {{(pid=87294) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:48:25 devstack sudo[99508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8 Jul 10 06:48:25 devstack sudo[99508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:25 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-8ea2ddac-8ce1-4702-952b-d7f0046498dc req-65aa8e13-2ce9-415d-9bad-5de58f0a38cb tempest-TestServerVolumeAttachmentScenario-1734695340 None] attachment_update completed successfully. Jul 10 06:48:25 devstack sudo[99505]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b2616708-1cd7-44ea-ac23-acb8a467656a tempest-TestInstancesWithCinderVolumes-177535336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.772s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:25 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-b2616708-1cd7-44ea-ac23-acb8a467656a tempest-TestInstancesWithCinderVolumes-177535336 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:48:25 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-b2616708-1cd7-44ea-ac23-acb8a467656a tempest-TestInstancesWithCinderVolumes-177535336 None] Deleted volume successfully. Jul 10 06:48:25 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b2616708-1cd7-44ea-ac23-acb8a467656a tempest-TestInstancesWithCinderVolumes-177535336 None] Lock "cinder-0980f2aa-516f-40a7-8d8f-f0547bb4a8d5-delete_volume" released by "delete_volume" :: held 3.462s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:25 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-c9a8fcd5-bfb0-41d0-9c4a-916ee6dcad15 tempest-GroupSnapshotsTest-440840859 None] GroupSnapshot b39a2911-269b-4bcc-b05d-89db1db35d4f: creating. Jul 10 06:48:25 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c9a8fcd5-bfb0-41d0-9c4a-916ee6dcad15 tempest-GroupSnapshotsTest-440840859 None] Group snapshot b39a2911-269b-4bcc-b05d-89db1db35d4f: creating. {{(pid=87294) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 10 06:48:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c9a8fcd5-bfb0-41d0-9c4a-916ee6dcad15 tempest-GroupSnapshotsTest-440840859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:26 devstack sudo[99508]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9b21ce9f-3505-45cc-be8c-f11afa919329 tempest-TestStampPattern-1951221454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8" returned: 0 in 1.003s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9b21ce9f-3505-45cc-be8c-f11afa919329 tempest-TestStampPattern-1951221454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8.b1e902ea-f893-442d-be2c-e4a2c06bdd35 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:26 devstack sudo[99581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8.b1e902ea-f893-442d-be2c-e4a2c06bdd35 1G Jul 10 06:48:26 devstack sudo[99581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:27 devstack sudo[99581]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9b21ce9f-3505-45cc-be8c-f11afa919329 tempest-TestStampPattern-1951221454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8.b1e902ea-f893-442d-be2c-e4a2c06bdd35 1G" returned: 0 in 0.980s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9b21ce9f-3505-45cc-be8c-f11afa919329 tempest-TestStampPattern-1951221454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8.b1e902ea-f893-442d-be2c-e4a2c06bdd35 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:27 devstack sudo[99902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8.b1e902ea-f893-442d-be2c-e4a2c06bdd35 Jul 10 06:48:27 devstack sudo[99902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:27 devstack sudo[99902]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9b21ce9f-3505-45cc-be8c-f11afa919329 tempest-TestStampPattern-1951221454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8.b1e902ea-f893-442d-be2c-e4a2c06bdd35" returned: 0 in 0.685s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:27 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-9b21ce9f-3505-45cc-be8c-f11afa919329 tempest-TestStampPattern-1951221454 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8.b1e902ea-f893-442d-be2c-e4a2c06bdd35 is being set with open permissions: ugo+rw Jul 10 06:48:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9b21ce9f-3505-45cc-be8c-f11afa919329 tempest-TestStampPattern-1951221454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8.b1e902ea-f893-442d-be2c-e4a2c06bdd35 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:27 devstack sudo[99908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8.b1e902ea-f893-442d-be2c-e4a2c06bdd35 Jul 10 06:48:27 devstack sudo[99908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:28 devstack sudo[99908]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9b21ce9f-3505-45cc-be8c-f11afa919329 tempest-TestStampPattern-1951221454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8.b1e902ea-f893-442d-be2c-e4a2c06bdd35" returned: 0 in 0.643s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9b21ce9f-3505-45cc-be8c-f11afa919329 tempest-TestStampPattern-1951221454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:28 devstack sudo[99911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8.info Jul 10 06:48:28 devstack sudo[99911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:29 devstack sudo[99911]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9b21ce9f-3505-45cc-be8c-f11afa919329 tempest-TestStampPattern-1951221454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8.info" returned: 0 in 0.737s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:29 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-9b21ce9f-3505-45cc-be8c-f11afa919329 tempest-TestStampPattern-1951221454 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8.info is being set with open permissions: ugo+rw Jul 10 06:48:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9b21ce9f-3505-45cc-be8c-f11afa919329 tempest-TestStampPattern-1951221454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:29 devstack sudo[99915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8.info Jul 10 06:48:29 devstack sudo[99915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:30 devstack sudo[99915]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9b21ce9f-3505-45cc-be8c-f11afa919329 tempest-TestStampPattern-1951221454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8.info" returned: 0 in 0.718s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9b21ce9f-3505-45cc-be8c-f11afa919329 tempest-TestStampPattern-1951221454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.873s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c9a8fcd5-bfb0-41d0-9c4a-916ee6dcad15 tempest-GroupSnapshotsTest-440840859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.146s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:30 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-c9a8fcd5-bfb0-41d0-9c4a-916ee6dcad15 tempest-GroupSnapshotsTest-440840859 None] Creating offline snapshot 5544178f-a462-4d1d-820e-31d50d9b4775 of volume e5c09ff7-98b0-4f0f-b665-5d05beffd1ed {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:48:30 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-9b21ce9f-3505-45cc-be8c-f11afa919329 tempest-TestStampPattern-1951221454 None] Create snapshot completed successfully Jul 10 06:48:30 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d8302b-0d46-446d-a299-e4e2eaa4b647]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c9a8fcd5-bfb0-41d0-9c4a-916ee6dcad15 tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:30 devstack sudo[99919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed Jul 10 06:48:30 devstack sudo[99919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:31 devstack sudo[99919]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c9a8fcd5-bfb0-41d0-9c4a-916ee6dcad15 tempest-GroupSnapshotsTest-440840859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed" returned: 0 in 1.105s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c9a8fcd5-bfb0-41d0-9c4a-916ee6dcad15 tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed.5544178f-a462-4d1d-820e-31d50d9b4775 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:31 devstack sudo[99928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed.5544178f-a462-4d1d-820e-31d50d9b4775 1G Jul 10 06:48:31 devstack sudo[99928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:32 devstack sudo[99928]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c9a8fcd5-bfb0-41d0-9c4a-916ee6dcad15 tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed.5544178f-a462-4d1d-820e-31d50d9b4775 1G" returned: 0 in 1.008s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c9a8fcd5-bfb0-41d0-9c4a-916ee6dcad15 tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed.5544178f-a462-4d1d-820e-31d50d9b4775 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:32 devstack sudo[99937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed.5544178f-a462-4d1d-820e-31d50d9b4775 Jul 10 06:48:32 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:33 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c9a8fcd5-bfb0-41d0-9c4a-916ee6dcad15 tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed.5544178f-a462-4d1d-820e-31d50d9b4775" returned: 0 in 0.867s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:33 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-c9a8fcd5-bfb0-41d0-9c4a-916ee6dcad15 tempest-GroupSnapshotsTest-440840859 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed.5544178f-a462-4d1d-820e-31d50d9b4775 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 06:48:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c9a8fcd5-bfb0-41d0-9c4a-916ee6dcad15 tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed.5544178f-a462-4d1d-820e-31d50d9b4775 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:33 devstack sudo[99945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed.5544178f-a462-4d1d-820e-31d50d9b4775 Jul 10 06:48:33 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:33 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c9a8fcd5-bfb0-41d0-9c4a-916ee6dcad15 tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed.5544178f-a462-4d1d-820e-31d50d9b4775" returned: 0 in 0.736s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c9a8fcd5-bfb0-41d0-9c4a-916ee6dcad15 tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:33 devstack sudo[99949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed.info Jul 10 06:48:33 devstack sudo[99949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:34 devstack sudo[99949]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c9a8fcd5-bfb0-41d0-9c4a-916ee6dcad15 tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed.info" returned: 0 in 0.710s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:34 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-c9a8fcd5-bfb0-41d0-9c4a-916ee6dcad15 tempest-GroupSnapshotsTest-440840859 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 06:48:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c9a8fcd5-bfb0-41d0-9c4a-916ee6dcad15 tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:34 devstack sudo[99952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed.info Jul 10 06:48:34 devstack sudo[99952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:35 devstack sudo[99952]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c9a8fcd5-bfb0-41d0-9c4a-916ee6dcad15 tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed.info" returned: 0 in 0.727s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c9a8fcd5-bfb0-41d0-9c4a-916ee6dcad15 tempest-GroupSnapshotsTest-440840859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.338s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c9a8fcd5-bfb0-41d0-9c4a-916ee6dcad15 tempest-GroupSnapshotsTest-440840859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c9a8fcd5-bfb0-41d0-9c4a-916ee6dcad15 tempest-GroupSnapshotsTest-440840859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:35 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-c9a8fcd5-bfb0-41d0-9c4a-916ee6dcad15 tempest-GroupSnapshotsTest-440840859 None] Creating offline snapshot e6035832-e91e-4a18-a807-2544ce35a080 of volume 74bf8a7f-4a0e-4909-bd75-2669f5423227 {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:48:35 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[3464cb4d-beae-4daf-8930-a906670eb9d9]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c9a8fcd5-bfb0-41d0-9c4a-916ee6dcad15 tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:35 devstack sudo[99955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227 Jul 10 06:48:35 devstack sudo[99955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-630686cc-0317-4f96-b0ce-eb99eefe074d req-c0a6c09f-10f7-4116-b92f-03b79eb4c407 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:36 devstack sudo[99955]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c9a8fcd5-bfb0-41d0-9c4a-916ee6dcad15 tempest-GroupSnapshotsTest-440840859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227" returned: 0 in 0.850s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c9a8fcd5-bfb0-41d0-9c4a-916ee6dcad15 tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227.e6035832-e91e-4a18-a807-2544ce35a080 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:36 devstack sudo[99979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227.e6035832-e91e-4a18-a807-2544ce35a080 1G Jul 10 06:48:36 devstack sudo[99979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:37 devstack sudo[99979]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c9a8fcd5-bfb0-41d0-9c4a-916ee6dcad15 tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227.e6035832-e91e-4a18-a807-2544ce35a080 1G" returned: 0 in 0.997s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c9a8fcd5-bfb0-41d0-9c4a-916ee6dcad15 tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74bf8a7f-4a0e-4909-bd75-2669f5423227 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227.e6035832-e91e-4a18-a807-2544ce35a080 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:37 devstack sudo[100009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74bf8a7f-4a0e-4909-bd75-2669f5423227 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227.e6035832-e91e-4a18-a807-2544ce35a080 Jul 10 06:48:37 devstack sudo[100009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:38 devstack sudo[100009]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c9a8fcd5-bfb0-41d0-9c4a-916ee6dcad15 tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74bf8a7f-4a0e-4909-bd75-2669f5423227 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227.e6035832-e91e-4a18-a807-2544ce35a080" returned: 0 in 0.797s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:38 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-c9a8fcd5-bfb0-41d0-9c4a-916ee6dcad15 tempest-GroupSnapshotsTest-440840859 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227.e6035832-e91e-4a18-a807-2544ce35a080 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 06:48:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c9a8fcd5-bfb0-41d0-9c4a-916ee6dcad15 tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227.e6035832-e91e-4a18-a807-2544ce35a080 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:38 devstack sudo[100014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227.e6035832-e91e-4a18-a807-2544ce35a080 Jul 10 06:48:38 devstack sudo[100014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:38 devstack sudo[100014]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c9a8fcd5-bfb0-41d0-9c4a-916ee6dcad15 tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227.e6035832-e91e-4a18-a807-2544ce35a080" returned: 0 in 0.719s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c9a8fcd5-bfb0-41d0-9c4a-916ee6dcad15 tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:38 devstack sudo[100017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227.info Jul 10 06:48:38 devstack sudo[100017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:39 devstack sudo[100017]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c9a8fcd5-bfb0-41d0-9c4a-916ee6dcad15 tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227.info" returned: 0 in 0.745s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:39 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-c9a8fcd5-bfb0-41d0-9c4a-916ee6dcad15 tempest-GroupSnapshotsTest-440840859 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 06:48:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c9a8fcd5-bfb0-41d0-9c4a-916ee6dcad15 tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:39 devstack sudo[100021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227.info Jul 10 06:48:39 devstack sudo[100021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:40 devstack sudo[100021]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c9a8fcd5-bfb0-41d0-9c4a-916ee6dcad15 tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227.info" returned: 0 in 0.804s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c9a8fcd5-bfb0-41d0-9c4a-916ee6dcad15 tempest-GroupSnapshotsTest-440840859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.034s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-630686cc-0317-4f96-b0ce-eb99eefe074d req-c0a6c09f-10f7-4116-b92f-03b79eb4c407 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.282s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:40 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e16de1a-43ae-433b-814b-a87e3b5a3d8c]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-630686cc-0317-4f96-b0ce-eb99eefe074d req-c0a6c09f-10f7-4116-b92f-03b79eb4c407 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-097fce46-4bd1-4005-839c-cc6c88225274 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:40 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-c9a8fcd5-bfb0-41d0-9c4a-916ee6dcad15 tempest-GroupSnapshotsTest-440840859 None] group_snapshot b39a2911-269b-4bcc-b05d-89db1db35d4f: created successfully Jul 10 06:48:40 devstack sudo[100024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-097fce46-4bd1-4005-839c-cc6c88225274 Jul 10 06:48:40 devstack sudo[100024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:40 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-15ac0a6d-3069-41d4-8b03-25ebd96184ee tempest-GroupSnapshotsTest-440840859 None] group_snapshot b39a2911-269b-4bcc-b05d-89db1db35d4f: deleting Jul 10 06:48:40 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-15ac0a6d-3069-41d4-8b03-25ebd96184ee tempest-GroupSnapshotsTest-440840859 None] group_snapshot b39a2911-269b-4bcc-b05d-89db1db35d4f: deleting {{(pid=87294) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 10 06:48:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-15ac0a6d-3069-41d4-8b03-25ebd96184ee tempest-GroupSnapshotsTest-440840859 None] Acquiring lock "cinder-quobyte-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:48:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-15ac0a6d-3069-41d4-8b03-25ebd96184ee tempest-GroupSnapshotsTest-440840859 None] Lock "cinder-quobyte-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:48:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-15ac0a6d-3069-41d4-8b03-25ebd96184ee tempest-GroupSnapshotsTest-440840859 None] Acquiring lock "cinder-quobyte-5544178f-a462-4d1d-820e-31d50d9b4775" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:48:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-15ac0a6d-3069-41d4-8b03-25ebd96184ee tempest-GroupSnapshotsTest-440840859 None] Lock "cinder-quobyte-5544178f-a462-4d1d-820e-31d50d9b4775" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:48:41 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-15ac0a6d-3069-41d4-8b03-25ebd96184ee tempest-GroupSnapshotsTest-440840859 None] Deleting offline snapshot 5544178f-a462-4d1d-820e-31d50d9b4775 of volume e5c09ff7-98b0-4f0f-b665-5d05beffd1ed {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:48:41 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-15ac0a6d-3069-41d4-8b03-25ebd96184ee tempest-GroupSnapshotsTest-440840859 None] snapshot_file for this snap is: volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed.5544178f-a462-4d1d-820e-31d50d9b4775 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:48:41 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de29522-ab54-4b1f-a7c1-585ac99a1282]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-15ac0a6d-3069-41d4-8b03-25ebd96184ee tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed.5544178f-a462-4d1d-820e-31d50d9b4775 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:41 devstack sudo[100026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed.5544178f-a462-4d1d-820e-31d50d9b4775 Jul 10 06:48:41 devstack sudo[100026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:41 devstack sudo[100024]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-630686cc-0317-4f96-b0ce-eb99eefe074d req-c0a6c09f-10f7-4116-b92f-03b79eb4c407 tempest-TestServerVolumeAttachmentScenario-1734695340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-097fce46-4bd1-4005-839c-cc6c88225274" returned: 0 in 1.043s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-630686cc-0317-4f96-b0ce-eb99eefe074d req-c0a6c09f-10f7-4116-b92f-03b79eb4c407 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.073s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:41 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-630686cc-0317-4f96-b0ce-eb99eefe074d req-c0a6c09f-10f7-4116-b92f-03b79eb4c407 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804', 'name': 'volume-097fce46-4bd1-4005-839c-cc6c88225274', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '48395cf1-2a7a-404d-8f70-7444e5deefae', 'enforce_multipath': True} {{(pid=87294) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:48:41 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-630686cc-0317-4f96-b0ce-eb99eefe074d req-c0a6c09f-10f7-4116-b92f-03b79eb4c407 tempest-TestServerVolumeAttachmentScenario-1734695340 None] attachment_update completed successfully. Jul 10 06:48:42 devstack sudo[100026]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-15ac0a6d-3069-41d4-8b03-25ebd96184ee tempest-GroupSnapshotsTest-440840859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed.5544178f-a462-4d1d-820e-31d50d9b4775" returned: 0 in 0.992s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:42 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-15ac0a6d-3069-41d4-8b03-25ebd96184ee tempest-GroupSnapshotsTest-440840859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:48:42 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[32967249-7a70-476e-a172-2792a5137cc7]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-15ac0a6d-3069-41d4-8b03-25ebd96184ee tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:42 devstack sudo[100034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed Jul 10 06:48:42 devstack sudo[100034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:42 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:48:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Flow 'volume_create_manager' (1f695e01-f277-42ed-86c7-25319306d430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:48:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45d548e9-85b2-445e-aa4f-0c7c2a21d642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45d548e9-85b2-445e-aa4f-0c7c2a21d642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:48:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1949288065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8416e04e-7ebe-45fb-9bd2-c3eb7d42087a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01abf5b3c15c4a19aa038505bd0b68e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b1e902ea-f893-442d-be2c-e4a2c06bdd35,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:48:43Z,use_quota=True,user_id='d3d93bd21b904e01ae44515bc78d151f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c043f08-a035-47f8-ad62-890447a7d51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c043f08-a035-47f8-ad62-890447a7d51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd5cc01f-b0a9-40fd-a664-8b50e97d7cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd5cc01f-b0a9-40fd-a664-8b50e97d7cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8416e04e-7ebe-45fb-9bd2-c3eb7d42087a', 'volume_name': 'volume-8416e04e-7ebe-45fb-9bd2-c3eb7d42087a', 'volume_size': 1, 'snapshot_id': 'b1e902ea-f893-442d-be2c-e4a2c06bdd35'}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2cfbbbe-0d91-4919-a967-d0c2a422ee57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2cfbbbe-0d91-4919-a967-d0c2a422ee57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc7a47ad-322d-4a7e-a0db-d08de7306869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:42 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Volume 8416e04e-7ebe-45fb-9bd2-c3eb7d42087a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8416e04e-7ebe-45fb-9bd2-c3eb7d42087a', 'volume_size': 1, 'snapshot_id': 'b1e902ea-f893-442d-be2c-e4a2c06bdd35'} Jul 10 06:48:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Acquiring lock "cinder-quobyte-b1e902ea-f893-442d-be2c-e4a2c06bdd35-8416e04e-7ebe-45fb-9bd2-c3eb7d42087a" by "_create_volume_from_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:48:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Lock "cinder-quobyte-b1e902ea-f893-442d-be2c-e4a2c06bdd35-8416e04e-7ebe-45fb-9bd2-c3eb7d42087a" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:48:42 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Creating volume 8416e04e-7ebe-45fb-9bd2-c3eb7d42087a from snapshot b1e902ea-f893-442d-be2c-e4a2c06bdd35 {{(pid=87294) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 06:48:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:42 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:48:43 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:48:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:43 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:48:43 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Acquiring lock "cinder-quobyte-8416e04e-7ebe-45fb-9bd2-c3eb7d42087a" by "_copy_volume_from_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:48:43 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Lock "cinder-quobyte-8416e04e-7ebe-45fb-9bd2-c3eb7d42087a" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:48:43 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] snapshot: b1e902ea-f893-442d-be2c-e4a2c06bdd35, volume: 8416e04e-7ebe-45fb-9bd2-c3eb7d42087a, {{(pid=87294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 06:48:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:43 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:48:43 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:48:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:43 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[09eafe5d-6e95-49f5-aa5f-c08cfd794e8a]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8.b1e902ea-f893-442d-be2c-e4a2c06bdd35 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:43 devstack sudo[100034]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-15ac0a6d-3069-41d4-8b03-25ebd96184ee tempest-GroupSnapshotsTest-440840859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed" returned: 0 in 1.105s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-15ac0a6d-3069-41d4-8b03-25ebd96184ee tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed.5544178f-a462-4d1d-820e-31d50d9b4775 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:43 devstack sudo[100042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed.5544178f-a462-4d1d-820e-31d50d9b4775 Jul 10 06:48:43 devstack sudo[100042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:43 devstack sudo[100041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8.b1e902ea-f893-442d-be2c-e4a2c06bdd35 Jul 10 06:48:43 devstack sudo[100041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:44 devstack sudo[100041]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8.b1e902ea-f893-442d-be2c-e4a2c06bdd35" returned: 0 in 0.972s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:44 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:48:44 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8 {{(pid=87294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 06:48:44 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Creating direct copy from snapshot {{(pid=87294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 06:48:44 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b9035b-5170-4eb5-a41d-5190974b12da]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:44 devstack sudo[100042]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-15ac0a6d-3069-41d4-8b03-25ebd96184ee tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed.5544178f-a462-4d1d-820e-31d50d9b4775" returned: 0 in 0.965s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-15ac0a6d-3069-41d4-8b03-25ebd96184ee tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed.5544178f-a462-4d1d-820e-31d50d9b4775 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:44 devstack sudo[100057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed.5544178f-a462-4d1d-820e-31d50d9b4775 Jul 10 06:48:44 devstack sudo[100057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:44 devstack sudo[100056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8 Jul 10 06:48:44 devstack sudo[100056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:45 devstack sudo[100057]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-15ac0a6d-3069-41d4-8b03-25ebd96184ee tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed.5544178f-a462-4d1d-820e-31d50d9b4775" returned: 0 in 0.839s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:45 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-15ac0a6d-3069-41d4-8b03-25ebd96184ee tempest-GroupSnapshotsTest-440840859 None] Lock "cinder-quobyte-5544178f-a462-4d1d-820e-31d50d9b4775" released by "_delete_snapshot" :: held 4.032s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:45 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-15ac0a6d-3069-41d4-8b03-25ebd96184ee tempest-GroupSnapshotsTest-440840859 None] Lock "cinder-quobyte-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed" released by "delete_snapshot" :: held 4.077s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:45 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-15ac0a6d-3069-41d4-8b03-25ebd96184ee tempest-GroupSnapshotsTest-440840859 None] Acquiring lock "cinder-quobyte-74bf8a7f-4a0e-4909-bd75-2669f5423227" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:48:45 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-15ac0a6d-3069-41d4-8b03-25ebd96184ee tempest-GroupSnapshotsTest-440840859 None] Lock "cinder-quobyte-74bf8a7f-4a0e-4909-bd75-2669f5423227" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:48:45 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-15ac0a6d-3069-41d4-8b03-25ebd96184ee tempest-GroupSnapshotsTest-440840859 None] Acquiring lock "cinder-quobyte-e6035832-e91e-4a18-a807-2544ce35a080" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:48:45 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-15ac0a6d-3069-41d4-8b03-25ebd96184ee tempest-GroupSnapshotsTest-440840859 None] Lock "cinder-quobyte-e6035832-e91e-4a18-a807-2544ce35a080" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:48:45 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-15ac0a6d-3069-41d4-8b03-25ebd96184ee tempest-GroupSnapshotsTest-440840859 None] Deleting offline snapshot e6035832-e91e-4a18-a807-2544ce35a080 of volume 74bf8a7f-4a0e-4909-bd75-2669f5423227 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:48:45 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-15ac0a6d-3069-41d4-8b03-25ebd96184ee tempest-GroupSnapshotsTest-440840859 None] snapshot_file for this snap is: volume-74bf8a7f-4a0e-4909-bd75-2669f5423227.e6035832-e91e-4a18-a807-2544ce35a080 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:48:45 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[08935bb4-9fb0-439e-b461-ec04c6a77831]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-15ac0a6d-3069-41d4-8b03-25ebd96184ee tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227.e6035832-e91e-4a18-a807-2544ce35a080 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:45 devstack sudo[100056]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8" returned: 0 in 1.267s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:45 devstack cinder-volume[87294]: DEBUG cinder.utils [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Path /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8416e04e-7ebe-45fb-9bd2-c3eb7d42087a not found in is_blk_device check {{(pid=87294) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 06:48:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8416e04e-7ebe-45fb-9bd2-c3eb7d42087a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:45 devstack sudo[100064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227.e6035832-e91e-4a18-a807-2544ce35a080 Jul 10 06:48:45 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:45 devstack sudo[100065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8416e04e-7ebe-45fb-9bd2-c3eb7d42087a Jul 10 06:48:45 devstack sudo[100065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:46 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-15ac0a6d-3069-41d4-8b03-25ebd96184ee tempest-GroupSnapshotsTest-440840859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227.e6035832-e91e-4a18-a807-2544ce35a080" returned: 0 in 1.123s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:46 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-15ac0a6d-3069-41d4-8b03-25ebd96184ee tempest-GroupSnapshotsTest-440840859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74bf8a7f-4a0e-4909-bd75-2669f5423227(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:48:46 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c41961-eee7-4342-9532-642c50cd93f7]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-15ac0a6d-3069-41d4-8b03-25ebd96184ee tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:46 devstack sudo[100100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227 Jul 10 06:48:46 devstack sudo[100100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:48 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-d8bbcb8b-e7d3-4e0a-bce6-7648633ed237 req-e150431d-b0c5-4df4-8fd4-bd4522df84a5 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Terminate volume connection completed successfully. Jul 10 06:48:48 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-d8bbcb8b-e7d3-4e0a-bce6-7648633ed237 req-e150431d-b0c5-4df4-8fd4-bd4522df84a5 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Deleting attachment 48395cf1-2a7a-404d-8f70-7444e5deefae. {{(pid=87294) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:48:48 devstack sudo[100100]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-15ac0a6d-3069-41d4-8b03-25ebd96184ee tempest-GroupSnapshotsTest-440840859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227" returned: 0 in 2.078s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-15ac0a6d-3069-41d4-8b03-25ebd96184ee tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227.e6035832-e91e-4a18-a807-2544ce35a080 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:48 devstack sudo[100113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227.e6035832-e91e-4a18-a807-2544ce35a080 Jul 10 06:48:48 devstack sudo[100113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:51 devstack sudo[100113]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-15ac0a6d-3069-41d4-8b03-25ebd96184ee tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227.e6035832-e91e-4a18-a807-2544ce35a080" returned: 0 in 2.463s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-15ac0a6d-3069-41d4-8b03-25ebd96184ee tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227.e6035832-e91e-4a18-a807-2544ce35a080 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:51 devstack sudo[100119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227.e6035832-e91e-4a18-a807-2544ce35a080 Jul 10 06:48:51 devstack sudo[100119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:52 devstack sudo[100119]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-15ac0a6d-3069-41d4-8b03-25ebd96184ee tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227.e6035832-e91e-4a18-a807-2544ce35a080" returned: 0 in 1.676s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:52 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-15ac0a6d-3069-41d4-8b03-25ebd96184ee tempest-GroupSnapshotsTest-440840859 None] Lock "cinder-quobyte-e6035832-e91e-4a18-a807-2544ce35a080" released by "_delete_snapshot" :: held 7.551s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:52 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-15ac0a6d-3069-41d4-8b03-25ebd96184ee tempest-GroupSnapshotsTest-440840859 None] Lock "cinder-quobyte-74bf8a7f-4a0e-4909-bd75-2669f5423227" released by "delete_snapshot" :: held 7.590s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:52 devstack sudo[100065]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8416e04e-7ebe-45fb-9bd2-c3eb7d42087a" returned: 0 in 7.414s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:52 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bad39de-a26d-41f7-8dd8-f5f2dd923df9]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:53 devstack cinder-volume[87294]: WARNING cinder.quota [None req-15ac0a6d-3069-41d4-8b03-25ebd96184ee tempest-GroupSnapshotsTest-440840859 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1788987990 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1788987990, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:48:53 devstack cinder-volume[87294]: WARNING cinder.quota [None req-15ac0a6d-3069-41d4-8b03-25ebd96184ee tempest-GroupSnapshotsTest-440840859 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1788987990 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1788987990, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:48:53 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-15ac0a6d-3069-41d4-8b03-25ebd96184ee tempest-GroupSnapshotsTest-440840859 None] Created reservations ['7be9b944-09cc-4a61-82f4-02b46fb450ed', '856e0508-7dde-4437-91bd-82366cd1513c', 'f47ec2d9-8d82-499f-a3c9-0ee1c6b661c8', 'fbebe305-576e-42e7-a119-f4604ff07500'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:48:53 devstack sudo[100122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8 Jul 10 06:48:53 devstack sudo[100122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:53 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-15ac0a6d-3069-41d4-8b03-25ebd96184ee tempest-GroupSnapshotsTest-440840859 None] Created reservations ['36842e43-7e38-4576-a5c4-fe497e427586', '1826e2b7-167c-4a59-acb5-4f8cad7f6af0', 'd0fb40d1-dec2-492c-8540-c75053c84424', '94505147-00d7-42f9-a535-e896f080c4f5'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:48:53 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-15ac0a6d-3069-41d4-8b03-25ebd96184ee tempest-GroupSnapshotsTest-440840859 None] group_snapshot b39a2911-269b-4bcc-b05d-89db1db35d4f: deleted successfully Jul 10 06:48:53 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-428a2863-813f-4748-b7dc-6587c9108c43 req-6cac70de-1898-49e5-8b64-0ee484af1b6a tempest-TestServerVolumeAttachmentScenario-1734695340 None] Terminate volume connection completed successfully. Jul 10 06:48:53 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-428a2863-813f-4748-b7dc-6587c9108c43 req-6cac70de-1898-49e5-8b64-0ee484af1b6a tempest-TestServerVolumeAttachmentScenario-1734695340 None] Deleting attachment ccd9e132-76aa-4a98-bd20-368d6dfbe205. {{(pid=87294) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:48:54 devstack sudo[100122]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8" returned: 0 in 1.458s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:54 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8, size 1024.00 MB, duration 7.42 sec, destination /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8416e04e-7ebe-45fb-9bd2-c3eb7d42087a {{(pid=87294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 06:48:54 devstack cinder-volume[87294]: INFO cinder.image.image_utils [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Converted 1024.00 MB image at 138.04 MB/s Jul 10 06:48:54 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8416e04e-7ebe-45fb-9bd2-c3eb7d42087a is being set with open permissions: ugo+rw Jul 10 06:48:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8416e04e-7ebe-45fb-9bd2-c3eb7d42087a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:54 devstack sudo[100132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8416e04e-7ebe-45fb-9bd2-c3eb7d42087a Jul 10 06:48:54 devstack sudo[100132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-24de39ac-1bbe-439e-a0a4-5494cb41d11a tempest-GroupSnapshotsTest-440840859 None] Acquiring lock "cinder-quobyte-74bf8a7f-4a0e-4909-bd75-2669f5423227" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:48:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-24de39ac-1bbe-439e-a0a4-5494cb41d11a tempest-GroupSnapshotsTest-440840859 None] Lock "cinder-quobyte-74bf8a7f-4a0e-4909-bd75-2669f5423227" acquired by "delete_volume" :: waited 0.078s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:48:55 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa02c507-f9b1-44c1-9fd9-a2727233376c]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-24de39ac-1bbe-439e-a0a4-5494cb41d11a tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:55 devstack sudo[100151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227 Jul 10 06:48:55 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:55 devstack sudo[100132]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8416e04e-7ebe-45fb-9bd2-c3eb7d42087a" returned: 0 in 1.535s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Lock "cinder-quobyte-8416e04e-7ebe-45fb-9bd2-c3eb7d42087a" released by "_copy_volume_from_snapshot" :: held 12.846s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Lock "cinder-quobyte-b1e902ea-f893-442d-be2c-e4a2c06bdd35-8416e04e-7ebe-45fb-9bd2-c3eb7d42087a" released by "_create_volume_from_snapshot" :: held 12.912s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.933s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc7a47ad-322d-4a7e-a0db-d08de7306869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8416e04e-7ebe-45fb-9bd2-c3eb7d42087a', 'volume_size': 1, 'snapshot_id': 'b1e902ea-f893-442d-be2c-e4a2c06bdd35'}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae0c228f-500e-4f52-b77a-8e4a864ace9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:48:56 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Volume volume-8416e04e-7ebe-45fb-9bd2-c3eb7d42087a (8416e04e-7ebe-45fb-9bd2-c3eb7d42087a): created successfully Jul 10 06:48:56 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae0c228f-500e-4f52-b77a-8e4a864ace9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:48:56 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Flow 'volume_create_manager' (1f695e01-f277-42ed-86c7-25319306d430) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:48:56 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-d3c5c8f3-c9b3-4ac3-bf70-86b395fc50b1 tempest-TestStampPattern-1951221454 None] Created volume successfully. Jul 10 06:48:56 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-24de39ac-1bbe-439e-a0a4-5494cb41d11a tempest-GroupSnapshotsTest-440840859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227" returned: 0 in 1.359s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-24de39ac-1bbe-439e-a0a4-5494cb41d11a tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:56 devstack sudo[100167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227 Jul 10 06:48:56 devstack sudo[100167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:57 devstack sudo[100167]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-24de39ac-1bbe-439e-a0a4-5494cb41d11a tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74bf8a7f-4a0e-4909-bd75-2669f5423227" returned: 0 in 0.828s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:57 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-24de39ac-1bbe-439e-a0a4-5494cb41d11a tempest-GroupSnapshotsTest-440840859 None] Lock "cinder-quobyte-74bf8a7f-4a0e-4909-bd75-2669f5423227" released by "delete_volume" :: held 2.325s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:57 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-24de39ac-1bbe-439e-a0a4-5494cb41d11a tempest-GroupSnapshotsTest-440840859 None] Acquiring lock "cinder-quobyte-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:48:57 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-24de39ac-1bbe-439e-a0a4-5494cb41d11a tempest-GroupSnapshotsTest-440840859 None] Lock "cinder-quobyte-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed" acquired by "delete_volume" :: waited 0.024s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:48:57 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9e8067-8d46-4dc3-a57c-a0bf78a07223]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:48:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-24de39ac-1bbe-439e-a0a4-5494cb41d11a tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:57 devstack sudo[100176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed Jul 10 06:48:57 devstack sudo[100176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:58 devstack sudo[100176]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-24de39ac-1bbe-439e-a0a4-5494cb41d11a tempest-GroupSnapshotsTest-440840859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed" returned: 0 in 0.956s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-24de39ac-1bbe-439e-a0a4-5494cb41d11a tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:48:58 devstack sudo[100197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed Jul 10 06:48:58 devstack sudo[100197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:48:59 devstack sudo[100197]: pam_unix(sudo:session): session closed for user root Jul 10 06:48:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-24de39ac-1bbe-439e-a0a4-5494cb41d11a tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed" returned: 0 in 0.799s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:48:59 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-24de39ac-1bbe-439e-a0a4-5494cb41d11a tempest-GroupSnapshotsTest-440840859 None] Lock "cinder-quobyte-e5c09ff7-98b0-4f0f-b665-5d05beffd1ed" released by "delete_volume" :: held 1.839s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:48:59 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:UPDATE=82,cinder:SELECT=98,cinder:INSERT=22,cinder:DELETE=2 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:48:59 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:UPDATE=95,cinder:SELECT=111,cinder:INSERT=17,cinder:DELETE=5 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:48:59 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-24de39ac-1bbe-439e-a0a4-5494cb41d11a tempest-GroupSnapshotsTest-440840859 None] Created reservations ['da32ebb1-b9cb-4a35-b4e2-6f313b920252'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:48:59 devstack cinder-volume[87294]: WARNING cinder.quota [None req-24de39ac-1bbe-439e-a0a4-5494cb41d11a tempest-GroupSnapshotsTest-440840859 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1788987990 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1788987990, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:48:59 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-24de39ac-1bbe-439e-a0a4-5494cb41d11a tempest-GroupSnapshotsTest-440840859 None] Created reservations ['7e9f2fd9-4d7c-435a-abfb-69d60d3dfc00', '705d004e-d460-4743-a738-54ccf6d8475d', 'a32fdbd9-7127-4504-8666-faba0bc1611a', '559dbf7b-3ebf-466e-a77a-bc8568d9d81e'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:48:59 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-24de39ac-1bbe-439e-a0a4-5494cb41d11a tempest-GroupSnapshotsTest-440840859 None] Created reservations ['48b85dd5-1ccf-45e2-bfdb-98e2cef2e938', '9d38a982-bd59-41a8-b239-ebad224005d8', '7e29c0f6-2ae4-44bc-b691-d37f77cb97d9', '1fefee94-55d7-4839-a3aa-d984ff8e2a3c'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:48:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-24de39ac-1bbe-439e-a0a4-5494cb41d11a tempest-GroupSnapshotsTest-440840859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:48:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-24de39ac-1bbe-439e-a0a4-5494cb41d11a tempest-GroupSnapshotsTest-440840859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:48:59 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-24de39ac-1bbe-439e-a0a4-5494cb41d11a tempest-GroupSnapshotsTest-440840859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:48:59 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-24de39ac-1bbe-439e-a0a4-5494cb41d11a tempest-GroupSnapshotsTest-440840859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:48:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-24de39ac-1bbe-439e-a0a4-5494cb41d11a tempest-GroupSnapshotsTest-440840859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:48:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-24de39ac-1bbe-439e-a0a4-5494cb41d11a tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:00 devstack sudo[100204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:49:00 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:00 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-7fd9b67c-f4db-479b-a765-8acab870200c tempest-GroupSnapshotsTest-440840859 None] Group tempest-GroupSnapshotsTest-Group-467348135: creating Jul 10 06:49:00 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-24de39ac-1bbe-439e-a0a4-5494cb41d11a tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.819s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:00 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-24de39ac-1bbe-439e-a0a4-5494cb41d11a tempest-GroupSnapshotsTest-440840859 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:49:00 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-24de39ac-1bbe-439e-a0a4-5494cb41d11a tempest-GroupSnapshotsTest-440840859 None] Delete group completed successfully. Jul 10 06:49:00 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-7fd9b67c-f4db-479b-a765-8acab870200c tempest-GroupSnapshotsTest-440840859 None] Group tempest-GroupSnapshotsTest-Group-467348135: created successfully Jul 10 06:49:00 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-7fd9b67c-f4db-479b-a765-8acab870200c tempest-GroupSnapshotsTest-440840859 None] Create group completed successfully. Jul 10 06:49:02 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7f13ecf-8a45-4db0-b7e1-3351d19933f7 tempest-GroupSnapshotsTest-440840859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:49:02 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e7f13ecf-8a45-4db0-b7e1-3351d19933f7 tempest-GroupSnapshotsTest-440840859 None] Flow 'volume_create_manager' (b7fcd3b8-32c0-4772-a2d7-af298d68a67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:49:02 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e7f13ecf-8a45-4db0-b7e1-3351d19933f7 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59d20bbe-b983-43e9-aaf5-1d6a21fe87e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:02 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e7f13ecf-8a45-4db0-b7e1-3351d19933f7 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59d20bbe-b983-43e9-aaf5-1d6a21fe87e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:49:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1593184188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=be8b1814-a858-4827-b759-e3082535f4f4,host='devstack@QuobyteHD#QuobyteHD',id=c9a592af-48e9-4e35-9ef2-b859c440f9b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d433420cfd44bd99269f5c8cbd29d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:49:02Z,use_quota=True,user_id='5ab5cf40b4b0457990e4198e0c84b17d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bcaf356-7b00-44ee-81e3-edbd9c49358a),volume_type_id=8bcaf356-7b00-44ee-81e3-edbd9c49358a)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:02 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e7f13ecf-8a45-4db0-b7e1-3351d19933f7 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77c78ea6-66a5-421a-b5e3-3952e7d79829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:02 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e7f13ecf-8a45-4db0-b7e1-3351d19933f7 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77c78ea6-66a5-421a-b5e3-3952e7d79829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:02 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e7f13ecf-8a45-4db0-b7e1-3351d19933f7 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25caf123-2eea-418b-84d9-9bb8ad95068e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:02 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e7f13ecf-8a45-4db0-b7e1-3351d19933f7 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25caf123-2eea-418b-84d9-9bb8ad95068e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9a592af-48e9-4e35-9ef2-b859c440f9b8', 'volume_name': 'volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:02 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e7f13ecf-8a45-4db0-b7e1-3351d19933f7 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (358012a9-6b30-4219-b4dc-e49d8503fc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:02 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e7f13ecf-8a45-4db0-b7e1-3351d19933f7 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (358012a9-6b30-4219-b4dc-e49d8503fc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:02 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e7f13ecf-8a45-4db0-b7e1-3351d19933f7 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f08bdd24-de55-4a7b-ba9c-0e8acc7f3c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:02 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-e7f13ecf-8a45-4db0-b7e1-3351d19933f7 tempest-GroupSnapshotsTest-440840859 None] Volume c9a592af-48e9-4e35-9ef2-b859c440f9b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8', 'volume_size': 1} Jul 10 06:49:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e7f13ecf-8a45-4db0-b7e1-3351d19933f7 tempest-GroupSnapshotsTest-440840859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e7f13ecf-8a45-4db0-b7e1-3351d19933f7 tempest-GroupSnapshotsTest-440840859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:02 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-e7f13ecf-8a45-4db0-b7e1-3351d19933f7 tempest-GroupSnapshotsTest-440840859 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=be8b1814-a858-4827-b759-e3082535f4f4,created_at=2026-07-10T04:49:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1593184188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=be8b1814-a858-4827-b759-e3082535f4f4,host='devstack@QuobyteHD#QuobyteHD',id=c9a592af-48e9-4e35-9ef2-b859c440f9b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d433420cfd44bd99269f5c8cbd29d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:49:02Z,use_quota=True,user_id='5ab5cf40b4b0457990e4198e0c84b17d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bcaf356-7b00-44ee-81e3-edbd9c49358a),volume_type_id=8bcaf356-7b00-44ee-81e3-edbd9c49358a)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:49:02 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-e7f13ecf-8a45-4db0-b7e1-3351d19933f7 tempest-GroupSnapshotsTest-440840859 None] Creating volume c9a592af-48e9-4e35-9ef2-b859c440f9b8 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:49:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e7f13ecf-8a45-4db0-b7e1-3351d19933f7 tempest-GroupSnapshotsTest-440840859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e7f13ecf-8a45-4db0-b7e1-3351d19933f7 tempest-GroupSnapshotsTest-440840859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:02 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-e7f13ecf-8a45-4db0-b7e1-3351d19933f7 tempest-GroupSnapshotsTest-440840859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:49:02 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-e7f13ecf-8a45-4db0-b7e1-3351d19933f7 tempest-GroupSnapshotsTest-440840859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:49:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e7f13ecf-8a45-4db0-b7e1-3351d19933f7 tempest-GroupSnapshotsTest-440840859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:02 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-e7f13ecf-8a45-4db0-b7e1-3351d19933f7 tempest-GroupSnapshotsTest-440840859 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:49:02 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-e7f13ecf-8a45-4db0-b7e1-3351d19933f7 tempest-GroupSnapshotsTest-440840859 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:49:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e7f13ecf-8a45-4db0-b7e1-3351d19933f7 tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:02 devstack sudo[100228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8 1073741824 Jul 10 06:49:02 devstack sudo[100228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:03 devstack sudo[100228]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e7f13ecf-8a45-4db0-b7e1-3351d19933f7 tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8 1073741824" returned: 0 in 1.274s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e7f13ecf-8a45-4db0-b7e1-3351d19933f7 tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:04 devstack sudo[100254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8 Jul 10 06:49:04 devstack sudo[100254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:04 devstack sudo[100254]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e7f13ecf-8a45-4db0-b7e1-3351d19933f7 tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8" returned: 0 in 0.985s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:04 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-e7f13ecf-8a45-4db0-b7e1-3351d19933f7 tempest-GroupSnapshotsTest-440840859 None] <== create_volume: return (2331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:49:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e7f13ecf-8a45-4db0-b7e1-3351d19933f7 tempest-GroupSnapshotsTest-440840859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.333s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:05 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e7f13ecf-8a45-4db0-b7e1-3351d19933f7 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f08bdd24-de55-4a7b-ba9c-0e8acc7f3c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:05 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e7f13ecf-8a45-4db0-b7e1-3351d19933f7 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (930f3303-6090-48a4-aef0-2e89397fcee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:05 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-758f9bf4-ad5c-4d3c-88e9-89e84f6e1361 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Acquiring lock "cinder-097fce46-4bd1-4005-839c-cc6c88225274-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:49:05 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-e7f13ecf-8a45-4db0-b7e1-3351d19933f7 tempest-GroupSnapshotsTest-440840859 None] Volume volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8 (c9a592af-48e9-4e35-9ef2-b859c440f9b8): created successfully Jul 10 06:49:05 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e7f13ecf-8a45-4db0-b7e1-3351d19933f7 tempest-GroupSnapshotsTest-440840859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (930f3303-6090-48a4-aef0-2e89397fcee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:05 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e7f13ecf-8a45-4db0-b7e1-3351d19933f7 tempest-GroupSnapshotsTest-440840859 None] Flow 'volume_create_manager' (b7fcd3b8-32c0-4772-a2d7-af298d68a67b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:49:05 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-758f9bf4-ad5c-4d3c-88e9-89e84f6e1361 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Lock "cinder-097fce46-4bd1-4005-839c-cc6c88225274-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:49:05 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-e7f13ecf-8a45-4db0-b7e1-3351d19933f7 tempest-GroupSnapshotsTest-440840859 None] Created volume successfully. Jul 10 06:49:05 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-758f9bf4-ad5c-4d3c-88e9-89e84f6e1361 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Acquiring lock "cinder-quobyte-097fce46-4bd1-4005-839c-cc6c88225274" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:49:05 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-758f9bf4-ad5c-4d3c-88e9-89e84f6e1361 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Lock "cinder-quobyte-097fce46-4bd1-4005-839c-cc6c88225274" acquired by "delete_volume" :: waited 0.032s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:49:05 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[38dfc0f0-8dbd-4224-b88e-aef6cdeec30c]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:49:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-758f9bf4-ad5c-4d3c-88e9-89e84f6e1361 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-097fce46-4bd1-4005-839c-cc6c88225274 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:05 devstack sudo[100259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-097fce46-4bd1-4005-839c-cc6c88225274 Jul 10 06:49:05 devstack sudo[100259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:06 devstack sudo[100259]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-758f9bf4-ad5c-4d3c-88e9-89e84f6e1361 tempest-TestServerVolumeAttachmentScenario-1734695340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-097fce46-4bd1-4005-839c-cc6c88225274" returned: 0 in 1.116s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-758f9bf4-ad5c-4d3c-88e9-89e84f6e1361 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-097fce46-4bd1-4005-839c-cc6c88225274 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:06 devstack sudo[100264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-097fce46-4bd1-4005-839c-cc6c88225274 Jul 10 06:49:06 devstack sudo[100264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:06 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-f1c8142f-c826-46f7-9f4b-7cbdd54912ec tempest-GroupSnapshotsTest-440840859 None] GroupSnapshot faf603df-49ad-43a6-aceb-740435a279d9: creating. Jul 10 06:49:06 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f1c8142f-c826-46f7-9f4b-7cbdd54912ec tempest-GroupSnapshotsTest-440840859 None] Group snapshot faf603df-49ad-43a6-aceb-740435a279d9: creating. {{(pid=87294) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 10 06:49:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f1c8142f-c826-46f7-9f4b-7cbdd54912ec tempest-GroupSnapshotsTest-440840859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f1c8142f-c826-46f7-9f4b-7cbdd54912ec tempest-GroupSnapshotsTest-440840859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:06 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-f1c8142f-c826-46f7-9f4b-7cbdd54912ec tempest-GroupSnapshotsTest-440840859 None] Creating offline snapshot 6512f0be-92ce-4a31-a64a-12bc4dc03b06 of volume c9a592af-48e9-4e35-9ef2-b859c440f9b8 {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:49:06 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfc810e-9d13-4f5d-a0f1-651b8bc76bf5]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:49:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1c8142f-c826-46f7-9f4b-7cbdd54912ec tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:07 devstack sudo[100266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8 Jul 10 06:49:07 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:07 devstack sudo[100264]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-758f9bf4-ad5c-4d3c-88e9-89e84f6e1361 tempest-TestServerVolumeAttachmentScenario-1734695340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-097fce46-4bd1-4005-839c-cc6c88225274" returned: 0 in 1.454s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:08 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-758f9bf4-ad5c-4d3c-88e9-89e84f6e1361 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Lock "cinder-quobyte-097fce46-4bd1-4005-839c-cc6c88225274" released by "delete_volume" :: held 2.681s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:49:08 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-758f9bf4-ad5c-4d3c-88e9-89e84f6e1361 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Created reservations ['4f4a0a90-2ba8-4ca0-a763-8db04be31c98', 'ca93c4b1-7e69-4851-8c3f-f4192bbc7f3e', 'b995160b-3560-4e0e-9b08-80ad6d2ad04a', '30512718-7419-4cea-9eb9-641857ddaf66'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:49:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-758f9bf4-ad5c-4d3c-88e9-89e84f6e1361 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-758f9bf4-ad5c-4d3c-88e9-89e84f6e1361 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:08 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-758f9bf4-ad5c-4d3c-88e9-89e84f6e1361 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:49:08 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-758f9bf4-ad5c-4d3c-88e9-89e84f6e1361 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:49:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-758f9bf4-ad5c-4d3c-88e9-89e84f6e1361 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-758f9bf4-ad5c-4d3c-88e9-89e84f6e1361 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:08 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1c8142f-c826-46f7-9f4b-7cbdd54912ec tempest-GroupSnapshotsTest-440840859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8" returned: 0 in 1.363s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1c8142f-c826-46f7-9f4b-7cbdd54912ec tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8.6512f0be-92ce-4a31-a64a-12bc4dc03b06 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:08 devstack sudo[100275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:49:08 devstack sudo[100275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:08 devstack sudo[100277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8.6512f0be-92ce-4a31-a64a-12bc4dc03b06 1G Jul 10 06:49:08 devstack sudo[100277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:08 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-caf1c141-c09b-42ac-a64c-1fa59d0454e9 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Acquiring lock "cinder-a65c7665-8867-4a0a-8c90-dac792e801bb-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:49:08 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-caf1c141-c09b-42ac-a64c-1fa59d0454e9 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Lock "cinder-a65c7665-8867-4a0a-8c90-dac792e801bb-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:49:08 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-caf1c141-c09b-42ac-a64c-1fa59d0454e9 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Acquiring lock "cinder-quobyte-a65c7665-8867-4a0a-8c90-dac792e801bb" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:49:09 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-caf1c141-c09b-42ac-a64c-1fa59d0454e9 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Lock "cinder-quobyte-a65c7665-8867-4a0a-8c90-dac792e801bb" acquired by "delete_volume" :: waited 0.054s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:49:09 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[1716ad14-0af1-4a35-b5fb-c83f02b53489]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:49:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-caf1c141-c09b-42ac-a64c-1fa59d0454e9 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a65c7665-8867-4a0a-8c90-dac792e801bb {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:09 devstack sudo[100279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a65c7665-8867-4a0a-8c90-dac792e801bb Jul 10 06:49:09 devstack sudo[100279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:09 devstack sudo[100275]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-758f9bf4-ad5c-4d3c-88e9-89e84f6e1361 tempest-TestServerVolumeAttachmentScenario-1734695340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.502s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:09 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-758f9bf4-ad5c-4d3c-88e9-89e84f6e1361 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:49:09 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-758f9bf4-ad5c-4d3c-88e9-89e84f6e1361 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Deleted volume successfully. Jul 10 06:49:09 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-758f9bf4-ad5c-4d3c-88e9-89e84f6e1361 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Lock "cinder-097fce46-4bd1-4005-839c-cc6c88225274-delete_volume" released by "delete_volume" :: held 4.678s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:49:10 devstack sudo[100277]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1c8142f-c826-46f7-9f4b-7cbdd54912ec tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8.6512f0be-92ce-4a31-a64a-12bc4dc03b06 1G" returned: 0 in 1.679s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1c8142f-c826-46f7-9f4b-7cbdd54912ec tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8.6512f0be-92ce-4a31-a64a-12bc4dc03b06 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:10 devstack sudo[100286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8.6512f0be-92ce-4a31-a64a-12bc4dc03b06 Jul 10 06:49:10 devstack sudo[100286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:11 devstack sudo[100279]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-caf1c141-c09b-42ac-a64c-1fa59d0454e9 tempest-TestServerVolumeAttachmentScenario-1734695340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a65c7665-8867-4a0a-8c90-dac792e801bb" returned: 0 in 2.045s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-caf1c141-c09b-42ac-a64c-1fa59d0454e9 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a65c7665-8867-4a0a-8c90-dac792e801bb {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:11 devstack sudo[100296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a65c7665-8867-4a0a-8c90-dac792e801bb Jul 10 06:49:11 devstack sudo[100296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:11 devstack sudo[100286]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1c8142f-c826-46f7-9f4b-7cbdd54912ec tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8.6512f0be-92ce-4a31-a64a-12bc4dc03b06" returned: 0 in 1.378s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:11 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-f1c8142f-c826-46f7-9f4b-7cbdd54912ec tempest-GroupSnapshotsTest-440840859 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8.6512f0be-92ce-4a31-a64a-12bc4dc03b06 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 06:49:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1c8142f-c826-46f7-9f4b-7cbdd54912ec tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8.6512f0be-92ce-4a31-a64a-12bc4dc03b06 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:11 devstack sudo[100298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8.6512f0be-92ce-4a31-a64a-12bc4dc03b06 Jul 10 06:49:11 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:12 devstack sudo[100296]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-caf1c141-c09b-42ac-a64c-1fa59d0454e9 tempest-TestServerVolumeAttachmentScenario-1734695340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a65c7665-8867-4a0a-8c90-dac792e801bb" returned: 0 in 1.206s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:12 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-caf1c141-c09b-42ac-a64c-1fa59d0454e9 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Lock "cinder-quobyte-a65c7665-8867-4a0a-8c90-dac792e801bb" released by "delete_volume" :: held 3.348s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:49:12 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-caf1c141-c09b-42ac-a64c-1fa59d0454e9 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Created reservations ['f7475252-1938-4464-8890-3079427bd4c4', 'c46155c1-0d14-4012-9fc0-2e945f18a45b', '5539c2fb-3357-4aec-b2f8-5d625882cdb1', '94e62636-6744-432c-9efb-f147bfc6d161'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:49:12 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1c8142f-c826-46f7-9f4b-7cbdd54912ec tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8.6512f0be-92ce-4a31-a64a-12bc4dc03b06" returned: 0 in 1.196s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1c8142f-c826-46f7-9f4b-7cbdd54912ec tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-caf1c141-c09b-42ac-a64c-1fa59d0454e9 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-caf1c141-c09b-42ac-a64c-1fa59d0454e9 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:12 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-caf1c141-c09b-42ac-a64c-1fa59d0454e9 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:49:12 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-caf1c141-c09b-42ac-a64c-1fa59d0454e9 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:49:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-caf1c141-c09b-42ac-a64c-1fa59d0454e9 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-caf1c141-c09b-42ac-a64c-1fa59d0454e9 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:12 devstack sudo[100302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8.info Jul 10 06:49:12 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:12 devstack sudo[100303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:49:12 devstack sudo[100303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:13 devstack sudo[100303]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-caf1c141-c09b-42ac-a64c-1fa59d0454e9 tempest-TestServerVolumeAttachmentScenario-1734695340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.152s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:13 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-caf1c141-c09b-42ac-a64c-1fa59d0454e9 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:49:13 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-caf1c141-c09b-42ac-a64c-1fa59d0454e9 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Deleted volume successfully. Jul 10 06:49:13 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-caf1c141-c09b-42ac-a64c-1fa59d0454e9 tempest-TestServerVolumeAttachmentScenario-1734695340 None] Lock "cinder-a65c7665-8867-4a0a-8c90-dac792e801bb-delete_volume" released by "delete_volume" :: held 5.157s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:49:13 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1c8142f-c826-46f7-9f4b-7cbdd54912ec tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8.info" returned: 0 in 1.303s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:13 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-f1c8142f-c826-46f7-9f4b-7cbdd54912ec tempest-GroupSnapshotsTest-440840859 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 06:49:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1c8142f-c826-46f7-9f4b-7cbdd54912ec tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:14 devstack sudo[100308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8.info Jul 10 06:49:14 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:14 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1c8142f-c826-46f7-9f4b-7cbdd54912ec tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8.info" returned: 0 in 0.831s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f1c8142f-c826-46f7-9f4b-7cbdd54912ec tempest-GroupSnapshotsTest-440840859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.957s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:15 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-f1c8142f-c826-46f7-9f4b-7cbdd54912ec tempest-GroupSnapshotsTest-440840859 None] group_snapshot faf603df-49ad-43a6-aceb-740435a279d9: created successfully Jul 10 06:49:15 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-3c8ca39d-6223-4969-a439-8b5aa97a6d71 tempest-GroupSnapshotsTest-440840859 None] group_snapshot faf603df-49ad-43a6-aceb-740435a279d9: deleting Jul 10 06:49:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-3c8ca39d-6223-4969-a439-8b5aa97a6d71 tempest-GroupSnapshotsTest-440840859 None] group_snapshot faf603df-49ad-43a6-aceb-740435a279d9: deleting {{(pid=87294) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 10 06:49:15 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-3c8ca39d-6223-4969-a439-8b5aa97a6d71 tempest-GroupSnapshotsTest-440840859 None] Acquiring lock "cinder-quobyte-c9a592af-48e9-4e35-9ef2-b859c440f9b8" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:49:15 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-3c8ca39d-6223-4969-a439-8b5aa97a6d71 tempest-GroupSnapshotsTest-440840859 None] Lock "cinder-quobyte-c9a592af-48e9-4e35-9ef2-b859c440f9b8" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:49:15 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-3c8ca39d-6223-4969-a439-8b5aa97a6d71 tempest-GroupSnapshotsTest-440840859 None] Acquiring lock "cinder-quobyte-6512f0be-92ce-4a31-a64a-12bc4dc03b06" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:49:15 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-3c8ca39d-6223-4969-a439-8b5aa97a6d71 tempest-GroupSnapshotsTest-440840859 None] Lock "cinder-quobyte-6512f0be-92ce-4a31-a64a-12bc4dc03b06" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:49:15 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-3c8ca39d-6223-4969-a439-8b5aa97a6d71 tempest-GroupSnapshotsTest-440840859 None] Deleting offline snapshot 6512f0be-92ce-4a31-a64a-12bc4dc03b06 of volume c9a592af-48e9-4e35-9ef2-b859c440f9b8 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:49:16 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-3c8ca39d-6223-4969-a439-8b5aa97a6d71 tempest-GroupSnapshotsTest-440840859 None] snapshot_file for this snap is: volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8.6512f0be-92ce-4a31-a64a-12bc4dc03b06 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:49:16 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2b86e3-2b31-49ab-ba7b-e0c4755fc70d]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:49:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3c8ca39d-6223-4969-a439-8b5aa97a6d71 tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8.6512f0be-92ce-4a31-a64a-12bc4dc03b06 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:16 devstack sudo[100312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8.6512f0be-92ce-4a31-a64a-12bc4dc03b06 Jul 10 06:49:16 devstack sudo[100312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:17 devstack sudo[100312]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3c8ca39d-6223-4969-a439-8b5aa97a6d71 tempest-GroupSnapshotsTest-440840859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8.6512f0be-92ce-4a31-a64a-12bc4dc03b06" returned: 0 in 0.992s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:17 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-3c8ca39d-6223-4969-a439-8b5aa97a6d71 tempest-GroupSnapshotsTest-440840859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:49:17 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[103620af-f738-455f-bb51-883413a051fe]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:49:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3c8ca39d-6223-4969-a439-8b5aa97a6d71 tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:17 devstack sudo[100328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8 Jul 10 06:49:17 devstack sudo[100328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:18 devstack sudo[100328]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3c8ca39d-6223-4969-a439-8b5aa97a6d71 tempest-GroupSnapshotsTest-440840859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8" returned: 0 in 0.992s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3c8ca39d-6223-4969-a439-8b5aa97a6d71 tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8.6512f0be-92ce-4a31-a64a-12bc4dc03b06 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:18 devstack sudo[100333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8.6512f0be-92ce-4a31-a64a-12bc4dc03b06 Jul 10 06:49:18 devstack sudo[100333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:18 devstack sudo[100333]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3c8ca39d-6223-4969-a439-8b5aa97a6d71 tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8.6512f0be-92ce-4a31-a64a-12bc4dc03b06" returned: 0 in 0.900s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3c8ca39d-6223-4969-a439-8b5aa97a6d71 tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8.6512f0be-92ce-4a31-a64a-12bc4dc03b06 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:19 devstack sudo[100342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8.6512f0be-92ce-4a31-a64a-12bc4dc03b06 Jul 10 06:49:19 devstack sudo[100342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:19 devstack sudo[100342]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3c8ca39d-6223-4969-a439-8b5aa97a6d71 tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8.6512f0be-92ce-4a31-a64a-12bc4dc03b06" returned: 0 in 0.797s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:19 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-3c8ca39d-6223-4969-a439-8b5aa97a6d71 tempest-GroupSnapshotsTest-440840859 None] Lock "cinder-quobyte-6512f0be-92ce-4a31-a64a-12bc4dc03b06" released by "_delete_snapshot" :: held 3.878s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:49:19 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-3c8ca39d-6223-4969-a439-8b5aa97a6d71 tempest-GroupSnapshotsTest-440840859 None] Lock "cinder-quobyte-c9a592af-48e9-4e35-9ef2-b859c440f9b8" released by "delete_snapshot" :: held 3.928s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:49:19 devstack cinder-volume[87294]: WARNING cinder.quota [None req-3c8ca39d-6223-4969-a439-8b5aa97a6d71 tempest-GroupSnapshotsTest-440840859 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1666293 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1666293, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:49:19 devstack cinder-volume[87294]: WARNING cinder.quota [None req-3c8ca39d-6223-4969-a439-8b5aa97a6d71 tempest-GroupSnapshotsTest-440840859 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1666293 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1666293, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:49:19 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-3c8ca39d-6223-4969-a439-8b5aa97a6d71 tempest-GroupSnapshotsTest-440840859 None] Created reservations ['2f26ec7e-4f92-45d1-8bfe-5d2285bebe26', '28089e33-b821-4d6e-b796-c064ad720e4e', 'e5af03bc-e7d4-44f4-9b53-1e39596c1d36', 'fda8a18e-026f-47e3-a5ca-fad2035f23f5'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:49:20 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-3c8ca39d-6223-4969-a439-8b5aa97a6d71 tempest-GroupSnapshotsTest-440840859 None] group_snapshot faf603df-49ad-43a6-aceb-740435a279d9: deleted successfully Jul 10 06:49:20 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b6d7888e-3cba-456f-a536-cef24ba9f18d tempest-GroupSnapshotsTest-440840859 None] Acquiring lock "cinder-quobyte-c9a592af-48e9-4e35-9ef2-b859c440f9b8" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:49:20 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b6d7888e-3cba-456f-a536-cef24ba9f18d tempest-GroupSnapshotsTest-440840859 None] Lock "cinder-quobyte-c9a592af-48e9-4e35-9ef2-b859c440f9b8" acquired by "delete_volume" :: waited 0.018s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:49:20 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[653f47c8-be4b-4ca7-9327-36cf18c16e74]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:49:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b6d7888e-3cba-456f-a536-cef24ba9f18d tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:21 devstack sudo[100383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8 Jul 10 06:49:21 devstack sudo[100383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:21 devstack sudo[100383]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b6d7888e-3cba-456f-a536-cef24ba9f18d tempest-GroupSnapshotsTest-440840859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8" returned: 0 in 0.848s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b6d7888e-3cba-456f-a536-cef24ba9f18d tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:21 devstack sudo[100389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8 Jul 10 06:49:21 devstack sudo[100389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:21 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:49:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:49:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:49:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:21 devstack sudo[100391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:49:21 devstack sudo[100391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:22 devstack sudo[100389]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b6d7888e-3cba-456f-a536-cef24ba9f18d tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c9a592af-48e9-4e35-9ef2-b859c440f9b8" returned: 0 in 0.709s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:22 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b6d7888e-3cba-456f-a536-cef24ba9f18d tempest-GroupSnapshotsTest-440840859 None] Lock "cinder-quobyte-c9a592af-48e9-4e35-9ef2-b859c440f9b8" released by "delete_volume" :: held 1.628s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:49:22 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-b6d7888e-3cba-456f-a536-cef24ba9f18d tempest-GroupSnapshotsTest-440840859 None] Created reservations ['0c0c7227-b7c8-4a33-bbfd-2f165aa30657'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:49:22 devstack cinder-volume[87294]: WARNING cinder.quota [None req-b6d7888e-3cba-456f-a536-cef24ba9f18d tempest-GroupSnapshotsTest-440840859 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1666293 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1666293, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:49:22 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-b6d7888e-3cba-456f-a536-cef24ba9f18d tempest-GroupSnapshotsTest-440840859 None] Created reservations ['11dc67cc-b033-4870-8d21-284f5775779c', 'd47f28f0-1e80-4947-86e9-d9393f4ce8d8', '3a55b797-1be2-4f71-ad18-65af97823220', '111501f4-1bd1-4cad-81aa-3e0c89af5a5d'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:49:22 devstack sudo[100391]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.816s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:22 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:49:22 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager._thread_info {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:49:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread count: 28 {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:49:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread info: [<_MainThread(MainThread, started 139245706264704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:49:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b6d7888e-3cba-456f-a536-cef24ba9f18d tempest-GroupSnapshotsTest-440840859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b6d7888e-3cba-456f-a536-cef24ba9f18d tempest-GroupSnapshotsTest-440840859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:22 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b6d7888e-3cba-456f-a536-cef24ba9f18d tempest-GroupSnapshotsTest-440840859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:49:22 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b6d7888e-3cba-456f-a536-cef24ba9f18d tempest-GroupSnapshotsTest-440840859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:49:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b6d7888e-3cba-456f-a536-cef24ba9f18d tempest-GroupSnapshotsTest-440840859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b6d7888e-3cba-456f-a536-cef24ba9f18d tempest-GroupSnapshotsTest-440840859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:22 devstack sudo[100397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:49:22 devstack sudo[100397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:23 devstack sudo[100397]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b6d7888e-3cba-456f-a536-cef24ba9f18d tempest-GroupSnapshotsTest-440840859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.768s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:23 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-b6d7888e-3cba-456f-a536-cef24ba9f18d tempest-GroupSnapshotsTest-440840859 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:49:23 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-b6d7888e-3cba-456f-a536-cef24ba9f18d tempest-GroupSnapshotsTest-440840859 None] Delete group completed successfully. Jul 10 06:49:30 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-35574b5a-8530-4d75-9ee5-ab346edddc41 tempest-GroupsV314Test-1749907710 None] Group tempest-GroupsV314Test-Group-1125746925: creating Jul 10 06:49:30 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-35574b5a-8530-4d75-9ee5-ab346edddc41 tempest-GroupsV314Test-1749907710 None] Group tempest-GroupsV314Test-Group-1125746925: created successfully Jul 10 06:49:30 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-35574b5a-8530-4d75-9ee5-ab346edddc41 tempest-GroupsV314Test-1749907710 None] Create group completed successfully. Jul 10 06:49:32 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-88a1edf9-d75c-4dc3-b827-753dfecf39d4 tempest-GroupsV314Test-1749907710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:49:32 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-88a1edf9-d75c-4dc3-b827-753dfecf39d4 tempest-GroupsV314Test-1749907710 None] Flow 'volume_create_manager' (aa6976da-533c-4592-b5d6-826efcd8704c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:49:32 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-88a1edf9-d75c-4dc3-b827-753dfecf39d4 tempest-GroupsV314Test-1749907710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29eb7732-3c3c-4c78-a4e2-9d4d051aad98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:32 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-88a1edf9-d75c-4dc3-b827-753dfecf39d4 tempest-GroupsV314Test-1749907710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29eb7732-3c3c-4c78-a4e2-9d4d051aad98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-21240815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d33f7500-7253-44c5-8ad6-1d881c0025e5,host='devstack@QuobyteHD#QuobyteHD',id=910a1de6-fb9a-41a9-bb84-a8561b04849a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f6d5e58b0f646ac90f6a08fe449615a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:49:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:49:32Z,use_quota=True,user_id='e7ab3368d0644f7fbe64da7ec264182e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efd56f59-3754-455b-871c-e4a47f2ec704),volume_type_id=efd56f59-3754-455b-871c-e4a47f2ec704)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:32 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-88a1edf9-d75c-4dc3-b827-753dfecf39d4 tempest-GroupsV314Test-1749907710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29c0da45-8bf7-47b6-b5f8-e211b41398f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:32 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-88a1edf9-d75c-4dc3-b827-753dfecf39d4 tempest-GroupsV314Test-1749907710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29c0da45-8bf7-47b6-b5f8-e211b41398f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:32 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-88a1edf9-d75c-4dc3-b827-753dfecf39d4 tempest-GroupsV314Test-1749907710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (067f44e0-b313-48ab-9177-008139fa5a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:32 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-88a1edf9-d75c-4dc3-b827-753dfecf39d4 tempest-GroupsV314Test-1749907710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (067f44e0-b313-48ab-9177-008139fa5a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '910a1de6-fb9a-41a9-bb84-a8561b04849a', 'volume_name': 'volume-910a1de6-fb9a-41a9-bb84-a8561b04849a', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:32 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-88a1edf9-d75c-4dc3-b827-753dfecf39d4 tempest-GroupsV314Test-1749907710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91ad6349-2cf7-43f2-a9dd-8173dd6b670c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:32 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-88a1edf9-d75c-4dc3-b827-753dfecf39d4 tempest-GroupsV314Test-1749907710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91ad6349-2cf7-43f2-a9dd-8173dd6b670c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:32 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-88a1edf9-d75c-4dc3-b827-753dfecf39d4 tempest-GroupsV314Test-1749907710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df52d162-493f-4c6b-9e51-cb37b59f76d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:32 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-88a1edf9-d75c-4dc3-b827-753dfecf39d4 tempest-GroupsV314Test-1749907710 None] Volume 910a1de6-fb9a-41a9-bb84-a8561b04849a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-910a1de6-fb9a-41a9-bb84-a8561b04849a', 'volume_size': 1} Jul 10 06:49:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-88a1edf9-d75c-4dc3-b827-753dfecf39d4 tempest-GroupsV314Test-1749907710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-88a1edf9-d75c-4dc3-b827-753dfecf39d4 tempest-GroupsV314Test-1749907710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:32 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-88a1edf9-d75c-4dc3-b827-753dfecf39d4 tempest-GroupsV314Test-1749907710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d33f7500-7253-44c5-8ad6-1d881c0025e5,created_at=2026-07-10T04:49:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-21240815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d33f7500-7253-44c5-8ad6-1d881c0025e5,host='devstack@QuobyteHD#QuobyteHD',id=910a1de6-fb9a-41a9-bb84-a8561b04849a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f6d5e58b0f646ac90f6a08fe449615a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:49:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:49:32Z,use_quota=True,user_id='e7ab3368d0644f7fbe64da7ec264182e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efd56f59-3754-455b-871c-e4a47f2ec704),volume_type_id=efd56f59-3754-455b-871c-e4a47f2ec704)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:49:32 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-88a1edf9-d75c-4dc3-b827-753dfecf39d4 tempest-GroupsV314Test-1749907710 None] Creating volume 910a1de6-fb9a-41a9-bb84-a8561b04849a {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:49:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-88a1edf9-d75c-4dc3-b827-753dfecf39d4 tempest-GroupsV314Test-1749907710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-88a1edf9-d75c-4dc3-b827-753dfecf39d4 tempest-GroupsV314Test-1749907710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:32 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-88a1edf9-d75c-4dc3-b827-753dfecf39d4 tempest-GroupsV314Test-1749907710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:49:32 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-88a1edf9-d75c-4dc3-b827-753dfecf39d4 tempest-GroupsV314Test-1749907710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:49:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-88a1edf9-d75c-4dc3-b827-753dfecf39d4 tempest-GroupsV314Test-1749907710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:32 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-88a1edf9-d75c-4dc3-b827-753dfecf39d4 tempest-GroupsV314Test-1749907710 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:49:32 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-88a1edf9-d75c-4dc3-b827-753dfecf39d4 tempest-GroupsV314Test-1749907710 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:49:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-88a1edf9-d75c-4dc3-b827-753dfecf39d4 tempest-GroupsV314Test-1749907710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:32 devstack sudo[100510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a 1073741824 Jul 10 06:49:32 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:33 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-88a1edf9-d75c-4dc3-b827-753dfecf39d4 tempest-GroupsV314Test-1749907710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a 1073741824" returned: 0 in 1.046s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-88a1edf9-d75c-4dc3-b827-753dfecf39d4 tempest-GroupsV314Test-1749907710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:33 devstack sudo[100518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a Jul 10 06:49:33 devstack sudo[100518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:34 devstack sudo[100518]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-88a1edf9-d75c-4dc3-b827-753dfecf39d4 tempest-GroupsV314Test-1749907710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a" returned: 0 in 0.927s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:34 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-88a1edf9-d75c-4dc3-b827-753dfecf39d4 tempest-GroupsV314Test-1749907710 None] <== create_volume: return (2106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:49:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-88a1edf9-d75c-4dc3-b827-753dfecf39d4 tempest-GroupsV314Test-1749907710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.112s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-88a1edf9-d75c-4dc3-b827-753dfecf39d4 tempest-GroupsV314Test-1749907710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df52d162-493f-4c6b-9e51-cb37b59f76d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-910a1de6-fb9a-41a9-bb84-a8561b04849a', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-88a1edf9-d75c-4dc3-b827-753dfecf39d4 tempest-GroupsV314Test-1749907710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0764db72-9e2d-4ccc-a3f1-ae9cdbd58bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:34 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-88a1edf9-d75c-4dc3-b827-753dfecf39d4 tempest-GroupsV314Test-1749907710 None] Volume volume-910a1de6-fb9a-41a9-bb84-a8561b04849a (910a1de6-fb9a-41a9-bb84-a8561b04849a): created successfully Jul 10 06:49:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-88a1edf9-d75c-4dc3-b827-753dfecf39d4 tempest-GroupsV314Test-1749907710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0764db72-9e2d-4ccc-a3f1-ae9cdbd58bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-88a1edf9-d75c-4dc3-b827-753dfecf39d4 tempest-GroupsV314Test-1749907710 None] Flow 'volume_create_manager' (aa6976da-533c-4592-b5d6-826efcd8704c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:49:34 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-88a1edf9-d75c-4dc3-b827-753dfecf39d4 tempest-GroupsV314Test-1749907710 None] Created volume successfully. Jul 10 06:49:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-788003b3-6441-4d78-87b5-ebc88a7b960f req-8dea0039-ff7d-4a44-9a24-b898204e0502 tempest-TestStampPattern-1951221454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-788003b3-6441-4d78-87b5-ebc88a7b960f req-8dea0039-ff7d-4a44-9a24-b898204e0502 tempest-TestStampPattern-1951221454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:35 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[90361d6c-85af-49ed-bd23-42dea53c567a]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:49:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-788003b3-6441-4d78-87b5-ebc88a7b960f req-8dea0039-ff7d-4a44-9a24-b898204e0502 tempest-TestStampPattern-1951221454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8416e04e-7ebe-45fb-9bd2-c3eb7d42087a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:35 devstack sudo[100529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8416e04e-7ebe-45fb-9bd2-c3eb7d42087a Jul 10 06:49:35 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:36 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-788003b3-6441-4d78-87b5-ebc88a7b960f req-8dea0039-ff7d-4a44-9a24-b898204e0502 tempest-TestStampPattern-1951221454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8416e04e-7ebe-45fb-9bd2-c3eb7d42087a" returned: 0 in 1.656s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-788003b3-6441-4d78-87b5-ebc88a7b960f req-8dea0039-ff7d-4a44-9a24-b898204e0502 tempest-TestStampPattern-1951221454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.697s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.244s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:36 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] Cloning volume 910a1de6-fb9a-41a9-bb84-a8561b04849a to volume 07efaa3f-4ffc-4b08-9236-249764715f85 Jul 10 06:49:36 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] Creating offline snapshot 39fce403-c6f2-4d3b-baea-e6ff7fc58e54 of volume 910a1de6-fb9a-41a9-bb84-a8561b04849a {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:49:36 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-788003b3-6441-4d78-87b5-ebc88a7b960f req-8dea0039-ff7d-4a44-9a24-b898204e0502 tempest-TestStampPattern-1951221454 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804', 'name': 'volume-8416e04e-7ebe-45fb-9bd2-c3eb7d42087a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '09ce0933-3efc-47d1-b354-7c16141945ad', 'enforce_multipath': True} {{(pid=87294) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:49:36 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd7a09e-535c-407b-b6a4-777336546a8b]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:49:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:37 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-788003b3-6441-4d78-87b5-ebc88a7b960f req-8dea0039-ff7d-4a44-9a24-b898204e0502 tempest-TestStampPattern-1951221454 None] attachment_update completed successfully. Jul 10 06:49:37 devstack sudo[100534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a Jul 10 06:49:37 devstack sudo[100534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:38 devstack sudo[100534]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a" returned: 0 in 1.358s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a.39fce403-c6f2-4d3b-baea-e6ff7fc58e54 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:38 devstack sudo[100608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a.39fce403-c6f2-4d3b-baea-e6ff7fc58e54 1G Jul 10 06:49:38 devstack sudo[100608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:39 devstack sudo[100608]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a.39fce403-c6f2-4d3b-baea-e6ff7fc58e54 1G" returned: 0 in 1.147s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-910a1de6-fb9a-41a9-bb84-a8561b04849a -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a.39fce403-c6f2-4d3b-baea-e6ff7fc58e54 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:39 devstack sudo[100931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-910a1de6-fb9a-41a9-bb84-a8561b04849a -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a.39fce403-c6f2-4d3b-baea-e6ff7fc58e54 Jul 10 06:49:39 devstack sudo[100931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:40 devstack sudo[100931]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-910a1de6-fb9a-41a9-bb84-a8561b04849a -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a.39fce403-c6f2-4d3b-baea-e6ff7fc58e54" returned: 0 in 0.827s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:40 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a.39fce403-c6f2-4d3b-baea-e6ff7fc58e54 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 06:49:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a.39fce403-c6f2-4d3b-baea-e6ff7fc58e54 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:40 devstack sudo[100937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a.39fce403-c6f2-4d3b-baea-e6ff7fc58e54 Jul 10 06:49:40 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:40 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a.39fce403-c6f2-4d3b-baea-e6ff7fc58e54" returned: 0 in 0.795s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:41 devstack sudo[100940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a.info Jul 10 06:49:41 devstack sudo[100940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:41 devstack sudo[100940]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a.info" returned: 0 in 0.807s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:41 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 06:49:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:41 devstack sudo[100943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a.info Jul 10 06:49:41 devstack sudo[100943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:42 devstack sudo[100943]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a.info" returned: 0 in 0.935s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] Acquiring lock "cinder-quobyte-07efaa3f-4ffc-4b08-9236-249764715f85" by "_copy_volume_from_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:49:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] Lock "cinder-quobyte-07efaa3f-4ffc-4b08-9236-249764715f85" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:49:42 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] snapshot: 39fce403-c6f2-4d3b-baea-e6ff7fc58e54, volume: 07efaa3f-4ffc-4b08-9236-249764715f85, {{(pid=87294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 06:49:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:42 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:49:42 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:49:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:42 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74d687a-a9ef-4b2f-b826-f07e1ffb5fec]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:49:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a.39fce403-c6f2-4d3b-baea-e6ff7fc58e54 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:43 devstack sudo[100958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a.39fce403-c6f2-4d3b-baea-e6ff7fc58e54 Jul 10 06:49:43 devstack sudo[100958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:44 devstack sudo[100958]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a.39fce403-c6f2-4d3b-baea-e6ff7fc58e54" returned: 0 in 1.266s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:44 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-910a1de6-fb9a-41a9-bb84-a8561b04849a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:49:44 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a {{(pid=87294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 06:49:44 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] Creating direct copy from snapshot {{(pid=87294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 06:49:44 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f67d842-40c5-46c0-81b4-96eace74e098]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:49:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:44 devstack sudo[100967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a Jul 10 06:49:44 devstack sudo[100967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:45 devstack sudo[100967]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a" returned: 0 in 1.008s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:45 devstack cinder-volume[87294]: DEBUG cinder.utils [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] Path /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-07efaa3f-4ffc-4b08-9236-249764715f85 not found in is_blk_device check {{(pid=87294) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 06:49:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-07efaa3f-4ffc-4b08-9236-249764715f85 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:45 devstack sudo[100999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-07efaa3f-4ffc-4b08-9236-249764715f85 Jul 10 06:49:45 devstack sudo[100999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:45 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-9c5e229c-6efe-4d95-ac2a-af87da521b77 req-987fcd8e-2535-42ca-bb52-a95e6a8d5e09 tempest-TestStampPattern-1951221454 None] Terminate volume connection completed successfully. Jul 10 06:49:45 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-9c5e229c-6efe-4d95-ac2a-af87da521b77 req-987fcd8e-2535-42ca-bb52-a95e6a8d5e09 tempest-TestStampPattern-1951221454 None] Deleting attachment 09ce0933-3efc-47d1-b354-7c16141945ad. {{(pid=87294) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:49:51 devstack sudo[100999]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-07efaa3f-4ffc-4b08-9236-249764715f85" returned: 0 in 6.207s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:51 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[8115c60e-e79f-461e-bc69-e6964f51d9fb]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:49:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:51 devstack sudo[101034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a Jul 10 06:49:51 devstack sudo[101034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:52 devstack sudo[101034]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a" returned: 0 in 1.321s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:52 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a, size 1024.00 MB, duration 6.21 sec, destination /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-07efaa3f-4ffc-4b08-9236-249764715f85 {{(pid=87294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 06:49:52 devstack cinder-volume[87294]: INFO cinder.image.image_utils [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] Converted 1024.00 MB image at 164.94 MB/s Jul 10 06:49:52 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-07efaa3f-4ffc-4b08-9236-249764715f85 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 06:49:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-07efaa3f-4ffc-4b08-9236-249764715f85 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:52 devstack sudo[101060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-07efaa3f-4ffc-4b08-9236-249764715f85 Jul 10 06:49:52 devstack sudo[101060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:53 devstack sudo[101060]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-07efaa3f-4ffc-4b08-9236-249764715f85" returned: 0 in 0.763s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:53 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] Lock "cinder-quobyte-07efaa3f-4ffc-4b08-9236-249764715f85" released by "_copy_volume_from_snapshot" :: held 10.686s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:49:53 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] Acquiring lock "cinder-quobyte-39fce403-c6f2-4d3b-baea-e6ff7fc58e54" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:49:53 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] Lock "cinder-quobyte-39fce403-c6f2-4d3b-baea-e6ff7fc58e54" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:49:53 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] Deleting offline snapshot 39fce403-c6f2-4d3b-baea-e6ff7fc58e54 of volume 910a1de6-fb9a-41a9-bb84-a8561b04849a {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:49:53 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] snapshot_file for this snap is: volume-910a1de6-fb9a-41a9-bb84-a8561b04849a.39fce403-c6f2-4d3b-baea-e6ff7fc58e54 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:49:53 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[55df1e5b-1cea-4517-9d3e-a42cf42bbed7]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:49:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a.39fce403-c6f2-4d3b-baea-e6ff7fc58e54 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:53 devstack sudo[101064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a.39fce403-c6f2-4d3b-baea-e6ff7fc58e54 Jul 10 06:49:53 devstack sudo[101064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:54 devstack sudo[101064]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a.39fce403-c6f2-4d3b-baea-e6ff7fc58e54" returned: 0 in 1.174s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:54 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-910a1de6-fb9a-41a9-bb84-a8561b04849a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:49:54 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[311de8db-a80d-41ed-b55a-d06e1b532729]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:49:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:54 devstack sudo[101070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a Jul 10 06:49:54 devstack sudo[101070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:55 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:SELECT=62,cinder:UPDATE=65,cinder:INSERT=13,cinder:DELETE=1 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:49:55 devstack sudo[101070]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a" returned: 0 in 0.973s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a.39fce403-c6f2-4d3b-baea-e6ff7fc58e54 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:55 devstack sudo[101075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a.39fce403-c6f2-4d3b-baea-e6ff7fc58e54 Jul 10 06:49:55 devstack sudo[101075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:56 devstack sudo[101075]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a.39fce403-c6f2-4d3b-baea-e6ff7fc58e54" returned: 0 in 0.954s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a.39fce403-c6f2-4d3b-baea-e6ff7fc58e54 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:56 devstack sudo[101084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a.39fce403-c6f2-4d3b-baea-e6ff7fc58e54 Jul 10 06:49:56 devstack sudo[101084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:57 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c8730202-02e8-4a05-81ad-d7bd0f6c9a41 tempest-TestStampPattern-1951221454 None] Acquiring lock "cinder-8416e04e-7ebe-45fb-9bd2-c3eb7d42087a-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:49:57 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c8730202-02e8-4a05-81ad-d7bd0f6c9a41 tempest-TestStampPattern-1951221454 None] Lock "cinder-8416e04e-7ebe-45fb-9bd2-c3eb7d42087a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:49:57 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c8730202-02e8-4a05-81ad-d7bd0f6c9a41 tempest-TestStampPattern-1951221454 None] Acquiring lock "cinder-quobyte-8416e04e-7ebe-45fb-9bd2-c3eb7d42087a" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:49:57 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c8730202-02e8-4a05-81ad-d7bd0f6c9a41 tempest-TestStampPattern-1951221454 None] Lock "cinder-quobyte-8416e04e-7ebe-45fb-9bd2-c3eb7d42087a" acquired by "delete_volume" :: waited 0.022s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:49:57 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[20606660-e479-4d67-947e-5c1f891644ed]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:49:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c8730202-02e8-4a05-81ad-d7bd0f6c9a41 tempest-TestStampPattern-1951221454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8416e04e-7ebe-45fb-9bd2-c3eb7d42087a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:57 devstack sudo[101086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8416e04e-7ebe-45fb-9bd2-c3eb7d42087a Jul 10 06:49:57 devstack sudo[101086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:57 devstack sudo[101084]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a.39fce403-c6f2-4d3b-baea-e6ff7fc58e54" returned: 0 in 0.953s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:57 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] Lock "cinder-quobyte-39fce403-c6f2-4d3b-baea-e6ff7fc58e54" released by "_delete_snapshot" :: held 4.181s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:49:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.064s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:57 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-90885bb0-d2ef-46ad-b78e-5f14313ca067 tempest-GroupsV314Test-1749907710 None] Create group from source-group-d33f7500-7253-44c5-8ad6-1d881c0025e5 completed successfully. Jul 10 06:49:58 devstack sudo[101086]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c8730202-02e8-4a05-81ad-d7bd0f6c9a41 tempest-TestStampPattern-1951221454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8416e04e-7ebe-45fb-9bd2-c3eb7d42087a" returned: 0 in 1.056s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c8730202-02e8-4a05-81ad-d7bd0f6c9a41 tempest-TestStampPattern-1951221454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8416e04e-7ebe-45fb-9bd2-c3eb7d42087a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:58 devstack sudo[101093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8416e04e-7ebe-45fb-9bd2-c3eb7d42087a Jul 10 06:49:58 devstack sudo[101093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:58 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f9b9abf-b298-4370-a963-8cb3b33da183 tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:49:58 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7f9b9abf-b298-4370-a963-8cb3b33da183 tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Flow 'volume_create_manager' (73107abc-85f2-4944-be9d-90ffc3d7f31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:49:58 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7f9b9abf-b298-4370-a963-8cb3b33da183 tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (490af16e-a32e-4f8d-8751-4c02b5aaee48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:58 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7f9b9abf-b298-4370-a963-8cb3b33da183 tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (490af16e-a32e-4f8d-8751-4c02b5aaee48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:49:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-612874889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5226ca67-69fc-42e2-aa2c-c6dbb45af68d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c63abee3992e4a22a784147e8e0ff728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:49:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:49:58Z,use_quota=True,user_id='62f2942da259403791dc01d40369fb52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:58 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7f9b9abf-b298-4370-a963-8cb3b33da183 tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (947c1639-6907-4203-abf0-794fef393c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:58 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7f9b9abf-b298-4370-a963-8cb3b33da183 tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (947c1639-6907-4203-abf0-794fef393c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:58 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7f9b9abf-b298-4370-a963-8cb3b33da183 tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab3f93b0-5c2f-4687-9ca0-f45721b08bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:58 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7f9b9abf-b298-4370-a963-8cb3b33da183 tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab3f93b0-5c2f-4687-9ca0-f45721b08bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5226ca67-69fc-42e2-aa2c-c6dbb45af68d', 'volume_name': 'volume-5226ca67-69fc-42e2-aa2c-c6dbb45af68d', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:58 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7f9b9abf-b298-4370-a963-8cb3b33da183 tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa71c752-e3cf-4117-8d5d-f2ffd052a1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:58 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7f9b9abf-b298-4370-a963-8cb3b33da183 tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa71c752-e3cf-4117-8d5d-f2ffd052a1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:49:58 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7f9b9abf-b298-4370-a963-8cb3b33da183 tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f404c5c8-6309-4926-bb39-960797acd8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:49:58 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-7f9b9abf-b298-4370-a963-8cb3b33da183 tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Volume 5226ca67-69fc-42e2-aa2c-c6dbb45af68d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5226ca67-69fc-42e2-aa2c-c6dbb45af68d', 'volume_size': 1} Jul 10 06:49:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7f9b9abf-b298-4370-a963-8cb3b33da183 tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7f9b9abf-b298-4370-a963-8cb3b33da183 tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:58 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-7f9b9abf-b298-4370-a963-8cb3b33da183 tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:49:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-612874889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5226ca67-69fc-42e2-aa2c-c6dbb45af68d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c63abee3992e4a22a784147e8e0ff728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:49:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:49:58Z,use_quota=True,user_id='62f2942da259403791dc01d40369fb52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:49:58 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-7f9b9abf-b298-4370-a963-8cb3b33da183 tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Creating volume 5226ca67-69fc-42e2-aa2c-c6dbb45af68d {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:49:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7f9b9abf-b298-4370-a963-8cb3b33da183 tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7f9b9abf-b298-4370-a963-8cb3b33da183 tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:58 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-7f9b9abf-b298-4370-a963-8cb3b33da183 tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:49:58 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-7f9b9abf-b298-4370-a963-8cb3b33da183 tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:49:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7f9b9abf-b298-4370-a963-8cb3b33da183 tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:58 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-7f9b9abf-b298-4370-a963-8cb3b33da183 tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:49:58 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-7f9b9abf-b298-4370-a963-8cb3b33da183 tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:49:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7f9b9abf-b298-4370-a963-8cb3b33da183 tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-5226ca67-69fc-42e2-aa2c-c6dbb45af68d 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:58 devstack sudo[101095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-5226ca67-69fc-42e2-aa2c-c6dbb45af68d 1073741824 Jul 10 06:49:58 devstack sudo[101095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:59 devstack sudo[101093]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c8730202-02e8-4a05-81ad-d7bd0f6c9a41 tempest-TestStampPattern-1951221454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8416e04e-7ebe-45fb-9bd2-c3eb7d42087a" returned: 0 in 0.926s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:59 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c8730202-02e8-4a05-81ad-d7bd0f6c9a41 tempest-TestStampPattern-1951221454 None] Lock "cinder-quobyte-8416e04e-7ebe-45fb-9bd2-c3eb7d42087a" released by "delete_volume" :: held 2.060s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:49:59 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-c8730202-02e8-4a05-81ad-d7bd0f6c9a41 tempest-TestStampPattern-1951221454 None] Created reservations ['c429054e-5f4e-4c3b-a3d3-e34bb43960fb', 'cf0db2a2-f5b6-439c-9f5c-2fd19c959246', '57b3c53e-8c34-45b6-9a21-f19085dc63f8', 'cb9458cc-6884-4e7b-8629-1c7e351b644a'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:49:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c8730202-02e8-4a05-81ad-d7bd0f6c9a41 tempest-TestStampPattern-1951221454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:49:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c8730202-02e8-4a05-81ad-d7bd0f6c9a41 tempest-TestStampPattern-1951221454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:49:59 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-c8730202-02e8-4a05-81ad-d7bd0f6c9a41 tempest-TestStampPattern-1951221454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:49:59 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-c8730202-02e8-4a05-81ad-d7bd0f6c9a41 tempest-TestStampPattern-1951221454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:49:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c8730202-02e8-4a05-81ad-d7bd0f6c9a41 tempest-TestStampPattern-1951221454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:49:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c8730202-02e8-4a05-81ad-d7bd0f6c9a41 tempest-TestStampPattern-1951221454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:59 devstack sudo[101102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:49:59 devstack sudo[101102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:49:59 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:SELECT=70,cinder:UPDATE=70,cinder:INSERT=21,cinder:DELETE=3 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:49:59 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7fb734e7-500a-48b9-8a6d-2f2052fdb11b tempest-GroupsV314Test-1749907710 None] Acquiring lock "cinder-quobyte-07efaa3f-4ffc-4b08-9236-249764715f85" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:49:59 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7fb734e7-500a-48b9-8a6d-2f2052fdb11b tempest-GroupsV314Test-1749907710 None] Lock "cinder-quobyte-07efaa3f-4ffc-4b08-9236-249764715f85" acquired by "delete_volume" :: waited 0.027s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:49:59 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3654ea-ab57-4a22-ae2f-5836b4254809]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:49:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7fb734e7-500a-48b9-8a6d-2f2052fdb11b tempest-GroupsV314Test-1749907710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-07efaa3f-4ffc-4b08-9236-249764715f85 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:49:59 devstack sudo[101095]: pam_unix(sudo:session): session closed for user root Jul 10 06:49:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7f9b9abf-b298-4370-a963-8cb3b33da183 tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-5226ca67-69fc-42e2-aa2c-c6dbb45af68d 1073741824" returned: 0 in 1.299s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:49:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7f9b9abf-b298-4370-a963-8cb3b33da183 tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-5226ca67-69fc-42e2-aa2c-c6dbb45af68d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:00 devstack sudo[101107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-5226ca67-69fc-42e2-aa2c-c6dbb45af68d Jul 10 06:50:00 devstack sudo[101107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:00 devstack sudo[101106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-07efaa3f-4ffc-4b08-9236-249764715f85 Jul 10 06:50:00 devstack sudo[101106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:00 devstack sudo[101102]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c8730202-02e8-4a05-81ad-d7bd0f6c9a41 tempest-TestStampPattern-1951221454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.972s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:00 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-c8730202-02e8-4a05-81ad-d7bd0f6c9a41 tempest-TestStampPattern-1951221454 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:50:00 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-c8730202-02e8-4a05-81ad-d7bd0f6c9a41 tempest-TestStampPattern-1951221454 None] Deleted volume successfully. Jul 10 06:50:00 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c8730202-02e8-4a05-81ad-d7bd0f6c9a41 tempest-TestStampPattern-1951221454 None] Lock "cinder-8416e04e-7ebe-45fb-9bd2-c3eb7d42087a-delete_volume" released by "delete_volume" :: held 3.413s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:00 devstack sudo[101107]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7f9b9abf-b298-4370-a963-8cb3b33da183 tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-5226ca67-69fc-42e2-aa2c-c6dbb45af68d" returned: 0 in 0.925s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:00 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-7f9b9abf-b298-4370-a963-8cb3b33da183 tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] <== create_volume: return (2303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:50:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7f9b9abf-b298-4370-a963-8cb3b33da183 tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.305s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:00 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7f9b9abf-b298-4370-a963-8cb3b33da183 tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f404c5c8-6309-4926-bb39-960797acd8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5226ca67-69fc-42e2-aa2c-c6dbb45af68d', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:00 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7f9b9abf-b298-4370-a963-8cb3b33da183 tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70fd16d1-eef2-4123-89c9-22707526db5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:00 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-7f9b9abf-b298-4370-a963-8cb3b33da183 tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Volume volume-5226ca67-69fc-42e2-aa2c-c6dbb45af68d (5226ca67-69fc-42e2-aa2c-c6dbb45af68d): created successfully Jul 10 06:50:00 devstack sudo[101106]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:00 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7f9b9abf-b298-4370-a963-8cb3b33da183 tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70fd16d1-eef2-4123-89c9-22707526db5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:00 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7f9b9abf-b298-4370-a963-8cb3b33da183 tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Flow 'volume_create_manager' (73107abc-85f2-4944-be9d-90ffc3d7f31b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:50:00 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f03b72fb-dc14-49d6-9951-dd886123fb59 tempest-TestStampPattern-1951221454 None] Acquiring lock "cinder-b1e902ea-f893-442d-be2c-e4a2c06bdd35-delete_snapshot" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:50:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7fb734e7-500a-48b9-8a6d-2f2052fdb11b tempest-GroupsV314Test-1749907710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-07efaa3f-4ffc-4b08-9236-249764715f85" returned: 0 in 1.109s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7fb734e7-500a-48b9-8a6d-2f2052fdb11b tempest-GroupsV314Test-1749907710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-07efaa3f-4ffc-4b08-9236-249764715f85 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:01 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-7f9b9abf-b298-4370-a963-8cb3b33da183 tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Created volume successfully. Jul 10 06:50:01 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f03b72fb-dc14-49d6-9951-dd886123fb59 tempest-TestStampPattern-1951221454 None] Lock "cinder-b1e902ea-f893-442d-be2c-e4a2c06bdd35-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:50:01 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f03b72fb-dc14-49d6-9951-dd886123fb59 tempest-TestStampPattern-1951221454 None] Acquiring lock "cinder-quobyte-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:50:01 devstack sudo[101116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-07efaa3f-4ffc-4b08-9236-249764715f85 Jul 10 06:50:01 devstack sudo[101116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:01 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f03b72fb-dc14-49d6-9951-dd886123fb59 tempest-TestStampPattern-1951221454 None] Lock "cinder-quobyte-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:50:01 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f03b72fb-dc14-49d6-9951-dd886123fb59 tempest-TestStampPattern-1951221454 None] Acquiring lock "cinder-quobyte-b1e902ea-f893-442d-be2c-e4a2c06bdd35" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:50:01 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f03b72fb-dc14-49d6-9951-dd886123fb59 tempest-TestStampPattern-1951221454 None] Lock "cinder-quobyte-b1e902ea-f893-442d-be2c-e4a2c06bdd35" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:50:01 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-f03b72fb-dc14-49d6-9951-dd886123fb59 tempest-TestStampPattern-1951221454 None] Deleting offline snapshot b1e902ea-f893-442d-be2c-e4a2c06bdd35 of volume 2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:50:01 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-f03b72fb-dc14-49d6-9951-dd886123fb59 tempest-TestStampPattern-1951221454 None] snapshot_file for this snap is: volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8.b1e902ea-f893-442d-be2c-e4a2c06bdd35 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:50:01 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e798ce-a05d-4ee9-a812-2ce9d3b6c9d6]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:50:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f03b72fb-dc14-49d6-9951-dd886123fb59 tempest-TestStampPattern-1951221454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8.b1e902ea-f893-442d-be2c-e4a2c06bdd35 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:01 devstack sudo[101120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8.b1e902ea-f893-442d-be2c-e4a2c06bdd35 Jul 10 06:50:01 devstack sudo[101120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:01 devstack sudo[101116]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7fb734e7-500a-48b9-8a6d-2f2052fdb11b tempest-GroupsV314Test-1749907710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-07efaa3f-4ffc-4b08-9236-249764715f85" returned: 0 in 0.920s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:01 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7fb734e7-500a-48b9-8a6d-2f2052fdb11b tempest-GroupsV314Test-1749907710 None] Lock "cinder-quobyte-07efaa3f-4ffc-4b08-9236-249764715f85" released by "delete_volume" :: held 2.091s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:02 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-7fb734e7-500a-48b9-8a6d-2f2052fdb11b tempest-GroupsV314Test-1749907710 None] Created reservations ['26bac405-a292-4d50-aaee-89392c68880c'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:50:02 devstack cinder-volume[87294]: WARNING cinder.quota [None req-7fb734e7-500a-48b9-8a6d-2f2052fdb11b tempest-GroupsV314Test-1749907710 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1339785269 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1339785269, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:50:02 devstack cinder-volume[87294]: WARNING cinder.quota [None req-7fb734e7-500a-48b9-8a6d-2f2052fdb11b tempest-GroupsV314Test-1749907710 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1339785269 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1339785269, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:50:02 devstack sudo[101120]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f03b72fb-dc14-49d6-9951-dd886123fb59 tempest-TestStampPattern-1951221454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8.b1e902ea-f893-442d-be2c-e4a2c06bdd35" returned: 0 in 0.962s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:02 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-f03b72fb-dc14-49d6-9951-dd886123fb59 tempest-TestStampPattern-1951221454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:50:02 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-7fb734e7-500a-48b9-8a6d-2f2052fdb11b tempest-GroupsV314Test-1749907710 None] Created reservations ['f833665f-a9a4-4581-ab8f-0d806bc72775', 'c3ff03ea-fd33-48c1-b69c-65554f6afe95', '0fb998c1-78fc-4ea4-9f64-ff27d2d65597', 'd105fa2e-6628-45ac-86a6-f1beb89a365d'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:50:02 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[947a78a2-a231-48fe-a5ea-ab001084a5d9]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:50:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f03b72fb-dc14-49d6-9951-dd886123fb59 tempest-TestStampPattern-1951221454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:02 devstack sudo[101129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8 Jul 10 06:50:02 devstack sudo[101129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7fb734e7-500a-48b9-8a6d-2f2052fdb11b tempest-GroupsV314Test-1749907710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7fb734e7-500a-48b9-8a6d-2f2052fdb11b tempest-GroupsV314Test-1749907710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:02 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-7fb734e7-500a-48b9-8a6d-2f2052fdb11b tempest-GroupsV314Test-1749907710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:50:02 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-7fb734e7-500a-48b9-8a6d-2f2052fdb11b tempest-GroupsV314Test-1749907710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:50:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7fb734e7-500a-48b9-8a6d-2f2052fdb11b tempest-GroupsV314Test-1749907710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7fb734e7-500a-48b9-8a6d-2f2052fdb11b tempest-GroupsV314Test-1749907710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:02 devstack sudo[101131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:50:02 devstack sudo[101131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:02 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a08594b0-6ee1-4de6-861f-04425fa2afc9 tempest-GroupsV314Test-1749907710 None] Acquiring lock "cinder-quobyte-910a1de6-fb9a-41a9-bb84-a8561b04849a" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:50:02 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a08594b0-6ee1-4de6-861f-04425fa2afc9 tempest-GroupsV314Test-1749907710 None] Lock "cinder-quobyte-910a1de6-fb9a-41a9-bb84-a8561b04849a" acquired by "delete_volume" :: waited 0.016s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:50:02 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6451d3-7e85-42b2-bd10-867dffdd1971]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:50:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a08594b0-6ee1-4de6-861f-04425fa2afc9 tempest-GroupsV314Test-1749907710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:02 devstack sudo[101133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a Jul 10 06:50:02 devstack sudo[101133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:03 devstack sudo[101129]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f03b72fb-dc14-49d6-9951-dd886123fb59 tempest-TestStampPattern-1951221454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8" returned: 0 in 1.002s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f03b72fb-dc14-49d6-9951-dd886123fb59 tempest-TestStampPattern-1951221454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8.b1e902ea-f893-442d-be2c-e4a2c06bdd35 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:03 devstack sudo[101138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8.b1e902ea-f893-442d-be2c-e4a2c06bdd35 Jul 10 06:50:03 devstack sudo[101138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:03 devstack sudo[101131]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7fb734e7-500a-48b9-8a6d-2f2052fdb11b tempest-GroupsV314Test-1749907710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.038s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:03 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-7fb734e7-500a-48b9-8a6d-2f2052fdb11b tempest-GroupsV314Test-1749907710 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:50:03 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-7fb734e7-500a-48b9-8a6d-2f2052fdb11b tempest-GroupsV314Test-1749907710 None] Delete group completed successfully. Jul 10 06:50:03 devstack sudo[101133]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a08594b0-6ee1-4de6-861f-04425fa2afc9 tempest-GroupsV314Test-1749907710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a" returned: 0 in 1.051s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a08594b0-6ee1-4de6-861f-04425fa2afc9 tempest-GroupsV314Test-1749907710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:03 devstack sudo[101147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a Jul 10 06:50:03 devstack sudo[101147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:03 devstack sudo[101138]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f03b72fb-dc14-49d6-9951-dd886123fb59 tempest-TestStampPattern-1951221454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8.b1e902ea-f893-442d-be2c-e4a2c06bdd35" returned: 0 in 0.858s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f03b72fb-dc14-49d6-9951-dd886123fb59 tempest-TestStampPattern-1951221454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8.b1e902ea-f893-442d-be2c-e4a2c06bdd35 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:04 devstack sudo[101149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8.b1e902ea-f893-442d-be2c-e4a2c06bdd35 Jul 10 06:50:04 devstack sudo[101149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:04 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:50:04 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Flow 'volume_create_manager' (24370ba9-1a7b-426d-86f7-b292c8a86402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:50:04 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4c37192-c3a9-47f6-b24c-47b03e720cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:04 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4c37192-c3a9-47f6-b24c-47b03e720cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:50:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1582012639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b7985d9-0694-4f31-8003-55116f99eb3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c28155375b1746f6b4b7077d951ea384',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:50:04Z,use_quota=True,user_id='78475d21daea4c088ddf9a206c3e840d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:04 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b9b6f28-4172-4229-b22a-b0aa1474d97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:04 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b9b6f28-4172-4229-b22a-b0aa1474d97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:04 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72815b2c-e90d-4ca4-80aa-0b7466403b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:04 devstack cinder-volume[87294]: DEBUG cinder.image.glance [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Creating Keystone auth plugin from conf {{(pid=87294) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 06:50:04 devstack sudo[101147]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a08594b0-6ee1-4de6-861f-04425fa2afc9 tempest-GroupsV314Test-1749907710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-910a1de6-fb9a-41a9-bb84-a8561b04849a" returned: 0 in 0.826s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:04 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a08594b0-6ee1-4de6-861f-04425fa2afc9 tempest-GroupsV314Test-1749907710 None] Lock "cinder-quobyte-910a1de6-fb9a-41a9-bb84-a8561b04849a" released by "delete_volume" :: held 1.953s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:04 devstack sudo[101149]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f03b72fb-dc14-49d6-9951-dd886123fb59 tempest-TestStampPattern-1951221454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8.b1e902ea-f893-442d-be2c-e4a2c06bdd35" returned: 0 in 0.770s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:04 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-a08594b0-6ee1-4de6-861f-04425fa2afc9 tempest-GroupsV314Test-1749907710 None] Created reservations ['f51eb07b-f456-448f-ab87-cb41f7432895'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:50:04 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f03b72fb-dc14-49d6-9951-dd886123fb59 tempest-TestStampPattern-1951221454 None] Lock "cinder-quobyte-b1e902ea-f893-442d-be2c-e4a2c06bdd35" released by "_delete_snapshot" :: held 3.725s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:04 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f03b72fb-dc14-49d6-9951-dd886123fb59 tempest-TestStampPattern-1951221454 None] Lock "cinder-quobyte-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8" released by "delete_snapshot" :: held 3.759s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:04 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72815b2c-e90d-4ca4-80aa-0b7466403b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1b7985d9-0694-4f31-8003-55116f99eb3c', 'volume_name': 'volume-1b7985d9-0694-4f31-8003-55116f99eb3c', 'volume_size': 1, 'image_id': 'fce564e0-408f-448f-b73c-5fae94549898', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fce564e0-408f-448f-b73c-5fae94549898', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '62db6635aac548658dfcc55ac904ccde', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fce564e0-408f-448f-b73c-5fae94549898', 'created_at': datetime.datetime(2026, 7, 10, 4, 29, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 29, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fce564e0-408f-448f-b73c-5fae94549898/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:04 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2b72d8d-e814-4cde-b87d-cc8ccc99abdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:04 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2b72d8d-e814-4cde-b87d-cc8ccc99abdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:04 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cde706e-4532-4874-9504-b9694f3e70c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:04 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Volume 1b7985d9-0694-4f31-8003-55116f99eb3c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1b7985d9-0694-4f31-8003-55116f99eb3c', 'volume_size': 1, 'image_id': 'fce564e0-408f-448f-b73c-5fae94549898', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fce564e0-408f-448f-b73c-5fae94549898', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '62db6635aac548658dfcc55ac904ccde', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fce564e0-408f-448f-b73c-5fae94549898', 'created_at': datetime.datetime(2026, 7, 10, 4, 29, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 29, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fce564e0-408f-448f-b73c-5fae94549898/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 06:50:04 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Trying to clone 1b7985d9-0694-4f31-8003-55116f99eb3c from image fce564e0-408f-448f-b73c-5fae94549898 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fce564e0-408f-448f-b73c-5fae94549898', 'metadata': {}}]). {{(pid=87294) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 06:50:04 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-a08594b0-6ee1-4de6-861f-04425fa2afc9 tempest-GroupsV314Test-1749907710 None] Created reservations ['1bf99736-0b1c-444e-9383-8a0ee4e01ce6', '0f7a6ebf-ef06-4bab-9da7-c768f648d921', '4e22145f-1220-4c05-82dd-3d41351385bd', '7ecf147e-962f-42e1-81a2-cf8b78cdab60'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:50:04 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-f03b72fb-dc14-49d6-9951-dd886123fb59 tempest-TestStampPattern-1951221454 None] Created reservations ['eb278a82-eb74-4a10-9e10-80bbd2067512', 'cfd9a837-f644-4f8d-b45b-414098129a96', 'c83e0a4c-5066-475c-a9a5-ea1588b84da1', 'fdf569e3-1ae7-44ce-be81-3c3795d2f378'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:50:05 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-f03b72fb-dc14-49d6-9951-dd886123fb59 tempest-TestStampPattern-1951221454 None] Delete snapshot completed successfully. Jul 10 06:50:05 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f03b72fb-dc14-49d6-9951-dd886123fb59 tempest-TestStampPattern-1951221454 None] Lock "cinder-b1e902ea-f893-442d-be2c-e4a2c06bdd35-delete_snapshot" released by "delete_snapshot" :: held 4.101s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a08594b0-6ee1-4de6-861f-04425fa2afc9 tempest-GroupsV314Test-1749907710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a08594b0-6ee1-4de6-861f-04425fa2afc9 tempest-GroupsV314Test-1749907710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:05 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-a08594b0-6ee1-4de6-861f-04425fa2afc9 tempest-GroupsV314Test-1749907710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:50:05 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-a08594b0-6ee1-4de6-861f-04425fa2afc9 tempest-GroupsV314Test-1749907710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:50:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a08594b0-6ee1-4de6-861f-04425fa2afc9 tempest-GroupsV314Test-1749907710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a08594b0-6ee1-4de6-861f-04425fa2afc9 tempest-GroupsV314Test-1749907710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:05 devstack sudo[101161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:50:05 devstack sudo[101161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:05 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_e_3uxsbndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87294) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 06:50:05 devstack cinder-volume[87294]: INFO cinder.image.image_utils [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Image download 20.69 MB at 20.69 MB/s Jul 10 06:50:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-5d75b0e7-d7e6-40cb-9e41-5a57362f0e8d req-ee079f1b-d3c0-400a-8851-20f233f4c803 tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-5d75b0e7-d7e6-40cb-9e41-5a57362f0e8d req-ee079f1b-d3c0-400a-8851-20f233f4c803 tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:05 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[a006c9f0-2fb8-4ad2-a52c-b39c4447c25d]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:50:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-5d75b0e7-d7e6-40cb-9e41-5a57362f0e8d req-ee079f1b-d3c0-400a-8851-20f233f4c803 tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-5226ca67-69fc-42e2-aa2c-c6dbb45af68d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:05 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc87f4a-1262-4d8c-8ccc-e725223eea53]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:50:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_e_3uxsbndevstack@QuobyteHD {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:05 devstack sudo[101164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-5226ca67-69fc-42e2-aa2c-c6dbb45af68d Jul 10 06:50:05 devstack sudo[101164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:05 devstack sudo[101165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_e_3uxsbndevstack@QuobyteHD Jul 10 06:50:05 devstack sudo[101165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:06 devstack sudo[101161]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a08594b0-6ee1-4de6-861f-04425fa2afc9 tempest-GroupsV314Test-1749907710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.096s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:06 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-a08594b0-6ee1-4de6-861f-04425fa2afc9 tempest-GroupsV314Test-1749907710 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:50:06 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-a08594b0-6ee1-4de6-861f-04425fa2afc9 tempest-GroupsV314Test-1749907710 None] Delete group completed successfully. Jul 10 06:50:06 devstack sudo[101164]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-5d75b0e7-d7e6-40cb-9e41-5a57362f0e8d req-ee079f1b-d3c0-400a-8851-20f233f4c803 tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-5226ca67-69fc-42e2-aa2c-c6dbb45af68d" returned: 0 in 1.116s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-5d75b0e7-d7e6-40cb-9e41-5a57362f0e8d req-ee079f1b-d3c0-400a-8851-20f233f4c803 tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.140s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:06 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-5d75b0e7-d7e6-40cb-9e41-5a57362f0e8d req-ee079f1b-d3c0-400a-8851-20f233f4c803 tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804', 'name': 'volume-5226ca67-69fc-42e2-aa2c-c6dbb45af68d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '12f45885-a9c0-4392-9f1d-ffbe5fd47a0b', 'enforce_multipath': True} {{(pid=87294) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:50:06 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-5d75b0e7-d7e6-40cb-9e41-5a57362f0e8d req-ee079f1b-d3c0-400a-8851-20f233f4c803 tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] attachment_update completed successfully. Jul 10 06:50:06 devstack sudo[101165]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_e_3uxsbndevstack@QuobyteHD" returned: 0 in 1.381s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:06 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Temporary image fce564e0-408f-448f-b73c-5fae94549898 is fetched for user 78475d21daea4c088ddf9a206c3e840d. {{(pid=87294) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 06:50:06 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c90c1c-9ad7-4a26-8a9d-945d23be6d55]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:50:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_e_3uxsbndevstack@QuobyteHD {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:07 devstack sudo[101201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_e_3uxsbndevstack@QuobyteHD Jul 10 06:50:07 devstack sudo[101201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:07 devstack sudo[101201]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_e_3uxsbndevstack@QuobyteHD" returned: 0 in 0.962s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:07 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:50:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1582012639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b7985d9-0694-4f31-8003-55116f99eb3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c28155375b1746f6b4b7077d951ea384',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:50:04Z,use_quota=True,user_id='78475d21daea4c088ddf9a206c3e840d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:50:07 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Creating volume 1b7985d9-0694-4f31-8003-55116f99eb3c {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:50:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:07 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:50:07 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:50:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:07 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:50:07 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:50:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b7985d9-0694-4f31-8003-55116f99eb3c 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:07 devstack sudo[101568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b7985d9-0694-4f31-8003-55116f99eb3c 1073741824 Jul 10 06:50:07 devstack sudo[101568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:09 devstack sudo[101568]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b7985d9-0694-4f31-8003-55116f99eb3c 1073741824" returned: 0 in 1.157s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b7985d9-0694-4f31-8003-55116f99eb3c {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:09 devstack sudo[101593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b7985d9-0694-4f31-8003-55116f99eb3c Jul 10 06:50:09 devstack sudo[101593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:09 devstack sudo[101593]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b7985d9-0694-4f31-8003-55116f99eb3c" returned: 0 in 0.922s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:09 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] <== create_volume: return (2143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:50:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.147s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:10 devstack cinder-volume[87294]: DEBUG cinder.volume.volume_utils [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Attempting download of fce564e0-408f-448f-b73c-5fae94549898 ((None, [{'url': 'file:///opt/stack/data/glance/images/fce564e0-408f-448f-b73c-5fae94549898', 'metadata': {}}])) to volume 1b7985d9-0694-4f31-8003-55116f99eb3c. {{(pid=87294) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 06:50:10 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1793304-5e02-4715-8e5b-75d56c0e27c8]: (4, 'raw') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:50:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fce564e0-408f-448f-b73c-5fae94549898_g6l9f8n0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:10 devstack sudo[101599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fce564e0-408f-448f-b73c-5fae94549898_g6l9f8n0 Jul 10 06:50:10 devstack sudo[101599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:11 devstack sudo[101599]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fce564e0-408f-448f-b73c-5fae94549898_g6l9f8n0" returned: 0 in 0.886s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fce564e0-408f-448f-b73c-5fae94549898_g6l9f8n0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:11 devstack sudo[101604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fce564e0-408f-448f-b73c-5fae94549898_g6l9f8n0 Jul 10 06:50:11 devstack sudo[101604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:11 devstack sudo[101604]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fce564e0-408f-448f-b73c-5fae94549898_g6l9f8n0" returned: 1 in 0.860s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fce564e0-408f-448f-b73c-5fae94549898_g6l9f8n0' failed. Not Retrying. {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:50:11 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ea0d94-2a8b-4b61-9dd3-2c3f955fa509]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:50:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_e_3uxsbndevstack@QuobyteHD {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:12 devstack sudo[101608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_e_3uxsbndevstack@QuobyteHD Jul 10 06:50:12 devstack sudo[101608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:12 devstack sudo[101608]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_e_3uxsbndevstack@QuobyteHD" returned: 0 in 0.847s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:12 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] fce564e0-408f-448f-b73c-5fae94549898 was qcow2, converting to raw {{(pid=87294) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 06:50:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_e_3uxsbndevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b7985d9-0694-4f31-8003-55116f99eb3c {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:12 devstack sudo[101613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_e_3uxsbndevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b7985d9-0694-4f31-8003-55116f99eb3c Jul 10 06:50:12 devstack sudo[101613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:13 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-78d0e638-8ee5-4358-8e9a-07495e92506f req-220bdc42-1e78-417c-9f40-022b053646bb tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Terminate volume connection completed successfully. Jul 10 06:50:13 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-78d0e638-8ee5-4358-8e9a-07495e92506f req-220bdc42-1e78-417c-9f40-022b053646bb tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Deleting attachment 12f45885-a9c0-4392-9f1d-ffbe5fd47a0b. {{(pid=87294) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:50:14 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-dedb2759-8e53-4e14-bb08-71f4a0106647 tempest-TestStampPattern-1951221454 None] Acquiring lock "cinder-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:50:14 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-dedb2759-8e53-4e14-bb08-71f4a0106647 tempest-TestStampPattern-1951221454 None] Lock "cinder-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:50:14 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-dedb2759-8e53-4e14-bb08-71f4a0106647 tempest-TestStampPattern-1951221454 None] Acquiring lock "cinder-quobyte-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:50:14 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-dedb2759-8e53-4e14-bb08-71f4a0106647 tempest-TestStampPattern-1951221454 None] Lock "cinder-quobyte-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8" acquired by "delete_volume" :: waited 0.030s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:50:14 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56038fd-5779-40f4-b0e8-a4394187dfc4]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:50:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-dedb2759-8e53-4e14-bb08-71f4a0106647 tempest-TestStampPattern-1951221454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:14 devstack sudo[101649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8 Jul 10 06:50:14 devstack sudo[101649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:15 devstack sudo[101613]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_e_3uxsbndevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b7985d9-0694-4f31-8003-55116f99eb3c" returned: 0 in 2.280s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:15 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fce564e0-408f-448f-b73c-5fae94549898_e_3uxsbndevstack@QuobyteHD, size 112.00 MB, duration 2.28 sec, destination /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b7985d9-0694-4f31-8003-55116f99eb3c {{(pid=87294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 06:50:15 devstack cinder-volume[87294]: INFO cinder.image.image_utils [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Converted 112.00 MB image at 49.08 MB/s Jul 10 06:50:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b7985d9-0694-4f31-8003-55116f99eb3c 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:15 devstack sudo[101651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b7985d9-0694-4f31-8003-55116f99eb3c 1G Jul 10 06:50:15 devstack sudo[101651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:15 devstack sudo[101649]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-dedb2759-8e53-4e14-bb08-71f4a0106647 tempest-TestStampPattern-1951221454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8" returned: 0 in 0.829s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-dedb2759-8e53-4e14-bb08-71f4a0106647 tempest-TestStampPattern-1951221454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:15 devstack sudo[101657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8 Jul 10 06:50:15 devstack sudo[101657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:15 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-204fef8b-10e1-4d9a-930c-b1dd96b79dfb tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Acquiring lock "cinder-5226ca67-69fc-42e2-aa2c-c6dbb45af68d-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:50:15 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-204fef8b-10e1-4d9a-930c-b1dd96b79dfb tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Lock "cinder-5226ca67-69fc-42e2-aa2c-c6dbb45af68d-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:50:15 devstack sudo[101651]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b7985d9-0694-4f31-8003-55116f99eb3c 1G" returned: 0 in 0.941s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:15 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-204fef8b-10e1-4d9a-930c-b1dd96b79dfb tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Acquiring lock "cinder-quobyte-5226ca67-69fc-42e2-aa2c-c6dbb45af68d" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:50:16 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-204fef8b-10e1-4d9a-930c-b1dd96b79dfb tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Lock "cinder-quobyte-5226ca67-69fc-42e2-aa2c-c6dbb45af68d" acquired by "delete_volume" :: waited 0.023s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:50:16 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce51748-1b60-46ec-8c2d-94b28aa81118]: (4, 'raw') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:50:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b7985d9-0694-4f31-8003-55116f99eb3c {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:16 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[91dc5dc0-99fc-4036-9971-42163052ea19]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:50:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-204fef8b-10e1-4d9a-930c-b1dd96b79dfb tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-5226ca67-69fc-42e2-aa2c-c6dbb45af68d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:16 devstack sudo[101662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b7985d9-0694-4f31-8003-55116f99eb3c Jul 10 06:50:16 devstack sudo[101662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:16 devstack sudo[101663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-5226ca67-69fc-42e2-aa2c-c6dbb45af68d Jul 10 06:50:16 devstack sudo[101663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:16 devstack sudo[101657]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-dedb2759-8e53-4e14-bb08-71f4a0106647 tempest-TestStampPattern-1951221454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8" returned: 0 in 0.800s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:16 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-dedb2759-8e53-4e14-bb08-71f4a0106647 tempest-TestStampPattern-1951221454 None] Lock "cinder-quobyte-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8" released by "delete_volume" :: held 1.700s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:16 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-dedb2759-8e53-4e14-bb08-71f4a0106647 tempest-TestStampPattern-1951221454 None] Created reservations ['471b1064-92fe-428e-8502-daf421e3a9f8', 'cb4afe2a-7656-43f6-81a3-142f83c1d9f4', '60c2e466-b0aa-4d81-ba91-c49bf5fc353b', '7b9066fb-aebf-49d6-94ed-f81bae7ad543'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:50:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-dedb2759-8e53-4e14-bb08-71f4a0106647 tempest-TestStampPattern-1951221454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-dedb2759-8e53-4e14-bb08-71f4a0106647 tempest-TestStampPattern-1951221454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:16 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-dedb2759-8e53-4e14-bb08-71f4a0106647 tempest-TestStampPattern-1951221454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:50:16 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-dedb2759-8e53-4e14-bb08-71f4a0106647 tempest-TestStampPattern-1951221454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:50:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-dedb2759-8e53-4e14-bb08-71f4a0106647 tempest-TestStampPattern-1951221454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-dedb2759-8e53-4e14-bb08-71f4a0106647 tempest-TestStampPattern-1951221454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:16 devstack sudo[101667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:50:16 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:16 devstack sudo[101662]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b7985d9-0694-4f31-8003-55116f99eb3c" returned: 0 in 0.910s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b7985d9-0694-4f31-8003-55116f99eb3c {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:17 devstack sudo[101674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b7985d9-0694-4f31-8003-55116f99eb3c Jul 10 06:50:17 devstack sudo[101674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:17 devstack sudo[101663]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-204fef8b-10e1-4d9a-930c-b1dd96b79dfb tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-5226ca67-69fc-42e2-aa2c-c6dbb45af68d" returned: 0 in 1.057s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-204fef8b-10e1-4d9a-930c-b1dd96b79dfb tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-5226ca67-69fc-42e2-aa2c-c6dbb45af68d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:17 devstack sudo[101676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-5226ca67-69fc-42e2-aa2c-c6dbb45af68d Jul 10 06:50:17 devstack sudo[101676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:17 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-dedb2759-8e53-4e14-bb08-71f4a0106647 tempest-TestStampPattern-1951221454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.851s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:17 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-dedb2759-8e53-4e14-bb08-71f4a0106647 tempest-TestStampPattern-1951221454 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:50:17 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-dedb2759-8e53-4e14-bb08-71f4a0106647 tempest-TestStampPattern-1951221454 None] Deleted volume successfully. Jul 10 06:50:17 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-dedb2759-8e53-4e14-bb08-71f4a0106647 tempest-TestStampPattern-1951221454 None] Lock "cinder-2062c1bf-bcd3-4bfd-883e-cffcf27cd6b8-delete_volume" released by "delete_volume" :: held 2.850s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:17 devstack sudo[101674]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b7985d9-0694-4f31-8003-55116f99eb3c" returned: 1 in 0.986s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b7985d9-0694-4f31-8003-55116f99eb3c' failed. Not Retrying. {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:50:17 devstack cinder-volume[87294]: DEBUG cinder.volume.volume_utils [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Downloaded image fce564e0-408f-448f-b73c-5fae94549898 ((None, [{'url': 'file:///opt/stack/data/glance/images/fce564e0-408f-448f-b73c-5fae94549898', 'metadata': {}}])) to volume 1b7985d9-0694-4f31-8003-55116f99eb3c successfully. {{(pid=87294) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 06:50:17 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Temporary image fce564e0-408f-448f-b73c-5fae94549898 for user 78475d21daea4c088ddf9a206c3e840d is deleted. {{(pid=87294) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 06:50:17 devstack cinder-volume[87294]: DEBUG cinder.volume.volume_utils [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Marking volume 1b7985d9-0694-4f31-8003-55116f99eb3c as bootable. {{(pid=87294) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 06:50:17 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Copying metadata from image fce564e0-408f-448f-b73c-5fae94549898 to 1b7985d9-0694-4f31-8003-55116f99eb3c. {{(pid=87294) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 06:50:17 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Creating volume glance metadata for volume 1b7985d9-0694-4f31-8003-55116f99eb3c backed by image fce564e0-408f-448f-b73c-5fae94549898 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fce564e0-408f-448f-b73c-5fae94549898', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87294) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 06:50:18 devstack sudo[101676]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-204fef8b-10e1-4d9a-930c-b1dd96b79dfb tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-5226ca67-69fc-42e2-aa2c-c6dbb45af68d" returned: 0 in 0.921s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:18 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-204fef8b-10e1-4d9a-930c-b1dd96b79dfb tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Lock "cinder-quobyte-5226ca67-69fc-42e2-aa2c-c6dbb45af68d" released by "delete_volume" :: held 2.046s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cde706e-4532-4874-9504-b9694f3e70c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b7985d9-0694-4f31-8003-55116f99eb3c', 'volume_size': 1, 'image_id': 'fce564e0-408f-448f-b73c-5fae94549898', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fce564e0-408f-448f-b73c-5fae94549898', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '62db6635aac548658dfcc55ac904ccde', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fce564e0-408f-448f-b73c-5fae94549898', 'created_at': datetime.datetime(2026, 7, 10, 4, 29, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 29, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fce564e0-408f-448f-b73c-5fae94549898/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b284b0ea-76b0-4a7f-97cc-12e5191df03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:18 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Volume volume-1b7985d9-0694-4f31-8003-55116f99eb3c (1b7985d9-0694-4f31-8003-55116f99eb3c): created successfully Jul 10 06:50:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b284b0ea-76b0-4a7f-97cc-12e5191df03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Flow 'volume_create_manager' (24370ba9-1a7b-426d-86f7-b292c8a86402) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:50:18 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-6e1b5d00-44c8-4f13-92b6-ff1baa5abfcf tempest-TestShelveInstance-522639284 None] Created volume successfully. Jul 10 06:50:18 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-204fef8b-10e1-4d9a-930c-b1dd96b79dfb tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Created reservations ['12f59bf3-eaed-4190-ab50-3d972fd58212', '1343fd04-4dd2-4c97-a10b-890ee9ea96b3', 'ea921826-1dcc-42fd-ae18-4906856f86bd', '85279e95-4a0c-467f-9a2f-6efcf72badf8'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:50:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-204fef8b-10e1-4d9a-930c-b1dd96b79dfb tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-204fef8b-10e1-4d9a-930c-b1dd96b79dfb tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:18 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-204fef8b-10e1-4d9a-930c-b1dd96b79dfb tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:50:18 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-204fef8b-10e1-4d9a-930c-b1dd96b79dfb tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:50:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-204fef8b-10e1-4d9a-930c-b1dd96b79dfb tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-204fef8b-10e1-4d9a-930c-b1dd96b79dfb tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:18 devstack sudo[101683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:50:18 devstack sudo[101683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:19 devstack sudo[101683]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-204fef8b-10e1-4d9a-930c-b1dd96b79dfb tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.856s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:19 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-204fef8b-10e1-4d9a-930c-b1dd96b79dfb tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:50:19 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-204fef8b-10e1-4d9a-930c-b1dd96b79dfb tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Deleted volume successfully. Jul 10 06:50:19 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-204fef8b-10e1-4d9a-930c-b1dd96b79dfb tempest-TestServerVolumeAttachScenarioOldVersion-1554908745 None] Lock "cinder-5226ca67-69fc-42e2-aa2c-c6dbb45af68d-delete_volume" released by "delete_volume" :: held 3.251s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:21 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:50:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:50:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:50:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:21 devstack sudo[101748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:50:21 devstack sudo[101748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:22 devstack sudo[101748]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.747s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:22 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:50:22 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager._thread_info {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:50:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread count: 28 {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:50:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread info: [<_MainThread(MainThread, started 139245706264704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:50:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-156c401d-1f2f-4580-9a27-566d8f6e96ba req-ee67f1fb-5552-462f-8113-d3c73d3e04b4 tempest-TestShelveInstance-522639284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-156c401d-1f2f-4580-9a27-566d8f6e96ba req-ee67f1fb-5552-462f-8113-d3c73d3e04b4 tempest-TestShelveInstance-522639284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:26 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef925355-c4db-4572-b9d6-2f650005903f]: (4, 'raw') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:50:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-156c401d-1f2f-4580-9a27-566d8f6e96ba req-ee67f1fb-5552-462f-8113-d3c73d3e04b4 tempest-TestShelveInstance-522639284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b7985d9-0694-4f31-8003-55116f99eb3c {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:26 devstack sudo[101766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b7985d9-0694-4f31-8003-55116f99eb3c Jul 10 06:50:26 devstack sudo[101766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:27 devstack sudo[101766]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-156c401d-1f2f-4580-9a27-566d8f6e96ba req-ee67f1fb-5552-462f-8113-d3c73d3e04b4 tempest-TestShelveInstance-522639284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b7985d9-0694-4f31-8003-55116f99eb3c" returned: 0 in 1.048s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-156c401d-1f2f-4580-9a27-566d8f6e96ba req-ee67f1fb-5552-462f-8113-d3c73d3e04b4 tempest-TestShelveInstance-522639284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b7985d9-0694-4f31-8003-55116f99eb3c {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:27 devstack sudo[101771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b7985d9-0694-4f31-8003-55116f99eb3c Jul 10 06:50:27 devstack sudo[101771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:28 devstack sudo[101771]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-156c401d-1f2f-4580-9a27-566d8f6e96ba req-ee67f1fb-5552-462f-8113-d3c73d3e04b4 tempest-TestShelveInstance-522639284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b7985d9-0694-4f31-8003-55116f99eb3c" returned: 1 in 0.938s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-156c401d-1f2f-4580-9a27-566d8f6e96ba req-ee67f1fb-5552-462f-8113-d3c73d3e04b4 tempest-TestShelveInstance-522639284 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b7985d9-0694-4f31-8003-55116f99eb3c' failed. Not Retrying. {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:50:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-156c401d-1f2f-4580-9a27-566d8f6e96ba req-ee67f1fb-5552-462f-8113-d3c73d3e04b4 tempest-TestShelveInstance-522639284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.040s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:28 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-156c401d-1f2f-4580-9a27-566d8f6e96ba req-ee67f1fb-5552-462f-8113-d3c73d3e04b4 tempest-TestShelveInstance-522639284 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804', 'name': 'volume-1b7985d9-0694-4f31-8003-55116f99eb3c', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a6c3d986-8860-40ad-baf5-a53cdc0c5e13', 'enforce_multipath': True} {{(pid=87294) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:50:28 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-156c401d-1f2f-4580-9a27-566d8f6e96ba req-ee67f1fb-5552-462f-8113-d3c73d3e04b4 tempest-TestShelveInstance-522639284 None] attachment_update completed successfully. Jul 10 06:50:31 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bcbc8d0-d278-4100-a820-a7cf1b6b5e2f tempest-SnapshotMetadataTestJSON-1965665849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:50:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2bcbc8d0-d278-4100-a820-a7cf1b6b5e2f tempest-SnapshotMetadataTestJSON-1965665849 None] Flow 'volume_create_manager' (aa67ab0e-1bf7-44b4-bbe8-6c085215bf17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:50:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2bcbc8d0-d278-4100-a820-a7cf1b6b5e2f tempest-SnapshotMetadataTestJSON-1965665849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1fcadb0-f320-4077-9876-191316ef8095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2bcbc8d0-d278-4100-a820-a7cf1b6b5e2f tempest-SnapshotMetadataTestJSON-1965665849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1fcadb0-f320-4077-9876-191316ef8095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1855265801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e19e2577-751e-4ecf-9d2b-59dd2fd40b4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='960b4f48072e409d930ec7c762200404',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:50:31Z,use_quota=True,user_id='17ee042d13ed4b3280f1643187a0cac5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2bcbc8d0-d278-4100-a820-a7cf1b6b5e2f tempest-SnapshotMetadataTestJSON-1965665849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7a2c92d-c8ab-449b-bcac-3c6326aa8466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2bcbc8d0-d278-4100-a820-a7cf1b6b5e2f tempest-SnapshotMetadataTestJSON-1965665849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7a2c92d-c8ab-449b-bcac-3c6326aa8466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2bcbc8d0-d278-4100-a820-a7cf1b6b5e2f tempest-SnapshotMetadataTestJSON-1965665849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b687058-9afc-4ec2-9ffb-b132f7ce08f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2bcbc8d0-d278-4100-a820-a7cf1b6b5e2f tempest-SnapshotMetadataTestJSON-1965665849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b687058-9afc-4ec2-9ffb-b132f7ce08f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e19e2577-751e-4ecf-9d2b-59dd2fd40b4b', 'volume_name': 'volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2bcbc8d0-d278-4100-a820-a7cf1b6b5e2f tempest-SnapshotMetadataTestJSON-1965665849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (239671d1-e88c-4937-a2be-d6e720f47c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2bcbc8d0-d278-4100-a820-a7cf1b6b5e2f tempest-SnapshotMetadataTestJSON-1965665849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (239671d1-e88c-4937-a2be-d6e720f47c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2bcbc8d0-d278-4100-a820-a7cf1b6b5e2f tempest-SnapshotMetadataTestJSON-1965665849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53477b1e-097a-460c-a65b-f3a541c356ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:31 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-2bcbc8d0-d278-4100-a820-a7cf1b6b5e2f tempest-SnapshotMetadataTestJSON-1965665849 None] Volume e19e2577-751e-4ecf-9d2b-59dd2fd40b4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b', 'volume_size': 1} Jul 10 06:50:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2bcbc8d0-d278-4100-a820-a7cf1b6b5e2f tempest-SnapshotMetadataTestJSON-1965665849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2bcbc8d0-d278-4100-a820-a7cf1b6b5e2f tempest-SnapshotMetadataTestJSON-1965665849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:31 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-2bcbc8d0-d278-4100-a820-a7cf1b6b5e2f tempest-SnapshotMetadataTestJSON-1965665849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1855265801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e19e2577-751e-4ecf-9d2b-59dd2fd40b4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='960b4f48072e409d930ec7c762200404',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:50:31Z,use_quota=True,user_id='17ee042d13ed4b3280f1643187a0cac5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:50:31 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-2bcbc8d0-d278-4100-a820-a7cf1b6b5e2f tempest-SnapshotMetadataTestJSON-1965665849 None] Creating volume e19e2577-751e-4ecf-9d2b-59dd2fd40b4b {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:50:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2bcbc8d0-d278-4100-a820-a7cf1b6b5e2f tempest-SnapshotMetadataTestJSON-1965665849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2bcbc8d0-d278-4100-a820-a7cf1b6b5e2f tempest-SnapshotMetadataTestJSON-1965665849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:31 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-2bcbc8d0-d278-4100-a820-a7cf1b6b5e2f tempest-SnapshotMetadataTestJSON-1965665849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:50:31 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-2bcbc8d0-d278-4100-a820-a7cf1b6b5e2f tempest-SnapshotMetadataTestJSON-1965665849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:50:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2bcbc8d0-d278-4100-a820-a7cf1b6b5e2f tempest-SnapshotMetadataTestJSON-1965665849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:31 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-2bcbc8d0-d278-4100-a820-a7cf1b6b5e2f tempest-SnapshotMetadataTestJSON-1965665849 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:50:31 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-2bcbc8d0-d278-4100-a820-a7cf1b6b5e2f tempest-SnapshotMetadataTestJSON-1965665849 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:50:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2bcbc8d0-d278-4100-a820-a7cf1b6b5e2f tempest-SnapshotMetadataTestJSON-1965665849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:31 devstack sudo[101781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b 1073741824 Jul 10 06:50:31 devstack sudo[101781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:32 devstack sudo[101781]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2bcbc8d0-d278-4100-a820-a7cf1b6b5e2f tempest-SnapshotMetadataTestJSON-1965665849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b 1073741824" returned: 0 in 1.106s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2bcbc8d0-d278-4100-a820-a7cf1b6b5e2f tempest-SnapshotMetadataTestJSON-1965665849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:32 devstack sudo[101859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b Jul 10 06:50:32 devstack sudo[101859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:33 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-98bd2ba3-4cac-4711-a75c-6b6d99187bd7 tempest-CreateVolumesFromImageTest-1811867116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:50:33 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-98bd2ba3-4cac-4711-a75c-6b6d99187bd7 tempest-CreateVolumesFromImageTest-1811867116 None] Flow 'volume_create_manager' (d62ddd54-6085-4ec1-ab0d-394aea036243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:50:33 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-98bd2ba3-4cac-4711-a75c-6b6d99187bd7 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8047505-bd11-4978-b822-60047c088855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:33 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-98bd2ba3-4cac-4711-a75c-6b6d99187bd7 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8047505-bd11-4978-b822-60047c088855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1424461769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d247168b-a0f3-4ea6-980f-917f06393767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63aec7de6832484b81e0fe37ee3107c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:50:33Z,use_quota=True,user_id='b89f698b3145436fa0bb3c722dd5e71e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:33 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-98bd2ba3-4cac-4711-a75c-6b6d99187bd7 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b863c3f5-e2cb-441f-b1d5-a92b2d59c94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:33 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-98bd2ba3-4cac-4711-a75c-6b6d99187bd7 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b863c3f5-e2cb-441f-b1d5-a92b2d59c94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:33 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-98bd2ba3-4cac-4711-a75c-6b6d99187bd7 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcb82db2-1b6e-4e12-bb2f-4be146c76951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:33 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-98bd2ba3-4cac-4711-a75c-6b6d99187bd7 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcb82db2-1b6e-4e12-bb2f-4be146c76951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd247168b-a0f3-4ea6-980f-917f06393767', 'volume_name': 'volume-d247168b-a0f3-4ea6-980f-917f06393767', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:33 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-98bd2ba3-4cac-4711-a75c-6b6d99187bd7 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2988b5f-57f6-4d14-b93d-425f9f89119f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:33 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-98bd2ba3-4cac-4711-a75c-6b6d99187bd7 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2988b5f-57f6-4d14-b93d-425f9f89119f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:33 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-98bd2ba3-4cac-4711-a75c-6b6d99187bd7 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a60208b3-b92e-4fd0-af82-7e98d708a33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:33 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-98bd2ba3-4cac-4711-a75c-6b6d99187bd7 tempest-CreateVolumesFromImageTest-1811867116 None] Volume d247168b-a0f3-4ea6-980f-917f06393767: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d247168b-a0f3-4ea6-980f-917f06393767', 'volume_size': 1} Jul 10 06:50:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-98bd2ba3-4cac-4711-a75c-6b6d99187bd7 tempest-CreateVolumesFromImageTest-1811867116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:33 devstack sudo[101859]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2bcbc8d0-d278-4100-a820-a7cf1b6b5e2f tempest-SnapshotMetadataTestJSON-1965665849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b" returned: 0 in 1.242s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:33 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-2bcbc8d0-d278-4100-a820-a7cf1b6b5e2f tempest-SnapshotMetadataTestJSON-1965665849 None] <== create_volume: return (2407ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:50:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2bcbc8d0-d278-4100-a820-a7cf1b6b5e2f tempest-SnapshotMetadataTestJSON-1965665849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.410s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-98bd2ba3-4cac-4711-a75c-6b6d99187bd7 tempest-CreateVolumesFromImageTest-1811867116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.273s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:33 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-98bd2ba3-4cac-4711-a75c-6b6d99187bd7 tempest-CreateVolumesFromImageTest-1811867116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1424461769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d247168b-a0f3-4ea6-980f-917f06393767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63aec7de6832484b81e0fe37ee3107c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:50:33Z,use_quota=True,user_id='b89f698b3145436fa0bb3c722dd5e71e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:50:33 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-98bd2ba3-4cac-4711-a75c-6b6d99187bd7 tempest-CreateVolumesFromImageTest-1811867116 None] Creating volume d247168b-a0f3-4ea6-980f-917f06393767 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:50:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-98bd2ba3-4cac-4711-a75c-6b6d99187bd7 tempest-CreateVolumesFromImageTest-1811867116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-98bd2ba3-4cac-4711-a75c-6b6d99187bd7 tempest-CreateVolumesFromImageTest-1811867116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:34 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-98bd2ba3-4cac-4711-a75c-6b6d99187bd7 tempest-CreateVolumesFromImageTest-1811867116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:50:34 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-98bd2ba3-4cac-4711-a75c-6b6d99187bd7 tempest-CreateVolumesFromImageTest-1811867116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:50:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-98bd2ba3-4cac-4711-a75c-6b6d99187bd7 tempest-CreateVolumesFromImageTest-1811867116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:34 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-98bd2ba3-4cac-4711-a75c-6b6d99187bd7 tempest-CreateVolumesFromImageTest-1811867116 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:50:34 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-98bd2ba3-4cac-4711-a75c-6b6d99187bd7 tempest-CreateVolumesFromImageTest-1811867116 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:50:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-98bd2ba3-4cac-4711-a75c-6b6d99187bd7 tempest-CreateVolumesFromImageTest-1811867116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d247168b-a0f3-4ea6-980f-917f06393767 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2bcbc8d0-d278-4100-a820-a7cf1b6b5e2f tempest-SnapshotMetadataTestJSON-1965665849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53477b1e-097a-460c-a65b-f3a541c356ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:34 devstack sudo[101898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d247168b-a0f3-4ea6-980f-917f06393767 1073741824 Jul 10 06:50:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2bcbc8d0-d278-4100-a820-a7cf1b6b5e2f tempest-SnapshotMetadataTestJSON-1965665849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3a7c2f0-9e98-4221-8ce5-6c959aa781f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:34 devstack sudo[101898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:34 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-2bcbc8d0-d278-4100-a820-a7cf1b6b5e2f tempest-SnapshotMetadataTestJSON-1965665849 None] Volume volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b (e19e2577-751e-4ecf-9d2b-59dd2fd40b4b): created successfully Jul 10 06:50:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2bcbc8d0-d278-4100-a820-a7cf1b6b5e2f tempest-SnapshotMetadataTestJSON-1965665849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3a7c2f0-9e98-4221-8ce5-6c959aa781f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2bcbc8d0-d278-4100-a820-a7cf1b6b5e2f tempest-SnapshotMetadataTestJSON-1965665849 None] Flow 'volume_create_manager' (aa67ab0e-1bf7-44b4-bbe8-6c085215bf17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:50:34 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-2bcbc8d0-d278-4100-a820-a7cf1b6b5e2f tempest-SnapshotMetadataTestJSON-1965665849 None] Created volume successfully. Jul 10 06:50:34 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c02a517-ae6e-4ed8-b252-431b49d77eb4 tempest-CreateVolumesFromImageTest-1811867116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:50:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9c02a517-ae6e-4ed8-b252-431b49d77eb4 tempest-CreateVolumesFromImageTest-1811867116 None] Flow 'volume_create_manager' (c3bc8de3-f321-4bd3-beed-240cc7b95607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:50:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9c02a517-ae6e-4ed8-b252-431b49d77eb4 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72743d49-3a09-47fe-a102-a3588bceb85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9c02a517-ae6e-4ed8-b252-431b49d77eb4 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72743d49-3a09-47fe-a102-a3588bceb85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-745095196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55d6a106-2076-40f7-9a1d-ad97e103c2fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63aec7de6832484b81e0fe37ee3107c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:50:34Z,use_quota=True,user_id='b89f698b3145436fa0bb3c722dd5e71e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9c02a517-ae6e-4ed8-b252-431b49d77eb4 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa3c7918-2fb0-44c1-bb20-5b76c22a9e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9c02a517-ae6e-4ed8-b252-431b49d77eb4 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa3c7918-2fb0-44c1-bb20-5b76c22a9e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9c02a517-ae6e-4ed8-b252-431b49d77eb4 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70da88b0-9985-42db-8964-6dd2146e903b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9c02a517-ae6e-4ed8-b252-431b49d77eb4 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70da88b0-9985-42db-8964-6dd2146e903b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55d6a106-2076-40f7-9a1d-ad97e103c2fa', 'volume_name': 'volume-55d6a106-2076-40f7-9a1d-ad97e103c2fa', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9c02a517-ae6e-4ed8-b252-431b49d77eb4 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2844bf4f-ff4e-45c4-9e02-761d4870ee5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9c02a517-ae6e-4ed8-b252-431b49d77eb4 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2844bf4f-ff4e-45c4-9e02-761d4870ee5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9c02a517-ae6e-4ed8-b252-431b49d77eb4 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1137471b-5164-4b46-b48a-bd02dff5f13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:34 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-9c02a517-ae6e-4ed8-b252-431b49d77eb4 tempest-CreateVolumesFromImageTest-1811867116 None] Volume 55d6a106-2076-40f7-9a1d-ad97e103c2fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55d6a106-2076-40f7-9a1d-ad97e103c2fa', 'volume_size': 1} Jul 10 06:50:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9c02a517-ae6e-4ed8-b252-431b49d77eb4 tempest-CreateVolumesFromImageTest-1811867116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-45a79877-a4cb-4cf2-b266-18539875e021 tempest-SnapshotMetadataTestJSON-1965665849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:35 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff83f0ad-2e1e-497b-afad-466b90b644d6 tempest-CreateVolumesFromImageTest-1811867116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:50:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ff83f0ad-2e1e-497b-afad-466b90b644d6 tempest-CreateVolumesFromImageTest-1811867116 None] Flow 'volume_create_manager' (ad440c30-39c5-4a37-94f9-275b825e16d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:50:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ff83f0ad-2e1e-497b-afad-466b90b644d6 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e75ac10-31b6-4285-9782-b543421283a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ff83f0ad-2e1e-497b-afad-466b90b644d6 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e75ac10-31b6-4285-9782-b543421283a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1901791759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e010282e-9dda-4ad1-9169-111757876706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63aec7de6832484b81e0fe37ee3107c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:50:35Z,use_quota=True,user_id='b89f698b3145436fa0bb3c722dd5e71e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ff83f0ad-2e1e-497b-afad-466b90b644d6 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af82614-0910-463e-a5ce-9f2e4b05ec40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ff83f0ad-2e1e-497b-afad-466b90b644d6 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af82614-0910-463e-a5ce-9f2e4b05ec40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ff83f0ad-2e1e-497b-afad-466b90b644d6 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13797339-1044-42a8-b9b7-2588a730e450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ff83f0ad-2e1e-497b-afad-466b90b644d6 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13797339-1044-42a8-b9b7-2588a730e450) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e010282e-9dda-4ad1-9169-111757876706', 'volume_name': 'volume-e010282e-9dda-4ad1-9169-111757876706', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ff83f0ad-2e1e-497b-afad-466b90b644d6 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1242a6b0-592b-45ad-95eb-a45703ed4910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ff83f0ad-2e1e-497b-afad-466b90b644d6 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1242a6b0-592b-45ad-95eb-a45703ed4910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ff83f0ad-2e1e-497b-afad-466b90b644d6 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07e415c2-f7f3-418f-8951-ce3f0ad351c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:35 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-ff83f0ad-2e1e-497b-afad-466b90b644d6 tempest-CreateVolumesFromImageTest-1811867116 None] Volume e010282e-9dda-4ad1-9169-111757876706: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e010282e-9dda-4ad1-9169-111757876706', 'volume_size': 1} Jul 10 06:50:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ff83f0ad-2e1e-497b-afad-466b90b644d6 tempest-CreateVolumesFromImageTest-1811867116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:35 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac10b858-7e69-42cd-a093-f6194f2bd657 tempest-CreateVolumesFromImageTest-1811867116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:50:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ac10b858-7e69-42cd-a093-f6194f2bd657 tempest-CreateVolumesFromImageTest-1811867116 None] Flow 'volume_create_manager' (69286f69-18d7-4339-9119-6cc9261300ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:50:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ac10b858-7e69-42cd-a093-f6194f2bd657 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22b9b4a4-641d-4252-80b8-dfeb92c5063f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:35 devstack sudo[101898]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-98bd2ba3-4cac-4711-a75c-6b6d99187bd7 tempest-CreateVolumesFromImageTest-1811867116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d247168b-a0f3-4ea6-980f-917f06393767 1073741824" returned: 0 in 1.818s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ac10b858-7e69-42cd-a093-f6194f2bd657 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22b9b4a4-641d-4252-80b8-dfeb92c5063f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1601075001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23d5b811-2721-406b-b43e-4baff0c42e2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63aec7de6832484b81e0fe37ee3107c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:50:36Z,use_quota=True,user_id='b89f698b3145436fa0bb3c722dd5e71e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ac10b858-7e69-42cd-a093-f6194f2bd657 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ade3d812-bdac-4cc4-ba92-1725bb66c85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ac10b858-7e69-42cd-a093-f6194f2bd657 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ade3d812-bdac-4cc4-ba92-1725bb66c85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ac10b858-7e69-42cd-a093-f6194f2bd657 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f109102-e91c-48bb-96fc-bc80db80fe7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ac10b858-7e69-42cd-a093-f6194f2bd657 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f109102-e91c-48bb-96fc-bc80db80fe7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23d5b811-2721-406b-b43e-4baff0c42e2d', 'volume_name': 'volume-23d5b811-2721-406b-b43e-4baff0c42e2d', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ac10b858-7e69-42cd-a093-f6194f2bd657 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdc48e3e-5f2a-4558-96f8-0ab06897a3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ac10b858-7e69-42cd-a093-f6194f2bd657 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdc48e3e-5f2a-4558-96f8-0ab06897a3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ac10b858-7e69-42cd-a093-f6194f2bd657 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e27da95c-cf0e-4127-93c0-e096782fac23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:35 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-ac10b858-7e69-42cd-a093-f6194f2bd657 tempest-CreateVolumesFromImageTest-1811867116 None] Volume 23d5b811-2721-406b-b43e-4baff0c42e2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23d5b811-2721-406b-b43e-4baff0c42e2d', 'volume_size': 1} Jul 10 06:50:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ac10b858-7e69-42cd-a093-f6194f2bd657 tempest-CreateVolumesFromImageTest-1811867116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-98bd2ba3-4cac-4711-a75c-6b6d99187bd7 tempest-CreateVolumesFromImageTest-1811867116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d247168b-a0f3-4ea6-980f-917f06393767 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:36 devstack sudo[102247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d247168b-a0f3-4ea6-980f-917f06393767 Jul 10 06:50:36 devstack sudo[102247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:36 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6d9b18f-2f12-4950-a808-f442940b96ae tempest-CreateVolumesFromImageTest-1811867116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:50:36 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b6d9b18f-2f12-4950-a808-f442940b96ae tempest-CreateVolumesFromImageTest-1811867116 None] Flow 'volume_create_manager' (d7425ea0-68cc-4ca7-84ab-647050fa6403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:50:36 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b6d9b18f-2f12-4950-a808-f442940b96ae tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c457b1ff-8992-443a-9347-cf75df3d8c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:36 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b6d9b18f-2f12-4950-a808-f442940b96ae tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c457b1ff-8992-443a-9347-cf75df3d8c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-960146816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50f93b7a-743f-4871-8f4c-a5330bda0917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63aec7de6832484b81e0fe37ee3107c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:50:36Z,use_quota=True,user_id='b89f698b3145436fa0bb3c722dd5e71e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:36 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b6d9b18f-2f12-4950-a808-f442940b96ae tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cbccf11-8e5e-4718-8bad-1d35eec69a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:36 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b6d9b18f-2f12-4950-a808-f442940b96ae tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cbccf11-8e5e-4718-8bad-1d35eec69a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:36 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b6d9b18f-2f12-4950-a808-f442940b96ae tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b91b570-1797-4e68-b321-c1119e71ae5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:36 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b6d9b18f-2f12-4950-a808-f442940b96ae tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b91b570-1797-4e68-b321-c1119e71ae5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50f93b7a-743f-4871-8f4c-a5330bda0917', 'volume_name': 'volume-50f93b7a-743f-4871-8f4c-a5330bda0917', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:36 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b6d9b18f-2f12-4950-a808-f442940b96ae tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c66ec4ca-2f28-46ab-bb11-a1de539cb306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:36 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b6d9b18f-2f12-4950-a808-f442940b96ae tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c66ec4ca-2f28-46ab-bb11-a1de539cb306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:36 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b6d9b18f-2f12-4950-a808-f442940b96ae tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5328e5e-778b-4a3e-9005-9682681de428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:36 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-b6d9b18f-2f12-4950-a808-f442940b96ae tempest-CreateVolumesFromImageTest-1811867116 None] Volume 50f93b7a-743f-4871-8f4c-a5330bda0917: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50f93b7a-743f-4871-8f4c-a5330bda0917', 'volume_size': 1} Jul 10 06:50:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b6d9b18f-2f12-4950-a808-f442940b96ae tempest-CreateVolumesFromImageTest-1811867116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:37 devstack sudo[102247]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-98bd2ba3-4cac-4711-a75c-6b6d99187bd7 tempest-CreateVolumesFromImageTest-1811867116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d247168b-a0f3-4ea6-980f-917f06393767" returned: 0 in 1.083s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:37 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-98bd2ba3-4cac-4711-a75c-6b6d99187bd7 tempest-CreateVolumesFromImageTest-1811867116 None] <== create_volume: return (3055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:50:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-98bd2ba3-4cac-4711-a75c-6b6d99187bd7 tempest-CreateVolumesFromImageTest-1811867116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.058s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9c02a517-ae6e-4ed8-b252-431b49d77eb4 tempest-CreateVolumesFromImageTest-1811867116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.566s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:37 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9c02a517-ae6e-4ed8-b252-431b49d77eb4 tempest-CreateVolumesFromImageTest-1811867116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-745095196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55d6a106-2076-40f7-9a1d-ad97e103c2fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63aec7de6832484b81e0fe37ee3107c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:50:34Z,use_quota=True,user_id='b89f698b3145436fa0bb3c722dd5e71e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:50:37 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-9c02a517-ae6e-4ed8-b252-431b49d77eb4 tempest-CreateVolumesFromImageTest-1811867116 None] Creating volume 55d6a106-2076-40f7-9a1d-ad97e103c2fa {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:50:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9c02a517-ae6e-4ed8-b252-431b49d77eb4 tempest-CreateVolumesFromImageTest-1811867116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9c02a517-ae6e-4ed8-b252-431b49d77eb4 tempest-CreateVolumesFromImageTest-1811867116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:37 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9c02a517-ae6e-4ed8-b252-431b49d77eb4 tempest-CreateVolumesFromImageTest-1811867116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:50:37 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9c02a517-ae6e-4ed8-b252-431b49d77eb4 tempest-CreateVolumesFromImageTest-1811867116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:50:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9c02a517-ae6e-4ed8-b252-431b49d77eb4 tempest-CreateVolumesFromImageTest-1811867116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:37 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9c02a517-ae6e-4ed8-b252-431b49d77eb4 tempest-CreateVolumesFromImageTest-1811867116 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:50:37 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-9c02a517-ae6e-4ed8-b252-431b49d77eb4 tempest-CreateVolumesFromImageTest-1811867116 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:50:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9c02a517-ae6e-4ed8-b252-431b49d77eb4 tempest-CreateVolumesFromImageTest-1811867116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-55d6a106-2076-40f7-9a1d-ad97e103c2fa 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-98bd2ba3-4cac-4711-a75c-6b6d99187bd7 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a60208b3-b92e-4fd0-af82-7e98d708a33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d247168b-a0f3-4ea6-980f-917f06393767', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:37 devstack sudo[102253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-55d6a106-2076-40f7-9a1d-ad97e103c2fa 1073741824 Jul 10 06:50:37 devstack sudo[102253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-98bd2ba3-4cac-4711-a75c-6b6d99187bd7 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b222cf2-510e-4ad6-82b8-914540b87ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:37 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-98bd2ba3-4cac-4711-a75c-6b6d99187bd7 tempest-CreateVolumesFromImageTest-1811867116 None] Volume volume-d247168b-a0f3-4ea6-980f-917f06393767 (d247168b-a0f3-4ea6-980f-917f06393767): created successfully Jul 10 06:50:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-98bd2ba3-4cac-4711-a75c-6b6d99187bd7 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b222cf2-510e-4ad6-82b8-914540b87ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-98bd2ba3-4cac-4711-a75c-6b6d99187bd7 tempest-CreateVolumesFromImageTest-1811867116 None] Flow 'volume_create_manager' (d62ddd54-6085-4ec1-ab0d-394aea036243) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:50:37 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-98bd2ba3-4cac-4711-a75c-6b6d99187bd7 tempest-CreateVolumesFromImageTest-1811867116 None] Created volume successfully. Jul 10 06:50:38 devstack sudo[102253]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9c02a517-ae6e-4ed8-b252-431b49d77eb4 tempest-CreateVolumesFromImageTest-1811867116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-55d6a106-2076-40f7-9a1d-ad97e103c2fa 1073741824" returned: 0 in 1.342s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9c02a517-ae6e-4ed8-b252-431b49d77eb4 tempest-CreateVolumesFromImageTest-1811867116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-55d6a106-2076-40f7-9a1d-ad97e103c2fa {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:38 devstack sudo[102259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-55d6a106-2076-40f7-9a1d-ad97e103c2fa Jul 10 06:50:38 devstack sudo[102259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:39 devstack sudo[102259]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9c02a517-ae6e-4ed8-b252-431b49d77eb4 tempest-CreateVolumesFromImageTest-1811867116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-55d6a106-2076-40f7-9a1d-ad97e103c2fa" returned: 0 in 0.803s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:39 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9c02a517-ae6e-4ed8-b252-431b49d77eb4 tempest-CreateVolumesFromImageTest-1811867116 None] <== create_volume: return (2199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:50:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9c02a517-ae6e-4ed8-b252-431b49d77eb4 tempest-CreateVolumesFromImageTest-1811867116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.201s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-45a79877-a4cb-4cf2-b266-18539875e021 tempest-SnapshotMetadataTestJSON-1965665849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.761s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:39 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-45a79877-a4cb-4cf2-b266-18539875e021 tempest-SnapshotMetadataTestJSON-1965665849 None] Creating offline snapshot 958727e6-8e0c-4358-ac9f-22eeb7ac0b31 of volume e19e2577-751e-4ecf-9d2b-59dd2fd40b4b {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:50:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9c02a517-ae6e-4ed8-b252-431b49d77eb4 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1137471b-5164-4b46-b48a-bd02dff5f13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55d6a106-2076-40f7-9a1d-ad97e103c2fa', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9c02a517-ae6e-4ed8-b252-431b49d77eb4 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b48962f-a42a-465c-af44-5cc0433f8891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:39 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b893286-50f7-4289-be8b-16267c2b9d65]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:50:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-45a79877-a4cb-4cf2-b266-18539875e021 tempest-SnapshotMetadataTestJSON-1965665849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:39 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-9c02a517-ae6e-4ed8-b252-431b49d77eb4 tempest-CreateVolumesFromImageTest-1811867116 None] Volume volume-55d6a106-2076-40f7-9a1d-ad97e103c2fa (55d6a106-2076-40f7-9a1d-ad97e103c2fa): created successfully Jul 10 06:50:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9c02a517-ae6e-4ed8-b252-431b49d77eb4 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b48962f-a42a-465c-af44-5cc0433f8891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9c02a517-ae6e-4ed8-b252-431b49d77eb4 tempest-CreateVolumesFromImageTest-1811867116 None] Flow 'volume_create_manager' (c3bc8de3-f321-4bd3-beed-240cc7b95607) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:50:39 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-9c02a517-ae6e-4ed8-b252-431b49d77eb4 tempest-CreateVolumesFromImageTest-1811867116 None] Created volume successfully. Jul 10 06:50:39 devstack sudo[102263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b Jul 10 06:50:39 devstack sudo[102263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:40 devstack sudo[102263]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-45a79877-a4cb-4cf2-b266-18539875e021 tempest-SnapshotMetadataTestJSON-1965665849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b" returned: 0 in 1.246s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-45a79877-a4cb-4cf2-b266-18539875e021 tempest-SnapshotMetadataTestJSON-1965665849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b.958727e6-8e0c-4358-ac9f-22eeb7ac0b31 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:40 devstack sudo[102269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b.958727e6-8e0c-4358-ac9f-22eeb7ac0b31 1G Jul 10 06:50:40 devstack sudo[102269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:41 devstack sudo[102269]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-45a79877-a4cb-4cf2-b266-18539875e021 tempest-SnapshotMetadataTestJSON-1965665849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b.958727e6-8e0c-4358-ac9f-22eeb7ac0b31 1G" returned: 0 in 1.380s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-45a79877-a4cb-4cf2-b266-18539875e021 tempest-SnapshotMetadataTestJSON-1965665849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b.958727e6-8e0c-4358-ac9f-22eeb7ac0b31 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:42 devstack sudo[102275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b.958727e6-8e0c-4358-ac9f-22eeb7ac0b31 Jul 10 06:50:42 devstack sudo[102275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:42 devstack sudo[102275]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-45a79877-a4cb-4cf2-b266-18539875e021 tempest-SnapshotMetadataTestJSON-1965665849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b.958727e6-8e0c-4358-ac9f-22eeb7ac0b31" returned: 0 in 1.017s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:42 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-45a79877-a4cb-4cf2-b266-18539875e021 tempest-SnapshotMetadataTestJSON-1965665849 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b.958727e6-8e0c-4358-ac9f-22eeb7ac0b31 is being set with open permissions: ugo+rw Jul 10 06:50:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-45a79877-a4cb-4cf2-b266-18539875e021 tempest-SnapshotMetadataTestJSON-1965665849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b.958727e6-8e0c-4358-ac9f-22eeb7ac0b31 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:43 devstack sudo[102282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b.958727e6-8e0c-4358-ac9f-22eeb7ac0b31 Jul 10 06:50:43 devstack sudo[102282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:43 devstack sudo[102282]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-45a79877-a4cb-4cf2-b266-18539875e021 tempest-SnapshotMetadataTestJSON-1965665849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b.958727e6-8e0c-4358-ac9f-22eeb7ac0b31" returned: 0 in 0.843s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-45a79877-a4cb-4cf2-b266-18539875e021 tempest-SnapshotMetadataTestJSON-1965665849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:43 devstack sudo[102286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b.info Jul 10 06:50:43 devstack sudo[102286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:44 devstack sudo[102286]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-45a79877-a4cb-4cf2-b266-18539875e021 tempest-SnapshotMetadataTestJSON-1965665849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b.info" returned: 0 in 0.827s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:44 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-45a79877-a4cb-4cf2-b266-18539875e021 tempest-SnapshotMetadataTestJSON-1965665849 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b.info is being set with open permissions: ugo+rw Jul 10 06:50:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-45a79877-a4cb-4cf2-b266-18539875e021 tempest-SnapshotMetadataTestJSON-1965665849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:44 devstack sudo[102290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b.info Jul 10 06:50:44 devstack sudo[102290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:45 devstack sudo[102290]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-45a79877-a4cb-4cf2-b266-18539875e021 tempest-SnapshotMetadataTestJSON-1965665849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b.info" returned: 0 in 0.845s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-45a79877-a4cb-4cf2-b266-18539875e021 tempest-SnapshotMetadataTestJSON-1965665849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.310s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ff83f0ad-2e1e-497b-afad-466b90b644d6 tempest-CreateVolumesFromImageTest-1811867116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.954s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:45 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-ff83f0ad-2e1e-497b-afad-466b90b644d6 tempest-CreateVolumesFromImageTest-1811867116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1901791759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e010282e-9dda-4ad1-9169-111757876706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63aec7de6832484b81e0fe37ee3107c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:50:35Z,use_quota=True,user_id='b89f698b3145436fa0bb3c722dd5e71e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:50:45 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-ff83f0ad-2e1e-497b-afad-466b90b644d6 tempest-CreateVolumesFromImageTest-1811867116 None] Creating volume e010282e-9dda-4ad1-9169-111757876706 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:50:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ff83f0ad-2e1e-497b-afad-466b90b644d6 tempest-CreateVolumesFromImageTest-1811867116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ff83f0ad-2e1e-497b-afad-466b90b644d6 tempest-CreateVolumesFromImageTest-1811867116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:45 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-ff83f0ad-2e1e-497b-afad-466b90b644d6 tempest-CreateVolumesFromImageTest-1811867116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:50:45 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-ff83f0ad-2e1e-497b-afad-466b90b644d6 tempest-CreateVolumesFromImageTest-1811867116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:50:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ff83f0ad-2e1e-497b-afad-466b90b644d6 tempest-CreateVolumesFromImageTest-1811867116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:45 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-ff83f0ad-2e1e-497b-afad-466b90b644d6 tempest-CreateVolumesFromImageTest-1811867116 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:50:45 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-ff83f0ad-2e1e-497b-afad-466b90b644d6 tempest-CreateVolumesFromImageTest-1811867116 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:50:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ff83f0ad-2e1e-497b-afad-466b90b644d6 tempest-CreateVolumesFromImageTest-1811867116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e010282e-9dda-4ad1-9169-111757876706 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:45 devstack sudo[102293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e010282e-9dda-4ad1-9169-111757876706 1073741824 Jul 10 06:50:45 devstack sudo[102293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:45 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-45a79877-a4cb-4cf2-b266-18539875e021 tempest-SnapshotMetadataTestJSON-1965665849 None] Create snapshot completed successfully Jul 10 06:50:46 devstack sudo[102293]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ff83f0ad-2e1e-497b-afad-466b90b644d6 tempest-CreateVolumesFromImageTest-1811867116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e010282e-9dda-4ad1-9169-111757876706 1073741824" returned: 0 in 0.957s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ff83f0ad-2e1e-497b-afad-466b90b644d6 tempest-CreateVolumesFromImageTest-1811867116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e010282e-9dda-4ad1-9169-111757876706 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:46 devstack sudo[102299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e010282e-9dda-4ad1-9169-111757876706 Jul 10 06:50:46 devstack sudo[102299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:46 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-340adfd2-102e-4190-a024-89ef336f1ae4 tempest-VolumeDependencyTests-238445503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:50:46 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-340adfd2-102e-4190-a024-89ef336f1ae4 tempest-VolumeDependencyTests-238445503 None] Flow 'volume_create_manager' (79142146-0c10-498a-9e07-817332195cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:50:46 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-340adfd2-102e-4190-a024-89ef336f1ae4 tempest-VolumeDependencyTests-238445503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9428f8ac-3607-402f-9e2a-432a607fd24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:46 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-340adfd2-102e-4190-a024-89ef336f1ae4 tempest-VolumeDependencyTests-238445503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9428f8ac-3607-402f-9e2a-432a607fd24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-288944756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c823d1d2-9a66-488b-812a-7ced4039a1fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c97ccd39bb44df9948c2f252b65dfc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:50:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:50:47Z,use_quota=True,user_id='174631bd0995459a92ae2ae6a56978c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:46 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-340adfd2-102e-4190-a024-89ef336f1ae4 tempest-VolumeDependencyTests-238445503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (199c9ed6-276f-4f49-b3ce-66d15e11e3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:46 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-340adfd2-102e-4190-a024-89ef336f1ae4 tempest-VolumeDependencyTests-238445503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (199c9ed6-276f-4f49-b3ce-66d15e11e3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:46 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-340adfd2-102e-4190-a024-89ef336f1ae4 tempest-VolumeDependencyTests-238445503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67e0a634-1dd0-4aec-9b61-e59381c34b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:46 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-340adfd2-102e-4190-a024-89ef336f1ae4 tempest-VolumeDependencyTests-238445503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67e0a634-1dd0-4aec-9b61-e59381c34b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c823d1d2-9a66-488b-812a-7ced4039a1fa', 'volume_name': 'volume-c823d1d2-9a66-488b-812a-7ced4039a1fa', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:46 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-340adfd2-102e-4190-a024-89ef336f1ae4 tempest-VolumeDependencyTests-238445503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd5a9d06-743e-42ad-89c0-7f6f06e40153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:46 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-340adfd2-102e-4190-a024-89ef336f1ae4 tempest-VolumeDependencyTests-238445503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd5a9d06-743e-42ad-89c0-7f6f06e40153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:46 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-340adfd2-102e-4190-a024-89ef336f1ae4 tempest-VolumeDependencyTests-238445503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92925a3d-b24b-4dfc-b881-34252f60e03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:46 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-340adfd2-102e-4190-a024-89ef336f1ae4 tempest-VolumeDependencyTests-238445503 None] Volume c823d1d2-9a66-488b-812a-7ced4039a1fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c823d1d2-9a66-488b-812a-7ced4039a1fa', 'volume_size': 1} Jul 10 06:50:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-340adfd2-102e-4190-a024-89ef336f1ae4 tempest-VolumeDependencyTests-238445503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:47 devstack sudo[102299]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ff83f0ad-2e1e-497b-afad-466b90b644d6 tempest-CreateVolumesFromImageTest-1811867116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e010282e-9dda-4ad1-9169-111757876706" returned: 0 in 0.702s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:47 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-ff83f0ad-2e1e-497b-afad-466b90b644d6 tempest-CreateVolumesFromImageTest-1811867116 None] <== create_volume: return (1707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:50:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ff83f0ad-2e1e-497b-afad-466b90b644d6 tempest-CreateVolumesFromImageTest-1811867116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.711s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ac10b858-7e69-42cd-a093-f6194f2bd657 tempest-CreateVolumesFromImageTest-1811867116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.389s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:47 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-ac10b858-7e69-42cd-a093-f6194f2bd657 tempest-CreateVolumesFromImageTest-1811867116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1601075001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23d5b811-2721-406b-b43e-4baff0c42e2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63aec7de6832484b81e0fe37ee3107c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:50:36Z,use_quota=True,user_id='b89f698b3145436fa0bb3c722dd5e71e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:50:47 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-ac10b858-7e69-42cd-a093-f6194f2bd657 tempest-CreateVolumesFromImageTest-1811867116 None] Creating volume 23d5b811-2721-406b-b43e-4baff0c42e2d {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:50:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ac10b858-7e69-42cd-a093-f6194f2bd657 tempest-CreateVolumesFromImageTest-1811867116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ac10b858-7e69-42cd-a093-f6194f2bd657 tempest-CreateVolumesFromImageTest-1811867116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:47 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-ac10b858-7e69-42cd-a093-f6194f2bd657 tempest-CreateVolumesFromImageTest-1811867116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:50:47 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-ac10b858-7e69-42cd-a093-f6194f2bd657 tempest-CreateVolumesFromImageTest-1811867116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:50:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ac10b858-7e69-42cd-a093-f6194f2bd657 tempest-CreateVolumesFromImageTest-1811867116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:47 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-ac10b858-7e69-42cd-a093-f6194f2bd657 tempest-CreateVolumesFromImageTest-1811867116 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:50:47 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-ac10b858-7e69-42cd-a093-f6194f2bd657 tempest-CreateVolumesFromImageTest-1811867116 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:50:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ac10b858-7e69-42cd-a093-f6194f2bd657 tempest-CreateVolumesFromImageTest-1811867116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-23d5b811-2721-406b-b43e-4baff0c42e2d 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:47 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ff83f0ad-2e1e-497b-afad-466b90b644d6 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07e415c2-f7f3-418f-8951-ce3f0ad351c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e010282e-9dda-4ad1-9169-111757876706', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:47 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ff83f0ad-2e1e-497b-afad-466b90b644d6 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7849ff9e-5da8-4793-bf2e-6f29f2cc15a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:47 devstack sudo[102302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-23d5b811-2721-406b-b43e-4baff0c42e2d 1073741824 Jul 10 06:50:47 devstack sudo[102302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:47 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-ff83f0ad-2e1e-497b-afad-466b90b644d6 tempest-CreateVolumesFromImageTest-1811867116 None] Volume volume-e010282e-9dda-4ad1-9169-111757876706 (e010282e-9dda-4ad1-9169-111757876706): created successfully Jul 10 06:50:47 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ff83f0ad-2e1e-497b-afad-466b90b644d6 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7849ff9e-5da8-4793-bf2e-6f29f2cc15a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:47 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ff83f0ad-2e1e-497b-afad-466b90b644d6 tempest-CreateVolumesFromImageTest-1811867116 None] Flow 'volume_create_manager' (ad440c30-39c5-4a37-94f9-275b825e16d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:50:47 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-ff83f0ad-2e1e-497b-afad-466b90b644d6 tempest-CreateVolumesFromImageTest-1811867116 None] Created volume successfully. Jul 10 06:50:47 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2e7befce-8934-41cc-9a1b-6c4795e45156 tempest-SnapshotMetadataTestJSON-1965665849 None] Acquiring lock "cinder-958727e6-8e0c-4358-ac9f-22eeb7ac0b31-delete_snapshot" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:50:47 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2e7befce-8934-41cc-9a1b-6c4795e45156 tempest-SnapshotMetadataTestJSON-1965665849 None] Lock "cinder-958727e6-8e0c-4358-ac9f-22eeb7ac0b31-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:50:47 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2e7befce-8934-41cc-9a1b-6c4795e45156 tempest-SnapshotMetadataTestJSON-1965665849 None] Acquiring lock "cinder-quobyte-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:50:47 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2e7befce-8934-41cc-9a1b-6c4795e45156 tempest-SnapshotMetadataTestJSON-1965665849 None] Lock "cinder-quobyte-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:50:47 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2e7befce-8934-41cc-9a1b-6c4795e45156 tempest-SnapshotMetadataTestJSON-1965665849 None] Acquiring lock "cinder-quobyte-958727e6-8e0c-4358-ac9f-22eeb7ac0b31" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:50:47 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2e7befce-8934-41cc-9a1b-6c4795e45156 tempest-SnapshotMetadataTestJSON-1965665849 None] Lock "cinder-quobyte-958727e6-8e0c-4358-ac9f-22eeb7ac0b31" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:50:47 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-2e7befce-8934-41cc-9a1b-6c4795e45156 tempest-SnapshotMetadataTestJSON-1965665849 None] Deleting offline snapshot 958727e6-8e0c-4358-ac9f-22eeb7ac0b31 of volume e19e2577-751e-4ecf-9d2b-59dd2fd40b4b {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:50:47 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-2e7befce-8934-41cc-9a1b-6c4795e45156 tempest-SnapshotMetadataTestJSON-1965665849 None] snapshot_file for this snap is: volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b.958727e6-8e0c-4358-ac9f-22eeb7ac0b31 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:50:47 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6dc1f8-349f-4377-ac92-ca9c92e0a5c7]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:50:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2e7befce-8934-41cc-9a1b-6c4795e45156 tempest-SnapshotMetadataTestJSON-1965665849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b.958727e6-8e0c-4358-ac9f-22eeb7ac0b31 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:47 devstack sudo[102304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b.958727e6-8e0c-4358-ac9f-22eeb7ac0b31 Jul 10 06:50:47 devstack sudo[102304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:48 devstack sudo[102302]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ac10b858-7e69-42cd-a093-f6194f2bd657 tempest-CreateVolumesFromImageTest-1811867116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-23d5b811-2721-406b-b43e-4baff0c42e2d 1073741824" returned: 0 in 0.969s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ac10b858-7e69-42cd-a093-f6194f2bd657 tempest-CreateVolumesFromImageTest-1811867116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-23d5b811-2721-406b-b43e-4baff0c42e2d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:48 devstack sudo[102313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-23d5b811-2721-406b-b43e-4baff0c42e2d Jul 10 06:50:48 devstack sudo[102313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:48 devstack sudo[102304]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2e7befce-8934-41cc-9a1b-6c4795e45156 tempest-SnapshotMetadataTestJSON-1965665849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b.958727e6-8e0c-4358-ac9f-22eeb7ac0b31" returned: 0 in 0.823s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:48 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-2e7befce-8934-41cc-9a1b-6c4795e45156 tempest-SnapshotMetadataTestJSON-1965665849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:50:48 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[216a4b89-38cd-41a5-b4dc-cb9825e0d11a]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:50:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2e7befce-8934-41cc-9a1b-6c4795e45156 tempest-SnapshotMetadataTestJSON-1965665849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:48 devstack sudo[102315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b Jul 10 06:50:48 devstack sudo[102315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:49 devstack sudo[102313]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ac10b858-7e69-42cd-a093-f6194f2bd657 tempest-CreateVolumesFromImageTest-1811867116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-23d5b811-2721-406b-b43e-4baff0c42e2d" returned: 0 in 0.687s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:49 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-ac10b858-7e69-42cd-a093-f6194f2bd657 tempest-CreateVolumesFromImageTest-1811867116 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:50:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ac10b858-7e69-42cd-a093-f6194f2bd657 tempest-CreateVolumesFromImageTest-1811867116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.713s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b6d9b18f-2f12-4950-a808-f442940b96ae tempest-CreateVolumesFromImageTest-1811867116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.303s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:49 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b6d9b18f-2f12-4950-a808-f442940b96ae tempest-CreateVolumesFromImageTest-1811867116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-960146816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50f93b7a-743f-4871-8f4c-a5330bda0917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63aec7de6832484b81e0fe37ee3107c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:50:36Z,use_quota=True,user_id='b89f698b3145436fa0bb3c722dd5e71e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:50:49 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-b6d9b18f-2f12-4950-a808-f442940b96ae tempest-CreateVolumesFromImageTest-1811867116 None] Creating volume 50f93b7a-743f-4871-8f4c-a5330bda0917 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:50:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b6d9b18f-2f12-4950-a808-f442940b96ae tempest-CreateVolumesFromImageTest-1811867116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b6d9b18f-2f12-4950-a808-f442940b96ae tempest-CreateVolumesFromImageTest-1811867116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:49 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b6d9b18f-2f12-4950-a808-f442940b96ae tempest-CreateVolumesFromImageTest-1811867116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:50:49 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b6d9b18f-2f12-4950-a808-f442940b96ae tempest-CreateVolumesFromImageTest-1811867116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:50:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b6d9b18f-2f12-4950-a808-f442940b96ae tempest-CreateVolumesFromImageTest-1811867116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:49 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b6d9b18f-2f12-4950-a808-f442940b96ae tempest-CreateVolumesFromImageTest-1811867116 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:50:49 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-b6d9b18f-2f12-4950-a808-f442940b96ae tempest-CreateVolumesFromImageTest-1811867116 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:50:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b6d9b18f-2f12-4950-a808-f442940b96ae tempest-CreateVolumesFromImageTest-1811867116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-50f93b7a-743f-4871-8f4c-a5330bda0917 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:49 devstack sudo[102318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-50f93b7a-743f-4871-8f4c-a5330bda0917 1073741824 Jul 10 06:50:49 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ac10b858-7e69-42cd-a093-f6194f2bd657 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e27da95c-cf0e-4127-93c0-e096782fac23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23d5b811-2721-406b-b43e-4baff0c42e2d', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:49 devstack sudo[102318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:49 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ac10b858-7e69-42cd-a093-f6194f2bd657 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44daca52-e703-483d-a080-98f058ecffa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:49 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-ac10b858-7e69-42cd-a093-f6194f2bd657 tempest-CreateVolumesFromImageTest-1811867116 None] Volume volume-23d5b811-2721-406b-b43e-4baff0c42e2d (23d5b811-2721-406b-b43e-4baff0c42e2d): created successfully Jul 10 06:50:49 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ac10b858-7e69-42cd-a093-f6194f2bd657 tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44daca52-e703-483d-a080-98f058ecffa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:49 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ac10b858-7e69-42cd-a093-f6194f2bd657 tempest-CreateVolumesFromImageTest-1811867116 None] Flow 'volume_create_manager' (69286f69-18d7-4339-9119-6cc9261300ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:50:49 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-ac10b858-7e69-42cd-a093-f6194f2bd657 tempest-CreateVolumesFromImageTest-1811867116 None] Created volume successfully. Jul 10 06:50:49 devstack sudo[102315]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2e7befce-8934-41cc-9a1b-6c4795e45156 tempest-SnapshotMetadataTestJSON-1965665849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b" returned: 0 in 0.816s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2e7befce-8934-41cc-9a1b-6c4795e45156 tempest-SnapshotMetadataTestJSON-1965665849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b.958727e6-8e0c-4358-ac9f-22eeb7ac0b31 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:49 devstack sudo[102323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b.958727e6-8e0c-4358-ac9f-22eeb7ac0b31 Jul 10 06:50:49 devstack sudo[102323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:49 devstack sudo[102318]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b6d9b18f-2f12-4950-a808-f442940b96ae tempest-CreateVolumesFromImageTest-1811867116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-50f93b7a-743f-4871-8f4c-a5330bda0917 1073741824" returned: 0 in 0.910s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b6d9b18f-2f12-4950-a808-f442940b96ae tempest-CreateVolumesFromImageTest-1811867116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-50f93b7a-743f-4871-8f4c-a5330bda0917 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:50 devstack sudo[102334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-50f93b7a-743f-4871-8f4c-a5330bda0917 Jul 10 06:50:50 devstack sudo[102334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:50 devstack sudo[102323]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2e7befce-8934-41cc-9a1b-6c4795e45156 tempest-SnapshotMetadataTestJSON-1965665849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b.958727e6-8e0c-4358-ac9f-22eeb7ac0b31" returned: 0 in 0.786s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2e7befce-8934-41cc-9a1b-6c4795e45156 tempest-SnapshotMetadataTestJSON-1965665849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b.958727e6-8e0c-4358-ac9f-22eeb7ac0b31 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:50 devstack sudo[102336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b.958727e6-8e0c-4358-ac9f-22eeb7ac0b31 Jul 10 06:50:50 devstack sudo[102336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:50 devstack sudo[102334]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b6d9b18f-2f12-4950-a808-f442940b96ae tempest-CreateVolumesFromImageTest-1811867116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-50f93b7a-743f-4871-8f4c-a5330bda0917" returned: 0 in 0.696s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:50 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b6d9b18f-2f12-4950-a808-f442940b96ae tempest-CreateVolumesFromImageTest-1811867116 None] <== create_volume: return (1656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:50:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b6d9b18f-2f12-4950-a808-f442940b96ae tempest-CreateVolumesFromImageTest-1811867116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-340adfd2-102e-4190-a024-89ef336f1ae4 tempest-VolumeDependencyTests-238445503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.897s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:50 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-340adfd2-102e-4190-a024-89ef336f1ae4 tempest-VolumeDependencyTests-238445503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-288944756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c823d1d2-9a66-488b-812a-7ced4039a1fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c97ccd39bb44df9948c2f252b65dfc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:50:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:50:47Z,use_quota=True,user_id='174631bd0995459a92ae2ae6a56978c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:50:50 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-340adfd2-102e-4190-a024-89ef336f1ae4 tempest-VolumeDependencyTests-238445503 None] Creating volume c823d1d2-9a66-488b-812a-7ced4039a1fa {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:50:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-340adfd2-102e-4190-a024-89ef336f1ae4 tempest-VolumeDependencyTests-238445503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-340adfd2-102e-4190-a024-89ef336f1ae4 tempest-VolumeDependencyTests-238445503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:50 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-340adfd2-102e-4190-a024-89ef336f1ae4 tempest-VolumeDependencyTests-238445503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:50:50 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-340adfd2-102e-4190-a024-89ef336f1ae4 tempest-VolumeDependencyTests-238445503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:50:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-340adfd2-102e-4190-a024-89ef336f1ae4 tempest-VolumeDependencyTests-238445503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:50 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-340adfd2-102e-4190-a024-89ef336f1ae4 tempest-VolumeDependencyTests-238445503 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:50:50 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-340adfd2-102e-4190-a024-89ef336f1ae4 tempest-VolumeDependencyTests-238445503 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:50:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-340adfd2-102e-4190-a024-89ef336f1ae4 tempest-VolumeDependencyTests-238445503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:50 devstack sudo[102340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa 1073741824 Jul 10 06:50:50 devstack sudo[102340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:50 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b6d9b18f-2f12-4950-a808-f442940b96ae tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5328e5e-778b-4a3e-9005-9682681de428) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50f93b7a-743f-4871-8f4c-a5330bda0917', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:50 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b6d9b18f-2f12-4950-a808-f442940b96ae tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f4b271b-7e70-473a-8e13-21798865c6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:50 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-b6d9b18f-2f12-4950-a808-f442940b96ae tempest-CreateVolumesFromImageTest-1811867116 None] Volume volume-50f93b7a-743f-4871-8f4c-a5330bda0917 (50f93b7a-743f-4871-8f4c-a5330bda0917): created successfully Jul 10 06:50:50 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b6d9b18f-2f12-4950-a808-f442940b96ae tempest-CreateVolumesFromImageTest-1811867116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f4b271b-7e70-473a-8e13-21798865c6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:50 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b6d9b18f-2f12-4950-a808-f442940b96ae tempest-CreateVolumesFromImageTest-1811867116 None] Flow 'volume_create_manager' (d7425ea0-68cc-4ca7-84ab-647050fa6403) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:50:50 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-b6d9b18f-2f12-4950-a808-f442940b96ae tempest-CreateVolumesFromImageTest-1811867116 None] Created volume successfully. Jul 10 06:50:50 devstack sudo[102336]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2e7befce-8934-41cc-9a1b-6c4795e45156 tempest-SnapshotMetadataTestJSON-1965665849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b.958727e6-8e0c-4358-ac9f-22eeb7ac0b31" returned: 0 in 0.703s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:50 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2e7befce-8934-41cc-9a1b-6c4795e45156 tempest-SnapshotMetadataTestJSON-1965665849 None] Lock "cinder-quobyte-958727e6-8e0c-4358-ac9f-22eeb7ac0b31" released by "_delete_snapshot" :: held 3.294s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:50 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2e7befce-8934-41cc-9a1b-6c4795e45156 tempest-SnapshotMetadataTestJSON-1965665849 None] Lock "cinder-quobyte-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b" released by "delete_snapshot" :: held 3.341s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:50 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-2e7befce-8934-41cc-9a1b-6c4795e45156 tempest-SnapshotMetadataTestJSON-1965665849 None] Created reservations ['3fa83b68-c2d2-4619-a168-cb659dd748e8', 'c4286533-1b2a-4992-a945-e32952ea8ea3', '3bd29afd-d2aa-4201-a6ad-b33b5c9322f1', '8a840e67-987a-4d6b-b084-58af0ccd9df9'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:50:51 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-71eb184a-1f3a-410d-922c-8991c4e29cb2 tempest-CreateVolumesFromImageTest-1811867116 None] Acquiring lock "cinder-50f93b7a-743f-4871-8f4c-a5330bda0917-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:50:51 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-71eb184a-1f3a-410d-922c-8991c4e29cb2 tempest-CreateVolumesFromImageTest-1811867116 None] Lock "cinder-50f93b7a-743f-4871-8f4c-a5330bda0917-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:50:51 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-71eb184a-1f3a-410d-922c-8991c4e29cb2 tempest-CreateVolumesFromImageTest-1811867116 None] Acquiring lock "cinder-quobyte-50f93b7a-743f-4871-8f4c-a5330bda0917" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:50:51 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-2e7befce-8934-41cc-9a1b-6c4795e45156 tempest-SnapshotMetadataTestJSON-1965665849 None] Delete snapshot completed successfully. Jul 10 06:50:51 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2e7befce-8934-41cc-9a1b-6c4795e45156 tempest-SnapshotMetadataTestJSON-1965665849 None] Lock "cinder-958727e6-8e0c-4358-ac9f-22eeb7ac0b31-delete_snapshot" released by "delete_snapshot" :: held 3.609s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:51 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-71eb184a-1f3a-410d-922c-8991c4e29cb2 tempest-CreateVolumesFromImageTest-1811867116 None] Lock "cinder-quobyte-50f93b7a-743f-4871-8f4c-a5330bda0917" acquired by "delete_volume" :: waited 0.031s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:50:51 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[5275b968-0aca-41c1-9233-326dbf942612]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:50:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-71eb184a-1f3a-410d-922c-8991c4e29cb2 tempest-CreateVolumesFromImageTest-1811867116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-50f93b7a-743f-4871-8f4c-a5330bda0917 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:51 devstack sudo[102342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-50f93b7a-743f-4871-8f4c-a5330bda0917 Jul 10 06:50:51 devstack sudo[102342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:51 devstack sudo[102340]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-340adfd2-102e-4190-a024-89ef336f1ae4 tempest-VolumeDependencyTests-238445503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa 1073741824" returned: 0 in 0.998s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-340adfd2-102e-4190-a024-89ef336f1ae4 tempest-VolumeDependencyTests-238445503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:51 devstack sudo[102347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa Jul 10 06:50:51 devstack sudo[102347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:51 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-431f7fe9-25e8-43b7-87ad-5711ecbc6d8e tempest-SnapshotMetadataTestJSON-1965665849 None] Acquiring lock "cinder-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:50:51 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-431f7fe9-25e8-43b7-87ad-5711ecbc6d8e tempest-SnapshotMetadataTestJSON-1965665849 None] Lock "cinder-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:50:51 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-431f7fe9-25e8-43b7-87ad-5711ecbc6d8e tempest-SnapshotMetadataTestJSON-1965665849 None] Acquiring lock "cinder-quobyte-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:50:52 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-431f7fe9-25e8-43b7-87ad-5711ecbc6d8e tempest-SnapshotMetadataTestJSON-1965665849 None] Lock "cinder-quobyte-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b" acquired by "delete_volume" :: waited 0.029s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:50:52 devstack sudo[102342]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-71eb184a-1f3a-410d-922c-8991c4e29cb2 tempest-CreateVolumesFromImageTest-1811867116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-50f93b7a-743f-4871-8f4c-a5330bda0917" returned: 0 in 0.933s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-71eb184a-1f3a-410d-922c-8991c4e29cb2 tempest-CreateVolumesFromImageTest-1811867116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-50f93b7a-743f-4871-8f4c-a5330bda0917 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:52 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b3b765-b877-459b-84ef-1eaf07b9db43]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:50:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-431f7fe9-25e8-43b7-87ad-5711ecbc6d8e tempest-SnapshotMetadataTestJSON-1965665849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:52 devstack sudo[102393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-50f93b7a-743f-4871-8f4c-a5330bda0917 Jul 10 06:50:52 devstack sudo[102393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:52 devstack sudo[102394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b Jul 10 06:50:52 devstack sudo[102394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:52 devstack sudo[102347]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-340adfd2-102e-4190-a024-89ef336f1ae4 tempest-VolumeDependencyTests-238445503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa" returned: 0 in 0.881s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:52 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-340adfd2-102e-4190-a024-89ef336f1ae4 tempest-VolumeDependencyTests-238445503 None] <== create_volume: return (1934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:50:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-340adfd2-102e-4190-a024-89ef336f1ae4 tempest-VolumeDependencyTests-238445503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.938s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:52 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-340adfd2-102e-4190-a024-89ef336f1ae4 tempest-VolumeDependencyTests-238445503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92925a3d-b24b-4dfc-b881-34252f60e03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c823d1d2-9a66-488b-812a-7ced4039a1fa', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:52 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-340adfd2-102e-4190-a024-89ef336f1ae4 tempest-VolumeDependencyTests-238445503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28ec7e22-410d-4ad5-80d8-ef9c1e59f338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:52 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-340adfd2-102e-4190-a024-89ef336f1ae4 tempest-VolumeDependencyTests-238445503 None] Volume volume-c823d1d2-9a66-488b-812a-7ced4039a1fa (c823d1d2-9a66-488b-812a-7ced4039a1fa): created successfully Jul 10 06:50:52 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-340adfd2-102e-4190-a024-89ef336f1ae4 tempest-VolumeDependencyTests-238445503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28ec7e22-410d-4ad5-80d8-ef9c1e59f338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:52 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-340adfd2-102e-4190-a024-89ef336f1ae4 tempest-VolumeDependencyTests-238445503 None] Flow 'volume_create_manager' (79142146-0c10-498a-9e07-817332195cae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:50:52 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-340adfd2-102e-4190-a024-89ef336f1ae4 tempest-VolumeDependencyTests-238445503 None] Created volume successfully. Jul 10 06:50:52 devstack sudo[102393]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-71eb184a-1f3a-410d-922c-8991c4e29cb2 tempest-CreateVolumesFromImageTest-1811867116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-50f93b7a-743f-4871-8f4c-a5330bda0917" returned: 0 in 0.834s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:52 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-71eb184a-1f3a-410d-922c-8991c4e29cb2 tempest-CreateVolumesFromImageTest-1811867116 None] Lock "cinder-quobyte-50f93b7a-743f-4871-8f4c-a5330bda0917" released by "delete_volume" :: held 1.814s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:53 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-71eb184a-1f3a-410d-922c-8991c4e29cb2 tempest-CreateVolumesFromImageTest-1811867116 None] Created reservations ['b2109245-19db-4af3-808c-c3411dfa595b', 'df443946-5561-462f-96b2-bfb231be3065', 'b0a9d400-2e75-47ab-85dc-502c1b999573', '3ecc23d1-6d7f-496e-909b-6200d8de64dc'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:50:53 devstack sudo[102394]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-431f7fe9-25e8-43b7-87ad-5711ecbc6d8e tempest-SnapshotMetadataTestJSON-1965665849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b" returned: 0 in 0.968s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-431f7fe9-25e8-43b7-87ad-5711ecbc6d8e tempest-SnapshotMetadataTestJSON-1965665849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:53 devstack sudo[102455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b Jul 10 06:50:53 devstack sudo[102455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-71eb184a-1f3a-410d-922c-8991c4e29cb2 tempest-CreateVolumesFromImageTest-1811867116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-71eb184a-1f3a-410d-922c-8991c4e29cb2 tempest-CreateVolumesFromImageTest-1811867116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:53 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-71eb184a-1f3a-410d-922c-8991c4e29cb2 tempest-CreateVolumesFromImageTest-1811867116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:50:53 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-71eb184a-1f3a-410d-922c-8991c4e29cb2 tempest-CreateVolumesFromImageTest-1811867116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:50:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-71eb184a-1f3a-410d-922c-8991c4e29cb2 tempest-CreateVolumesFromImageTest-1811867116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-71eb184a-1f3a-410d-922c-8991c4e29cb2 tempest-CreateVolumesFromImageTest-1811867116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:53 devstack sudo[102457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:50:53 devstack sudo[102457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:53 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-9b96c062-94d5-4299-b1b1-bdd2f328a811 tempest-CreateVolumesFromImageTest-1811867116 None] Acquiring lock "cinder-23d5b811-2721-406b-b43e-4baff0c42e2d-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:50:53 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-9b96c062-94d5-4299-b1b1-bdd2f328a811 tempest-CreateVolumesFromImageTest-1811867116 None] Lock "cinder-23d5b811-2721-406b-b43e-4baff0c42e2d-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:50:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-0313cad3-7157-4f52-ab8b-56ba7bbe29ac tempest-VolumeDependencyTests-238445503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-0313cad3-7157-4f52-ab8b-56ba7bbe29ac tempest-VolumeDependencyTests-238445503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:53 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-9b96c062-94d5-4299-b1b1-bdd2f328a811 tempest-CreateVolumesFromImageTest-1811867116 None] Acquiring lock "cinder-quobyte-23d5b811-2721-406b-b43e-4baff0c42e2d" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:50:53 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-0313cad3-7157-4f52-ab8b-56ba7bbe29ac tempest-VolumeDependencyTests-238445503 None] Creating offline snapshot c57d6eb1-c5de-4c1c-9320-3b6b23e15a29 of volume c823d1d2-9a66-488b-812a-7ced4039a1fa {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:50:53 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-9b96c062-94d5-4299-b1b1-bdd2f328a811 tempest-CreateVolumesFromImageTest-1811867116 None] Lock "cinder-quobyte-23d5b811-2721-406b-b43e-4baff0c42e2d" acquired by "delete_volume" :: waited 0.034s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:50:53 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[163f303f-2d60-44a0-936e-6163bec1ea4e]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:50:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0313cad3-7157-4f52-ab8b-56ba7bbe29ac tempest-VolumeDependencyTests-238445503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:53 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5962e71-eb33-4d83-924b-8084f44a5216]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:50:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9b96c062-94d5-4299-b1b1-bdd2f328a811 tempest-CreateVolumesFromImageTest-1811867116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-23d5b811-2721-406b-b43e-4baff0c42e2d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:53 devstack sudo[102459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa Jul 10 06:50:53 devstack sudo[102459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:53 devstack sudo[102460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-23d5b811-2721-406b-b43e-4baff0c42e2d Jul 10 06:50:53 devstack sudo[102460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:54 devstack sudo[102455]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-431f7fe9-25e8-43b7-87ad-5711ecbc6d8e tempest-SnapshotMetadataTestJSON-1965665849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b" returned: 0 in 1.000s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:54 devstack sudo[102457]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-71eb184a-1f3a-410d-922c-8991c4e29cb2 tempest-CreateVolumesFromImageTest-1811867116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.947s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:54 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-71eb184a-1f3a-410d-922c-8991c4e29cb2 tempest-CreateVolumesFromImageTest-1811867116 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:50:54 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-431f7fe9-25e8-43b7-87ad-5711ecbc6d8e tempest-SnapshotMetadataTestJSON-1965665849 None] Lock "cinder-quobyte-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b" released by "delete_volume" :: held 2.083s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:54 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-71eb184a-1f3a-410d-922c-8991c4e29cb2 tempest-CreateVolumesFromImageTest-1811867116 None] Deleted volume successfully. Jul 10 06:50:54 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-71eb184a-1f3a-410d-922c-8991c4e29cb2 tempest-CreateVolumesFromImageTest-1811867116 None] Lock "cinder-50f93b7a-743f-4871-8f4c-a5330bda0917-delete_volume" released by "delete_volume" :: held 3.091s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:54 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-431f7fe9-25e8-43b7-87ad-5711ecbc6d8e tempest-SnapshotMetadataTestJSON-1965665849 None] Created reservations ['66b0d888-5a76-4bdf-9ce5-7b2676534a6a', 'a1bb4548-ded4-43f8-bfe8-f6146a48e3c9', '95831989-a667-4dfb-acd7-2c3e407fff11', '0804b73f-3bf1-4770-8a9b-9227954d3331'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:50:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-431f7fe9-25e8-43b7-87ad-5711ecbc6d8e tempest-SnapshotMetadataTestJSON-1965665849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-431f7fe9-25e8-43b7-87ad-5711ecbc6d8e tempest-SnapshotMetadataTestJSON-1965665849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:54 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-431f7fe9-25e8-43b7-87ad-5711ecbc6d8e tempest-SnapshotMetadataTestJSON-1965665849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:50:54 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-431f7fe9-25e8-43b7-87ad-5711ecbc6d8e tempest-SnapshotMetadataTestJSON-1965665849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:50:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-431f7fe9-25e8-43b7-87ad-5711ecbc6d8e tempest-SnapshotMetadataTestJSON-1965665849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-431f7fe9-25e8-43b7-87ad-5711ecbc6d8e tempest-SnapshotMetadataTestJSON-1965665849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:54 devstack sudo[102466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:50:54 devstack sudo[102466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:54 devstack sudo[102459]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0313cad3-7157-4f52-ab8b-56ba7bbe29ac tempest-VolumeDependencyTests-238445503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa" returned: 0 in 0.795s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0313cad3-7157-4f52-ab8b-56ba7bbe29ac tempest-VolumeDependencyTests-238445503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa.c57d6eb1-c5de-4c1c-9320-3b6b23e15a29 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:54 devstack sudo[102475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa.c57d6eb1-c5de-4c1c-9320-3b6b23e15a29 1G Jul 10 06:50:54 devstack sudo[102475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:54 devstack sudo[102460]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9b96c062-94d5-4299-b1b1-bdd2f328a811 tempest-CreateVolumesFromImageTest-1811867116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-23d5b811-2721-406b-b43e-4baff0c42e2d" returned: 0 in 0.855s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9b96c062-94d5-4299-b1b1-bdd2f328a811 tempest-CreateVolumesFromImageTest-1811867116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-23d5b811-2721-406b-b43e-4baff0c42e2d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:54 devstack sudo[102477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-23d5b811-2721-406b-b43e-4baff0c42e2d Jul 10 06:50:54 devstack sudo[102477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:54 devstack sudo[102466]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-431f7fe9-25e8-43b7-87ad-5711ecbc6d8e tempest-SnapshotMetadataTestJSON-1965665849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.650s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:54 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-431f7fe9-25e8-43b7-87ad-5711ecbc6d8e tempest-SnapshotMetadataTestJSON-1965665849 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:50:54 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-431f7fe9-25e8-43b7-87ad-5711ecbc6d8e tempest-SnapshotMetadataTestJSON-1965665849 None] Deleted volume successfully. Jul 10 06:50:54 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-431f7fe9-25e8-43b7-87ad-5711ecbc6d8e tempest-SnapshotMetadataTestJSON-1965665849 None] Lock "cinder-e19e2577-751e-4ecf-9d2b-59dd2fd40b4b-delete_volume" released by "delete_volume" :: held 3.031s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:55 devstack sudo[102477]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9b96c062-94d5-4299-b1b1-bdd2f328a811 tempest-CreateVolumesFromImageTest-1811867116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-23d5b811-2721-406b-b43e-4baff0c42e2d" returned: 0 in 0.695s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-9b96c062-94d5-4299-b1b1-bdd2f328a811 tempest-CreateVolumesFromImageTest-1811867116 None] Lock "cinder-quobyte-23d5b811-2721-406b-b43e-4baff0c42e2d" released by "delete_volume" :: held 1.617s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:55 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-9b96c062-94d5-4299-b1b1-bdd2f328a811 tempest-CreateVolumesFromImageTest-1811867116 None] Created reservations ['17acc85f-c2c7-4865-aa22-e3a44cd9a338', 'f82927a9-d6c0-4399-a0bc-91ea13ef25f5', '0550d9fd-aed1-4d95-a4d9-85f7991a306a', '00c1344a-4afc-4059-9a33-a4c42faa47a8'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:50:55 devstack sudo[102475]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0313cad3-7157-4f52-ab8b-56ba7bbe29ac tempest-VolumeDependencyTests-238445503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa.c57d6eb1-c5de-4c1c-9320-3b6b23e15a29 1G" returned: 0 in 0.868s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0313cad3-7157-4f52-ab8b-56ba7bbe29ac tempest-VolumeDependencyTests-238445503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c823d1d2-9a66-488b-812a-7ced4039a1fa -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa.c57d6eb1-c5de-4c1c-9320-3b6b23e15a29 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:55 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:UPDATE=118,cinder:SELECT=99,cinder:INSERT=36,cinder:DELETE=5 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:50:55 devstack sudo[102484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c823d1d2-9a66-488b-812a-7ced4039a1fa -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa.c57d6eb1-c5de-4c1c-9320-3b6b23e15a29 Jul 10 06:50:55 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9b96c062-94d5-4299-b1b1-bdd2f328a811 tempest-CreateVolumesFromImageTest-1811867116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9b96c062-94d5-4299-b1b1-bdd2f328a811 tempest-CreateVolumesFromImageTest-1811867116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:55 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9b96c062-94d5-4299-b1b1-bdd2f328a811 tempest-CreateVolumesFromImageTest-1811867116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:50:55 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9b96c062-94d5-4299-b1b1-bdd2f328a811 tempest-CreateVolumesFromImageTest-1811867116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:50:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9b96c062-94d5-4299-b1b1-bdd2f328a811 tempest-CreateVolumesFromImageTest-1811867116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9b96c062-94d5-4299-b1b1-bdd2f328a811 tempest-CreateVolumesFromImageTest-1811867116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:55 devstack sudo[102486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:50:55 devstack sudo[102486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-622a1677-0efa-4e73-8a2c-28aa2f0b65e9 tempest-CreateVolumesFromImageTest-1811867116 None] Acquiring lock "cinder-e010282e-9dda-4ad1-9169-111757876706-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:50:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-622a1677-0efa-4e73-8a2c-28aa2f0b65e9 tempest-CreateVolumesFromImageTest-1811867116 None] Lock "cinder-e010282e-9dda-4ad1-9169-111757876706-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:50:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-622a1677-0efa-4e73-8a2c-28aa2f0b65e9 tempest-CreateVolumesFromImageTest-1811867116 None] Acquiring lock "cinder-quobyte-e010282e-9dda-4ad1-9169-111757876706" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:50:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-622a1677-0efa-4e73-8a2c-28aa2f0b65e9 tempest-CreateVolumesFromImageTest-1811867116 None] Lock "cinder-quobyte-e010282e-9dda-4ad1-9169-111757876706" acquired by "delete_volume" :: waited 0.018s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:50:55 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2287871-57bc-458a-8136-903f1f10557d]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:50:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-622a1677-0efa-4e73-8a2c-28aa2f0b65e9 tempest-CreateVolumesFromImageTest-1811867116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e010282e-9dda-4ad1-9169-111757876706 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:56 devstack sudo[102491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e010282e-9dda-4ad1-9169-111757876706 Jul 10 06:50:56 devstack sudo[102491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:56 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0313cad3-7157-4f52-ab8b-56ba7bbe29ac tempest-VolumeDependencyTests-238445503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c823d1d2-9a66-488b-812a-7ced4039a1fa -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa.c57d6eb1-c5de-4c1c-9320-3b6b23e15a29" returned: 0 in 0.819s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:56 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-0313cad3-7157-4f52-ab8b-56ba7bbe29ac tempest-VolumeDependencyTests-238445503 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa.c57d6eb1-c5de-4c1c-9320-3b6b23e15a29 is being set with open permissions: ugo+rw Jul 10 06:50:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0313cad3-7157-4f52-ab8b-56ba7bbe29ac tempest-VolumeDependencyTests-238445503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa.c57d6eb1-c5de-4c1c-9320-3b6b23e15a29 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:56 devstack sudo[102494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa.c57d6eb1-c5de-4c1c-9320-3b6b23e15a29 Jul 10 06:50:56 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:56 devstack sudo[102486]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9b96c062-94d5-4299-b1b1-bdd2f328a811 tempest-CreateVolumesFromImageTest-1811867116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.799s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:56 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-9b96c062-94d5-4299-b1b1-bdd2f328a811 tempest-CreateVolumesFromImageTest-1811867116 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:50:56 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-9b96c062-94d5-4299-b1b1-bdd2f328a811 tempest-CreateVolumesFromImageTest-1811867116 None] Deleted volume successfully. Jul 10 06:50:56 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-9b96c062-94d5-4299-b1b1-bdd2f328a811 tempest-CreateVolumesFromImageTest-1811867116 None] Lock "cinder-23d5b811-2721-406b-b43e-4baff0c42e2d-delete_volume" released by "delete_volume" :: held 2.737s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:56 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0313cad3-7157-4f52-ab8b-56ba7bbe29ac tempest-VolumeDependencyTests-238445503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa.c57d6eb1-c5de-4c1c-9320-3b6b23e15a29" returned: 0 in 0.791s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:56 devstack sudo[102491]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-622a1677-0efa-4e73-8a2c-28aa2f0b65e9 tempest-CreateVolumesFromImageTest-1811867116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e010282e-9dda-4ad1-9169-111757876706" returned: 0 in 0.969s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-622a1677-0efa-4e73-8a2c-28aa2f0b65e9 tempest-CreateVolumesFromImageTest-1811867116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e010282e-9dda-4ad1-9169-111757876706 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0313cad3-7157-4f52-ab8b-56ba7bbe29ac tempest-VolumeDependencyTests-238445503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:56 devstack sudo[102503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e010282e-9dda-4ad1-9169-111757876706 Jul 10 06:50:56 devstack sudo[102503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:57 devstack sudo[102505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa.info Jul 10 06:50:57 devstack sudo[102505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:57 devstack sudo[102503]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-622a1677-0efa-4e73-8a2c-28aa2f0b65e9 tempest-CreateVolumesFromImageTest-1811867116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e010282e-9dda-4ad1-9169-111757876706" returned: 0 in 0.659s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:57 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-622a1677-0efa-4e73-8a2c-28aa2f0b65e9 tempest-CreateVolumesFromImageTest-1811867116 None] Lock "cinder-quobyte-e010282e-9dda-4ad1-9169-111757876706" released by "delete_volume" :: held 1.682s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:57 devstack sudo[102505]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0313cad3-7157-4f52-ab8b-56ba7bbe29ac tempest-VolumeDependencyTests-238445503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa.info" returned: 0 in 0.688s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:57 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-0313cad3-7157-4f52-ab8b-56ba7bbe29ac tempest-VolumeDependencyTests-238445503 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa.info is being set with open permissions: ugo+rw Jul 10 06:50:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0313cad3-7157-4f52-ab8b-56ba7bbe29ac tempest-VolumeDependencyTests-238445503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:57 devstack sudo[102509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa.info Jul 10 06:50:57 devstack sudo[102509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:57 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-622a1677-0efa-4e73-8a2c-28aa2f0b65e9 tempest-CreateVolumesFromImageTest-1811867116 None] Created reservations ['ba8f5be0-f839-4fae-b85f-5721cc62a979', '1a9d2265-3ef9-4d1a-b389-93b5c76b30db', '14e8f6a4-5373-43fc-9898-aa70979129e2', '59b66565-0cb0-440c-8000-ff3ab34efd4a'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:50:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-622a1677-0efa-4e73-8a2c-28aa2f0b65e9 tempest-CreateVolumesFromImageTest-1811867116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-622a1677-0efa-4e73-8a2c-28aa2f0b65e9 tempest-CreateVolumesFromImageTest-1811867116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:57 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-622a1677-0efa-4e73-8a2c-28aa2f0b65e9 tempest-CreateVolumesFromImageTest-1811867116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:50:57 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-622a1677-0efa-4e73-8a2c-28aa2f0b65e9 tempest-CreateVolumesFromImageTest-1811867116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:50:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-622a1677-0efa-4e73-8a2c-28aa2f0b65e9 tempest-CreateVolumesFromImageTest-1811867116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-622a1677-0efa-4e73-8a2c-28aa2f0b65e9 tempest-CreateVolumesFromImageTest-1811867116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:57 devstack sudo[102511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:50:57 devstack sudo[102511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:58 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c964e571-01f7-4534-8712-22f55b48d76b tempest-CreateVolumesFromImageTest-1811867116 None] Acquiring lock "cinder-55d6a106-2076-40f7-9a1d-ad97e103c2fa-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:50:58 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c964e571-01f7-4534-8712-22f55b48d76b tempest-CreateVolumesFromImageTest-1811867116 None] Lock "cinder-55d6a106-2076-40f7-9a1d-ad97e103c2fa-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:50:58 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c964e571-01f7-4534-8712-22f55b48d76b tempest-CreateVolumesFromImageTest-1811867116 None] Acquiring lock "cinder-quobyte-55d6a106-2076-40f7-9a1d-ad97e103c2fa" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:50:58 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c964e571-01f7-4534-8712-22f55b48d76b tempest-CreateVolumesFromImageTest-1811867116 None] Lock "cinder-quobyte-55d6a106-2076-40f7-9a1d-ad97e103c2fa" acquired by "delete_volume" :: waited 0.035s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:50:58 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[216a19f3-e1be-4cc3-a257-da4876be13fd]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:50:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c964e571-01f7-4534-8712-22f55b48d76b tempest-CreateVolumesFromImageTest-1811867116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-55d6a106-2076-40f7-9a1d-ad97e103c2fa {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:58 devstack sudo[102509]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0313cad3-7157-4f52-ab8b-56ba7bbe29ac tempest-VolumeDependencyTests-238445503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa.info" returned: 0 in 0.707s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:58 devstack sudo[102513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-55d6a106-2076-40f7-9a1d-ad97e103c2fa Jul 10 06:50:58 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-0313cad3-7157-4f52-ab8b-56ba7bbe29ac tempest-VolumeDependencyTests-238445503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.831s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:58 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-0313cad3-7157-4f52-ab8b-56ba7bbe29ac tempest-VolumeDependencyTests-238445503 None] Create snapshot completed successfully Jul 10 06:50:58 devstack sudo[102511]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-622a1677-0efa-4e73-8a2c-28aa2f0b65e9 tempest-CreateVolumesFromImageTest-1811867116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.771s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:58 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-622a1677-0efa-4e73-8a2c-28aa2f0b65e9 tempest-CreateVolumesFromImageTest-1811867116 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:50:58 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-622a1677-0efa-4e73-8a2c-28aa2f0b65e9 tempest-CreateVolumesFromImageTest-1811867116 None] Deleted volume successfully. Jul 10 06:50:58 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-622a1677-0efa-4e73-8a2c-28aa2f0b65e9 tempest-CreateVolumesFromImageTest-1811867116 None] Lock "cinder-e010282e-9dda-4ad1-9169-111757876706-delete_volume" released by "delete_volume" :: held 2.747s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:59 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c964e571-01f7-4534-8712-22f55b48d76b tempest-CreateVolumesFromImageTest-1811867116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-55d6a106-2076-40f7-9a1d-ad97e103c2fa" returned: 0 in 0.858s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c964e571-01f7-4534-8712-22f55b48d76b tempest-CreateVolumesFromImageTest-1811867116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-55d6a106-2076-40f7-9a1d-ad97e103c2fa {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:59 devstack sudo[102521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-55d6a106-2076-40f7-9a1d-ad97e103c2fa Jul 10 06:50:59 devstack sudo[102521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:59 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:50:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Flow 'volume_create_manager' (fa24ea21-b09b-4229-b254-709c25c873a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:50:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e84777bb-ccca-481b-9297-e9a789d0a5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e84777bb-ccca-481b-9297-e9a789d0a5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:50:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1003986928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c787a2a1-10ec-4fb7-83a9-27da97ec36ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c97ccd39bb44df9948c2f252b65dfc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:50:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c57d6eb1-c5de-4c1c-9320-3b6b23e15a29,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:50:59Z,use_quota=True,user_id='174631bd0995459a92ae2ae6a56978c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (244265d9-7f00-4a55-b548-08cbe4fff6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (244265d9-7f00-4a55-b548-08cbe4fff6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47dbeb6d-0d54-4dc3-87a0-bd846871aa5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47dbeb6d-0d54-4dc3-87a0-bd846871aa5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c787a2a1-10ec-4fb7-83a9-27da97ec36ef', 'volume_name': 'volume-c787a2a1-10ec-4fb7-83a9-27da97ec36ef', 'volume_size': 1, 'snapshot_id': 'c57d6eb1-c5de-4c1c-9320-3b6b23e15a29'}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88631e13-1ac5-46ff-81fa-f316d66fc150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88631e13-1ac5-46ff-81fa-f316d66fc150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:50:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f64a8efd-8fe1-4a00-b982-29fd05079377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:50:59 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Volume c787a2a1-10ec-4fb7-83a9-27da97ec36ef: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c787a2a1-10ec-4fb7-83a9-27da97ec36ef', 'volume_size': 1, 'snapshot_id': 'c57d6eb1-c5de-4c1c-9320-3b6b23e15a29'} Jul 10 06:50:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:59 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Acquiring lock "cinder-quobyte-c57d6eb1-c5de-4c1c-9320-3b6b23e15a29-c787a2a1-10ec-4fb7-83a9-27da97ec36ef" by "_create_volume_from_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:50:59 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Lock "cinder-quobyte-c57d6eb1-c5de-4c1c-9320-3b6b23e15a29-c787a2a1-10ec-4fb7-83a9-27da97ec36ef" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:50:59 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Creating volume c787a2a1-10ec-4fb7-83a9-27da97ec36ef from snapshot c57d6eb1-c5de-4c1c-9320-3b6b23e15a29 {{(pid=87294) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 06:50:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:59 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:50:59 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:50:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:59 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:50:59 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Acquiring lock "cinder-quobyte-c787a2a1-10ec-4fb7-83a9-27da97ec36ef" by "_copy_volume_from_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:50:59 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Lock "cinder-quobyte-c787a2a1-10ec-4fb7-83a9-27da97ec36ef" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:50:59 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] snapshot: c57d6eb1-c5de-4c1c-9320-3b6b23e15a29, volume: c787a2a1-10ec-4fb7-83a9-27da97ec36ef, {{(pid=87294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 06:50:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:59 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:50:59 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:50:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:59 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be476a7-aef7-4581-ae11-fb35ae2031c0]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:50:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa.c57d6eb1-c5de-4c1c-9320-3b6b23e15a29 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:50:59 devstack sudo[102523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa.c57d6eb1-c5de-4c1c-9320-3b6b23e15a29 Jul 10 06:50:59 devstack sudo[102523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:50:59 devstack sudo[102521]: pam_unix(sudo:session): session closed for user root Jul 10 06:50:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c964e571-01f7-4534-8712-22f55b48d76b tempest-CreateVolumesFromImageTest-1811867116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-55d6a106-2076-40f7-9a1d-ad97e103c2fa" returned: 0 in 0.747s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:50:59 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c964e571-01f7-4534-8712-22f55b48d76b tempest-CreateVolumesFromImageTest-1811867116 None] Lock "cinder-quobyte-55d6a106-2076-40f7-9a1d-ad97e103c2fa" released by "delete_volume" :: held 1.653s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:50:59 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:UPDATE=117,cinder:INSERT=28,cinder:DELETE=11,cinder:SELECT=108 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:50:59 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-c964e571-01f7-4534-8712-22f55b48d76b tempest-CreateVolumesFromImageTest-1811867116 None] Created reservations ['a21c80b2-e6a0-462d-afcc-894185c51928', '78c052a8-58d2-4ac6-86e1-9faee0a217dd', '9b2483d7-4c8e-40de-9b38-a4f10ff00fd2', '2c06b577-be59-4f62-88b5-6fc45cc473cc'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:50:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c964e571-01f7-4534-8712-22f55b48d76b tempest-CreateVolumesFromImageTest-1811867116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:50:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c964e571-01f7-4534-8712-22f55b48d76b tempest-CreateVolumesFromImageTest-1811867116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:50:59 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-c964e571-01f7-4534-8712-22f55b48d76b tempest-CreateVolumesFromImageTest-1811867116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:50:59 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-c964e571-01f7-4534-8712-22f55b48d76b tempest-CreateVolumesFromImageTest-1811867116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:50:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c964e571-01f7-4534-8712-22f55b48d76b tempest-CreateVolumesFromImageTest-1811867116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:50:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c964e571-01f7-4534-8712-22f55b48d76b tempest-CreateVolumesFromImageTest-1811867116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:00 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:51:00 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:00 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-0eab3958-db7b-4cf0-b52a-bc752aa726ad tempest-CreateVolumesFromImageTest-1811867116 None] Acquiring lock "cinder-d247168b-a0f3-4ea6-980f-917f06393767-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:00 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-0eab3958-db7b-4cf0-b52a-bc752aa726ad tempest-CreateVolumesFromImageTest-1811867116 None] Lock "cinder-d247168b-a0f3-4ea6-980f-917f06393767-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:00 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d542d88-3464-4adc-920d-448109c99804 tempest-VolumesTransfersV355Test-1673787352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:51:00 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9d542d88-3464-4adc-920d-448109c99804 tempest-VolumesTransfersV355Test-1673787352 None] Flow 'volume_create_manager' (adfbe251-f64e-46c8-b13f-05108a4e35c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:51:00 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9d542d88-3464-4adc-920d-448109c99804 tempest-VolumesTransfersV355Test-1673787352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5be441df-26f1-4699-ba51-390711f5ef5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:00 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9d542d88-3464-4adc-920d-448109c99804 tempest-VolumesTransfersV355Test-1673787352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5be441df-26f1-4699-ba51-390711f5ef5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1544700247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=594bc940-f116-4d6c-ab67-5df6a1ba35ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78557e3d1ade41e78d9c534b4515f7bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:51:00Z,use_quota=True,user_id='2021a96149144e9b87ee357c3c5a2d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:00 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9d542d88-3464-4adc-920d-448109c99804 tempest-VolumesTransfersV355Test-1673787352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16722d3c-5aec-4ec4-af73-0bf83bda4a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:00 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9d542d88-3464-4adc-920d-448109c99804 tempest-VolumesTransfersV355Test-1673787352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16722d3c-5aec-4ec4-af73-0bf83bda4a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:00 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9d542d88-3464-4adc-920d-448109c99804 tempest-VolumesTransfersV355Test-1673787352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10ec55b1-53f8-497e-9df5-bb0d64344a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:00 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9d542d88-3464-4adc-920d-448109c99804 tempest-VolumesTransfersV355Test-1673787352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10ec55b1-53f8-497e-9df5-bb0d64344a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '594bc940-f116-4d6c-ab67-5df6a1ba35ea', 'volume_name': 'volume-594bc940-f116-4d6c-ab67-5df6a1ba35ea', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:00 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9d542d88-3464-4adc-920d-448109c99804 tempest-VolumesTransfersV355Test-1673787352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbf00cc3-24ce-4443-aece-3f2c080ec9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:00 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9d542d88-3464-4adc-920d-448109c99804 tempest-VolumesTransfersV355Test-1673787352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbf00cc3-24ce-4443-aece-3f2c080ec9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:00 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9d542d88-3464-4adc-920d-448109c99804 tempest-VolumesTransfersV355Test-1673787352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbf61562-ce75-4cb7-9d3f-308c5d2e90f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:00 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-9d542d88-3464-4adc-920d-448109c99804 tempest-VolumesTransfersV355Test-1673787352 None] Volume 594bc940-f116-4d6c-ab67-5df6a1ba35ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-594bc940-f116-4d6c-ab67-5df6a1ba35ea', 'volume_size': 1} Jul 10 06:51:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9d542d88-3464-4adc-920d-448109c99804 tempest-VolumesTransfersV355Test-1673787352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:00 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-0eab3958-db7b-4cf0-b52a-bc752aa726ad tempest-CreateVolumesFromImageTest-1811867116 None] Acquiring lock "cinder-quobyte-d247168b-a0f3-4ea6-980f-917f06393767" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:00 devstack sudo[102523]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:00 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-0eab3958-db7b-4cf0-b52a-bc752aa726ad tempest-CreateVolumesFromImageTest-1811867116 None] Lock "cinder-quobyte-d247168b-a0f3-4ea6-980f-917f06393767" acquired by "delete_volume" :: waited 0.015s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa.c57d6eb1-c5de-4c1c-9320-3b6b23e15a29" returned: 0 in 0.972s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:00 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c823d1d2-9a66-488b-812a-7ced4039a1fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:51:00 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa {{(pid=87294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 06:51:00 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Creating direct copy from snapshot {{(pid=87294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 06:51:00 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[030278ea-93dc-4de4-82c5-03d804b2dcbc]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:51:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0eab3958-db7b-4cf0-b52a-bc752aa726ad tempest-CreateVolumesFromImageTest-1811867116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d247168b-a0f3-4ea6-980f-917f06393767 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:00 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a8826f-de07-46e1-81e2-d063c034a531]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:51:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:00 devstack sudo[102533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d247168b-a0f3-4ea6-980f-917f06393767 Jul 10 06:51:00 devstack sudo[102533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:00 devstack sudo[102534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa Jul 10 06:51:00 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:00 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c964e571-01f7-4534-8712-22f55b48d76b tempest-CreateVolumesFromImageTest-1811867116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.874s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:00 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-c964e571-01f7-4534-8712-22f55b48d76b tempest-CreateVolumesFromImageTest-1811867116 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:51:00 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-c964e571-01f7-4534-8712-22f55b48d76b tempest-CreateVolumesFromImageTest-1811867116 None] Deleted volume successfully. Jul 10 06:51:00 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c964e571-01f7-4534-8712-22f55b48d76b tempest-CreateVolumesFromImageTest-1811867116 None] Lock "cinder-55d6a106-2076-40f7-9a1d-ad97e103c2fa-delete_volume" released by "delete_volume" :: held 2.776s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:51:01 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa" returned: 0 in 0.881s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:01 devstack cinder-volume[87294]: DEBUG cinder.utils [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Path /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c787a2a1-10ec-4fb7-83a9-27da97ec36ef not found in is_blk_device check {{(pid=87294) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 06:51:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c787a2a1-10ec-4fb7-83a9-27da97ec36ef {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:01 devstack sudo[102533]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0eab3958-db7b-4cf0-b52a-bc752aa726ad tempest-CreateVolumesFromImageTest-1811867116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d247168b-a0f3-4ea6-980f-917f06393767" returned: 0 in 0.911s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0eab3958-db7b-4cf0-b52a-bc752aa726ad tempest-CreateVolumesFromImageTest-1811867116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d247168b-a0f3-4ea6-980f-917f06393767 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:01 devstack sudo[102544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c787a2a1-10ec-4fb7-83a9-27da97ec36ef Jul 10 06:51:01 devstack sudo[102544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:01 devstack sudo[102545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d247168b-a0f3-4ea6-980f-917f06393767 Jul 10 06:51:01 devstack sudo[102545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:02 devstack sudo[102545]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0eab3958-db7b-4cf0-b52a-bc752aa726ad tempest-CreateVolumesFromImageTest-1811867116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d247168b-a0f3-4ea6-980f-917f06393767" returned: 0 in 0.687s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:02 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-0eab3958-db7b-4cf0-b52a-bc752aa726ad tempest-CreateVolumesFromImageTest-1811867116 None] Lock "cinder-quobyte-d247168b-a0f3-4ea6-980f-917f06393767" released by "delete_volume" :: held 1.646s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:51:02 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-0eab3958-db7b-4cf0-b52a-bc752aa726ad tempest-CreateVolumesFromImageTest-1811867116 None] Created reservations ['1e25348f-c511-41bc-a964-91233a25336c', '917a117b-7dbd-4bca-afe7-ba9ac814d2a5', 'f5494b6c-b923-4e0a-b086-94dad15df25c', 'ab7d7f5a-0f63-41a1-8259-d32bd0c0722b'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:51:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-0eab3958-db7b-4cf0-b52a-bc752aa726ad tempest-CreateVolumesFromImageTest-1811867116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-0eab3958-db7b-4cf0-b52a-bc752aa726ad tempest-CreateVolumesFromImageTest-1811867116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:02 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-0eab3958-db7b-4cf0-b52a-bc752aa726ad tempest-CreateVolumesFromImageTest-1811867116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:51:02 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-0eab3958-db7b-4cf0-b52a-bc752aa726ad tempest-CreateVolumesFromImageTest-1811867116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:51:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-0eab3958-db7b-4cf0-b52a-bc752aa726ad tempest-CreateVolumesFromImageTest-1811867116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0eab3958-db7b-4cf0-b52a-bc752aa726ad tempest-CreateVolumesFromImageTest-1811867116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:02 devstack sudo[102559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:51:02 devstack sudo[102559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:04 devstack sudo[102559]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0eab3958-db7b-4cf0-b52a-bc752aa726ad tempest-CreateVolumesFromImageTest-1811867116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 2.038s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:04 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-0eab3958-db7b-4cf0-b52a-bc752aa726ad tempest-CreateVolumesFromImageTest-1811867116 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:51:04 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-0eab3958-db7b-4cf0-b52a-bc752aa726ad tempest-CreateVolumesFromImageTest-1811867116 None] Deleted volume successfully. Jul 10 06:51:04 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-0eab3958-db7b-4cf0-b52a-bc752aa726ad tempest-CreateVolumesFromImageTest-1811867116 None] Lock "cinder-d247168b-a0f3-4ea6-980f-917f06393767-delete_volume" released by "delete_volume" :: held 4.136s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:51:07 devstack sudo[102544]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c787a2a1-10ec-4fb7-83a9-27da97ec36ef" returned: 0 in 6.053s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:07 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2a097a-d0cb-456b-bfed-bc5ee1cd926b]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:51:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:07 devstack sudo[102570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa Jul 10 06:51:07 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:08 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa" returned: 0 in 0.964s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:08 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa, size 1024.00 MB, duration 6.05 sec, destination /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c787a2a1-10ec-4fb7-83a9-27da97ec36ef {{(pid=87294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 06:51:08 devstack cinder-volume[87294]: INFO cinder.image.image_utils [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Converted 1024.00 MB image at 169.14 MB/s Jul 10 06:51:08 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c787a2a1-10ec-4fb7-83a9-27da97ec36ef is being set with open permissions: ugo+rw Jul 10 06:51:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c787a2a1-10ec-4fb7-83a9-27da97ec36ef {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:08 devstack sudo[102580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c787a2a1-10ec-4fb7-83a9-27da97ec36ef Jul 10 06:51:08 devstack sudo[102580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:09 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c79cf63-6988-48d0-a5a9-00826838f7f4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:51:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5c79cf63-6988-48d0-a5a9-00826838f7f4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Flow 'volume_create_manager' (4fe82a0a-341c-4b45-afd7-32f7f9074b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:51:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5c79cf63-6988-48d0-a5a9-00826838f7f4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baf3da1c-47a9-458b-96a3-81e80c309d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5c79cf63-6988-48d0-a5a9-00826838f7f4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baf3da1c-47a9-458b-96a3-81e80c309d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-703404407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa59d3cd-2996-49c3-9659-3cf574313f49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d175e49cbb446c19d15cdb84b59e4d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:51:09Z,use_quota=True,user_id='562a6d2faf0348ca8423d399f6a33457',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5c79cf63-6988-48d0-a5a9-00826838f7f4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44286f01-2fb9-4046-a276-0a4ec3468ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5c79cf63-6988-48d0-a5a9-00826838f7f4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44286f01-2fb9-4046-a276-0a4ec3468ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5c79cf63-6988-48d0-a5a9-00826838f7f4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (725a3bd1-443c-4e33-9887-60c9b6f30ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5c79cf63-6988-48d0-a5a9-00826838f7f4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (725a3bd1-443c-4e33-9887-60c9b6f30ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa59d3cd-2996-49c3-9659-3cf574313f49', 'volume_name': 'volume-fa59d3cd-2996-49c3-9659-3cf574313f49', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5c79cf63-6988-48d0-a5a9-00826838f7f4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de088772-6e54-47d7-aee0-29eceba93ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5c79cf63-6988-48d0-a5a9-00826838f7f4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de088772-6e54-47d7-aee0-29eceba93ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5c79cf63-6988-48d0-a5a9-00826838f7f4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26eccd4f-f73b-4f5b-ae74-40441980a60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:09 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-5c79cf63-6988-48d0-a5a9-00826838f7f4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Volume fa59d3cd-2996-49c3-9659-3cf574313f49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa59d3cd-2996-49c3-9659-3cf574313f49', 'volume_size': 1} Jul 10 06:51:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5c79cf63-6988-48d0-a5a9-00826838f7f4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:09 devstack sudo[102580]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c787a2a1-10ec-4fb7-83a9-27da97ec36ef" returned: 0 in 0.663s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:09 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Lock "cinder-quobyte-c787a2a1-10ec-4fb7-83a9-27da97ec36ef" released by "_copy_volume_from_snapshot" :: held 9.654s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:51:09 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Lock "cinder-quobyte-c57d6eb1-c5de-4c1c-9320-3b6b23e15a29-c787a2a1-10ec-4fb7-83a9-27da97ec36ef" released by "_create_volume_from_snapshot" :: held 9.689s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:51:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.705s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9d542d88-3464-4adc-920d-448109c99804 tempest-VolumesTransfersV355Test-1673787352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.669s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:09 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9d542d88-3464-4adc-920d-448109c99804 tempest-VolumesTransfersV355Test-1673787352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1544700247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=594bc940-f116-4d6c-ab67-5df6a1ba35ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78557e3d1ade41e78d9c534b4515f7bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:51:00Z,use_quota=True,user_id='2021a96149144e9b87ee357c3c5a2d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:51:09 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-9d542d88-3464-4adc-920d-448109c99804 tempest-VolumesTransfersV355Test-1673787352 None] Creating volume 594bc940-f116-4d6c-ab67-5df6a1ba35ea {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:51:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9d542d88-3464-4adc-920d-448109c99804 tempest-VolumesTransfersV355Test-1673787352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9d542d88-3464-4adc-920d-448109c99804 tempest-VolumesTransfersV355Test-1673787352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:09 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9d542d88-3464-4adc-920d-448109c99804 tempest-VolumesTransfersV355Test-1673787352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:51:09 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9d542d88-3464-4adc-920d-448109c99804 tempest-VolumesTransfersV355Test-1673787352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:51:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9d542d88-3464-4adc-920d-448109c99804 tempest-VolumesTransfersV355Test-1673787352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:09 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9d542d88-3464-4adc-920d-448109c99804 tempest-VolumesTransfersV355Test-1673787352 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:51:09 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-9d542d88-3464-4adc-920d-448109c99804 tempest-VolumesTransfersV355Test-1673787352 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:51:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9d542d88-3464-4adc-920d-448109c99804 tempest-VolumesTransfersV355Test-1673787352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-594bc940-f116-4d6c-ab67-5df6a1ba35ea 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:09 devstack sudo[102583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-594bc940-f116-4d6c-ab67-5df6a1ba35ea 1073741824 Jul 10 06:51:09 devstack sudo[102583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f64a8efd-8fe1-4a00-b982-29fd05079377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c787a2a1-10ec-4fb7-83a9-27da97ec36ef', 'volume_size': 1, 'snapshot_id': 'c57d6eb1-c5de-4c1c-9320-3b6b23e15a29'}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30ffc043-52f6-4b77-8fb1-89db7d82aa29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:09 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Volume volume-c787a2a1-10ec-4fb7-83a9-27da97ec36ef (c787a2a1-10ec-4fb7-83a9-27da97ec36ef): created successfully Jul 10 06:51:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30ffc043-52f6-4b77-8fb1-89db7d82aa29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Flow 'volume_create_manager' (fa24ea21-b09b-4229-b254-709c25c873a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:51:09 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-5fbb0afa-8933-4895-8595-c594ade92347 tempest-VolumeDependencyTests-238445503 None] Created volume successfully. Jul 10 06:51:10 devstack sudo[102583]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9d542d88-3464-4adc-920d-448109c99804 tempest-VolumesTransfersV355Test-1673787352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-594bc940-f116-4d6c-ab67-5df6a1ba35ea 1073741824" returned: 0 in 0.892s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9d542d88-3464-4adc-920d-448109c99804 tempest-VolumesTransfersV355Test-1673787352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-594bc940-f116-4d6c-ab67-5df6a1ba35ea {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:10 devstack sudo[102590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-594bc940-f116-4d6c-ab67-5df6a1ba35ea Jul 10 06:51:10 devstack sudo[102590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:10 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-0a531cd6-7847-4de2-a0bb-f00e14125e71 tempest-VolumeDependencyTests-238445503 None] Acquiring lock "cinder-c57d6eb1-c5de-4c1c-9320-3b6b23e15a29-delete_snapshot" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:10 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-0a531cd6-7847-4de2-a0bb-f00e14125e71 tempest-VolumeDependencyTests-238445503 None] Lock "cinder-c57d6eb1-c5de-4c1c-9320-3b6b23e15a29-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:10 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-0a531cd6-7847-4de2-a0bb-f00e14125e71 tempest-VolumeDependencyTests-238445503 None] Acquiring lock "cinder-quobyte-c823d1d2-9a66-488b-812a-7ced4039a1fa" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:10 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-0a531cd6-7847-4de2-a0bb-f00e14125e71 tempest-VolumeDependencyTests-238445503 None] Lock "cinder-quobyte-c823d1d2-9a66-488b-812a-7ced4039a1fa" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:10 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-0a531cd6-7847-4de2-a0bb-f00e14125e71 tempest-VolumeDependencyTests-238445503 None] Acquiring lock "cinder-quobyte-c57d6eb1-c5de-4c1c-9320-3b6b23e15a29" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:10 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-0a531cd6-7847-4de2-a0bb-f00e14125e71 tempest-VolumeDependencyTests-238445503 None] Lock "cinder-quobyte-c57d6eb1-c5de-4c1c-9320-3b6b23e15a29" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:10 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-0a531cd6-7847-4de2-a0bb-f00e14125e71 tempest-VolumeDependencyTests-238445503 None] Deleting offline snapshot c57d6eb1-c5de-4c1c-9320-3b6b23e15a29 of volume c823d1d2-9a66-488b-812a-7ced4039a1fa {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:51:10 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-0a531cd6-7847-4de2-a0bb-f00e14125e71 tempest-VolumeDependencyTests-238445503 None] snapshot_file for this snap is: volume-c823d1d2-9a66-488b-812a-7ced4039a1fa.c57d6eb1-c5de-4c1c-9320-3b6b23e15a29 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:51:10 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[69049e4c-b4e4-4185-9786-2585c7d23a0f]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:51:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0a531cd6-7847-4de2-a0bb-f00e14125e71 tempest-VolumeDependencyTests-238445503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa.c57d6eb1-c5de-4c1c-9320-3b6b23e15a29 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:10 devstack sudo[102592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa.c57d6eb1-c5de-4c1c-9320-3b6b23e15a29 Jul 10 06:51:10 devstack sudo[102592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:10 devstack sudo[102590]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9d542d88-3464-4adc-920d-448109c99804 tempest-VolumesTransfersV355Test-1673787352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-594bc940-f116-4d6c-ab67-5df6a1ba35ea" returned: 0 in 0.675s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:10 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9d542d88-3464-4adc-920d-448109c99804 tempest-VolumesTransfersV355Test-1673787352 None] <== create_volume: return (1606ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:51:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9d542d88-3464-4adc-920d-448109c99804 tempest-VolumesTransfersV355Test-1673787352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5c79cf63-6988-48d0-a5a9-00826838f7f4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.760s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:10 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5c79cf63-6988-48d0-a5a9-00826838f7f4 tempest-CreateVolumesFromSnapshotTest-82292396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-703404407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa59d3cd-2996-49c3-9659-3cf574313f49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d175e49cbb446c19d15cdb84b59e4d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:51:09Z,use_quota=True,user_id='562a6d2faf0348ca8423d399f6a33457',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:51:10 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-5c79cf63-6988-48d0-a5a9-00826838f7f4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Creating volume fa59d3cd-2996-49c3-9659-3cf574313f49 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:51:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5c79cf63-6988-48d0-a5a9-00826838f7f4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5c79cf63-6988-48d0-a5a9-00826838f7f4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:10 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5c79cf63-6988-48d0-a5a9-00826838f7f4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:51:10 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5c79cf63-6988-48d0-a5a9-00826838f7f4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:51:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5c79cf63-6988-48d0-a5a9-00826838f7f4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:10 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5c79cf63-6988-48d0-a5a9-00826838f7f4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:51:10 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-5c79cf63-6988-48d0-a5a9-00826838f7f4 tempest-CreateVolumesFromSnapshotTest-82292396 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:51:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5c79cf63-6988-48d0-a5a9-00826838f7f4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:10 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9d542d88-3464-4adc-920d-448109c99804 tempest-VolumesTransfersV355Test-1673787352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbf61562-ce75-4cb7-9d3f-308c5d2e90f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-594bc940-f116-4d6c-ab67-5df6a1ba35ea', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:10 devstack sudo[102595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49 1073741824 Jul 10 06:51:10 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9d542d88-3464-4adc-920d-448109c99804 tempest-VolumesTransfersV355Test-1673787352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (599f8e30-6668-4c28-8b96-ccd1033ca3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:10 devstack sudo[102595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:10 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-9d542d88-3464-4adc-920d-448109c99804 tempest-VolumesTransfersV355Test-1673787352 None] Volume volume-594bc940-f116-4d6c-ab67-5df6a1ba35ea (594bc940-f116-4d6c-ab67-5df6a1ba35ea): created successfully Jul 10 06:51:11 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9d542d88-3464-4adc-920d-448109c99804 tempest-VolumesTransfersV355Test-1673787352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (599f8e30-6668-4c28-8b96-ccd1033ca3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:11 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9d542d88-3464-4adc-920d-448109c99804 tempest-VolumesTransfersV355Test-1673787352 None] Flow 'volume_create_manager' (adfbe251-f64e-46c8-b13f-05108a4e35c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:51:11 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-9d542d88-3464-4adc-920d-448109c99804 tempest-VolumesTransfersV355Test-1673787352 None] Created volume successfully. Jul 10 06:51:11 devstack sudo[102592]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0a531cd6-7847-4de2-a0bb-f00e14125e71 tempest-VolumeDependencyTests-238445503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa.c57d6eb1-c5de-4c1c-9320-3b6b23e15a29" returned: 0 in 1.051s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:11 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-0a531cd6-7847-4de2-a0bb-f00e14125e71 tempest-VolumeDependencyTests-238445503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c823d1d2-9a66-488b-812a-7ced4039a1fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:51:11 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffedccfa-30a3-4fed-bbce-0713455fa1ad]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:51:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0a531cd6-7847-4de2-a0bb-f00e14125e71 tempest-VolumeDependencyTests-238445503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:11 devstack sudo[102606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa Jul 10 06:51:11 devstack sudo[102606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:11 devstack sudo[102595]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5c79cf63-6988-48d0-a5a9-00826838f7f4 tempest-CreateVolumesFromSnapshotTest-82292396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49 1073741824" returned: 0 in 1.059s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5c79cf63-6988-48d0-a5a9-00826838f7f4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:12 devstack sudo[102609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49 Jul 10 06:51:12 devstack sudo[102609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:12 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-685aacaa-a1e7-4428-b609-fb5eb785521d tempest-VolumesTransfersV355Test-1394462259 None] Transfer volume completed successfully. Jul 10 06:51:12 devstack sudo[102606]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0a531cd6-7847-4de2-a0bb-f00e14125e71 tempest-VolumeDependencyTests-238445503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa" returned: 0 in 1.127s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0a531cd6-7847-4de2-a0bb-f00e14125e71 tempest-VolumeDependencyTests-238445503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa.c57d6eb1-c5de-4c1c-9320-3b6b23e15a29 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:12 devstack sudo[102632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa.c57d6eb1-c5de-4c1c-9320-3b6b23e15a29 Jul 10 06:51:12 devstack sudo[102632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:12 devstack sudo[102609]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5c79cf63-6988-48d0-a5a9-00826838f7f4 tempest-CreateVolumesFromSnapshotTest-82292396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49" returned: 0 in 0.975s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:12 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5c79cf63-6988-48d0-a5a9-00826838f7f4 tempest-CreateVolumesFromSnapshotTest-82292396 None] <== create_volume: return (2083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:51:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5c79cf63-6988-48d0-a5a9-00826838f7f4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.086s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:12 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-65e06cfd-8a78-4a6a-b44d-5a3c2623ccc6 req-5445d4b8-9a62-45b2-b34a-8ca872f8d4cb tempest-TestShelveInstance-522639284 None] Terminate volume connection completed successfully. Jul 10 06:51:12 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-65e06cfd-8a78-4a6a-b44d-5a3c2623ccc6 req-5445d4b8-9a62-45b2-b34a-8ca872f8d4cb tempest-TestShelveInstance-522639284 None] Deleting attachment a6c3d986-8860-40ad-baf5-a53cdc0c5e13. {{(pid=87294) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:51:12 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5c79cf63-6988-48d0-a5a9-00826838f7f4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26eccd4f-f73b-4f5b-ae74-40441980a60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa59d3cd-2996-49c3-9659-3cf574313f49', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:12 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5c79cf63-6988-48d0-a5a9-00826838f7f4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb296c0b-968c-48c5-b8a8-6679b03567d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:12 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-5c79cf63-6988-48d0-a5a9-00826838f7f4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Volume volume-fa59d3cd-2996-49c3-9659-3cf574313f49 (fa59d3cd-2996-49c3-9659-3cf574313f49): created successfully Jul 10 06:51:13 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5c79cf63-6988-48d0-a5a9-00826838f7f4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb296c0b-968c-48c5-b8a8-6679b03567d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:13 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5c79cf63-6988-48d0-a5a9-00826838f7f4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Flow 'volume_create_manager' (4fe82a0a-341c-4b45-afd7-32f7f9074b1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:51:13 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-5c79cf63-6988-48d0-a5a9-00826838f7f4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Created volume successfully. Jul 10 06:51:13 devstack sudo[102632]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0a531cd6-7847-4de2-a0bb-f00e14125e71 tempest-VolumeDependencyTests-238445503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa.c57d6eb1-c5de-4c1c-9320-3b6b23e15a29" returned: 0 in 0.858s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0a531cd6-7847-4de2-a0bb-f00e14125e71 tempest-VolumeDependencyTests-238445503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa.c57d6eb1-c5de-4c1c-9320-3b6b23e15a29 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:13 devstack sudo[102640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa.c57d6eb1-c5de-4c1c-9320-3b6b23e15a29 Jul 10 06:51:13 devstack sudo[102640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-bda64488-719d-43fc-896a-6c7297007641 tempest-CreateVolumesFromSnapshotTest-82292396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-bda64488-719d-43fc-896a-6c7297007641 tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:13 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-bda64488-719d-43fc-896a-6c7297007641 tempest-CreateVolumesFromSnapshotTest-82292396 None] Creating offline snapshot ffae4ec7-90e5-4ea0-a6c8-0ea12802fed3 of volume fa59d3cd-2996-49c3-9659-3cf574313f49 {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:51:13 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fe9ec8-8fe3-4893-bd64-95458e2d31a7]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:51:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bda64488-719d-43fc-896a-6c7297007641 tempest-CreateVolumesFromSnapshotTest-82292396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:13 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-048b2c56-8609-423b-b91b-3669aa253bb9 tempest-VolumesTransfersV355Test-448114818 None] Acquiring lock "cinder-594bc940-f116-4d6c-ab67-5df6a1ba35ea-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:13 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-048b2c56-8609-423b-b91b-3669aa253bb9 tempest-VolumesTransfersV355Test-448114818 None] Lock "cinder-594bc940-f116-4d6c-ab67-5df6a1ba35ea-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:14 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-048b2c56-8609-423b-b91b-3669aa253bb9 tempest-VolumesTransfersV355Test-448114818 None] Acquiring lock "cinder-quobyte-594bc940-f116-4d6c-ab67-5df6a1ba35ea" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:14 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-048b2c56-8609-423b-b91b-3669aa253bb9 tempest-VolumesTransfersV355Test-448114818 None] Lock "cinder-quobyte-594bc940-f116-4d6c-ab67-5df6a1ba35ea" acquired by "delete_volume" :: waited 0.020s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:14 devstack sudo[102642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49 Jul 10 06:51:14 devstack sudo[102642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:14 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[82651755-e4e5-4ab0-aa21-afe39c08ffbf]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:51:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-048b2c56-8609-423b-b91b-3669aa253bb9 tempest-VolumesTransfersV355Test-448114818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-594bc940-f116-4d6c-ab67-5df6a1ba35ea {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:14 devstack sudo[102644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-594bc940-f116-4d6c-ab67-5df6a1ba35ea Jul 10 06:51:14 devstack sudo[102644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:14 devstack sudo[102640]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0a531cd6-7847-4de2-a0bb-f00e14125e71 tempest-VolumeDependencyTests-238445503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa.c57d6eb1-c5de-4c1c-9320-3b6b23e15a29" returned: 0 in 0.794s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:14 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-0a531cd6-7847-4de2-a0bb-f00e14125e71 tempest-VolumeDependencyTests-238445503 None] Lock "cinder-quobyte-c57d6eb1-c5de-4c1c-9320-3b6b23e15a29" released by "_delete_snapshot" :: held 3.966s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:51:14 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-0a531cd6-7847-4de2-a0bb-f00e14125e71 tempest-VolumeDependencyTests-238445503 None] Lock "cinder-quobyte-c823d1d2-9a66-488b-812a-7ced4039a1fa" released by "delete_snapshot" :: held 3.992s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:51:14 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-0a531cd6-7847-4de2-a0bb-f00e14125e71 tempest-VolumeDependencyTests-238445503 None] Created reservations ['e153a2c4-c376-4230-af41-9fb594672623', '1b5d513c-3dc3-440b-98ea-e37c4c809181', 'bca985ec-daa0-4d5f-a78c-c87b28986ec2', '19e64a23-c0b8-48af-b5cb-2193cc7b9b5d'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:51:14 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-0a531cd6-7847-4de2-a0bb-f00e14125e71 tempest-VolumeDependencyTests-238445503 None] Delete snapshot completed successfully. Jul 10 06:51:14 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-0a531cd6-7847-4de2-a0bb-f00e14125e71 tempest-VolumeDependencyTests-238445503 None] Lock "cinder-c57d6eb1-c5de-4c1c-9320-3b6b23e15a29-delete_snapshot" released by "delete_snapshot" :: held 4.163s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:51:14 devstack sudo[102642]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bda64488-719d-43fc-896a-6c7297007641 tempest-CreateVolumesFromSnapshotTest-82292396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49" returned: 0 in 0.940s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bda64488-719d-43fc-896a-6c7297007641 tempest-CreateVolumesFromSnapshotTest-82292396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49.ffae4ec7-90e5-4ea0-a6c8-0ea12802fed3 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:14 devstack sudo[102651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49.ffae4ec7-90e5-4ea0-a6c8-0ea12802fed3 1G Jul 10 06:51:14 devstack sudo[102651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:14 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c96299ce-f0ff-47d4-b8cb-5304668e5844 tempest-VolumeDependencyTests-238445503 None] Acquiring lock "cinder-c823d1d2-9a66-488b-812a-7ced4039a1fa-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:14 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c96299ce-f0ff-47d4-b8cb-5304668e5844 tempest-VolumeDependencyTests-238445503 None] Lock "cinder-c823d1d2-9a66-488b-812a-7ced4039a1fa-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:14 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c96299ce-f0ff-47d4-b8cb-5304668e5844 tempest-VolumeDependencyTests-238445503 None] Acquiring lock "cinder-quobyte-c823d1d2-9a66-488b-812a-7ced4039a1fa" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:15 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c96299ce-f0ff-47d4-b8cb-5304668e5844 tempest-VolumeDependencyTests-238445503 None] Lock "cinder-quobyte-c823d1d2-9a66-488b-812a-7ced4039a1fa" acquired by "delete_volume" :: waited 0.018s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:15 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb2be6d-30a0-4732-8b4b-de40769346c4]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:51:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c96299ce-f0ff-47d4-b8cb-5304668e5844 tempest-VolumeDependencyTests-238445503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:15 devstack sudo[102644]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-048b2c56-8609-423b-b91b-3669aa253bb9 tempest-VolumesTransfersV355Test-448114818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-594bc940-f116-4d6c-ab67-5df6a1ba35ea" returned: 0 in 1.041s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-048b2c56-8609-423b-b91b-3669aa253bb9 tempest-VolumesTransfersV355Test-448114818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-594bc940-f116-4d6c-ab67-5df6a1ba35ea {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:15 devstack sudo[102657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-594bc940-f116-4d6c-ab67-5df6a1ba35ea Jul 10 06:51:15 devstack sudo[102657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:15 devstack sudo[102656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa Jul 10 06:51:15 devstack sudo[102656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:15 devstack sudo[102657]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-048b2c56-8609-423b-b91b-3669aa253bb9 tempest-VolumesTransfersV355Test-448114818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-594bc940-f116-4d6c-ab67-5df6a1ba35ea" returned: 0 in 0.828s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:15 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-048b2c56-8609-423b-b91b-3669aa253bb9 tempest-VolumesTransfersV355Test-448114818 None] Lock "cinder-quobyte-594bc940-f116-4d6c-ab67-5df6a1ba35ea" released by "delete_volume" :: held 1.939s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:51:15 devstack sudo[102656]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c96299ce-f0ff-47d4-b8cb-5304668e5844 tempest-VolumeDependencyTests-238445503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa" returned: 0 in 0.951s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c96299ce-f0ff-47d4-b8cb-5304668e5844 tempest-VolumeDependencyTests-238445503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:16 devstack sudo[102651]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bda64488-719d-43fc-896a-6c7297007641 tempest-CreateVolumesFromSnapshotTest-82292396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49.ffae4ec7-90e5-4ea0-a6c8-0ea12802fed3 1G" returned: 0 in 1.229s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bda64488-719d-43fc-896a-6c7297007641 tempest-CreateVolumesFromSnapshotTest-82292396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa59d3cd-2996-49c3-9659-3cf574313f49 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49.ffae4ec7-90e5-4ea0-a6c8-0ea12802fed3 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:16 devstack sudo[102670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa Jul 10 06:51:16 devstack sudo[102670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:16 devstack sudo[102672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa59d3cd-2996-49c3-9659-3cf574313f49 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49.ffae4ec7-90e5-4ea0-a6c8-0ea12802fed3 Jul 10 06:51:16 devstack sudo[102672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:16 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-048b2c56-8609-423b-b91b-3669aa253bb9 tempest-VolumesTransfersV355Test-448114818 None] Created reservations ['b05fe0ae-50f2-4338-9bc7-d27b2360068b', '6d9611df-bd86-483a-acf3-5e7bda915a2c', '4c223311-ce43-47d8-b4c7-cce91c176eb8', 'b85b92bc-09a9-4887-9a1c-46df2394af98'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:51:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-048b2c56-8609-423b-b91b-3669aa253bb9 tempest-VolumesTransfersV355Test-448114818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-048b2c56-8609-423b-b91b-3669aa253bb9 tempest-VolumesTransfersV355Test-448114818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:16 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-048b2c56-8609-423b-b91b-3669aa253bb9 tempest-VolumesTransfersV355Test-448114818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:51:16 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-048b2c56-8609-423b-b91b-3669aa253bb9 tempest-VolumesTransfersV355Test-448114818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:51:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-048b2c56-8609-423b-b91b-3669aa253bb9 tempest-VolumesTransfersV355Test-448114818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-048b2c56-8609-423b-b91b-3669aa253bb9 tempest-VolumesTransfersV355Test-448114818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:16 devstack sudo[102674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:51:16 devstack sudo[102674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:16 devstack sudo[102670]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c96299ce-f0ff-47d4-b8cb-5304668e5844 tempest-VolumeDependencyTests-238445503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c823d1d2-9a66-488b-812a-7ced4039a1fa" returned: 0 in 0.873s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:16 devstack sudo[102672]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:16 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c96299ce-f0ff-47d4-b8cb-5304668e5844 tempest-VolumeDependencyTests-238445503 None] Lock "cinder-quobyte-c823d1d2-9a66-488b-812a-7ced4039a1fa" released by "delete_volume" :: held 1.910s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:51:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bda64488-719d-43fc-896a-6c7297007641 tempest-CreateVolumesFromSnapshotTest-82292396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa59d3cd-2996-49c3-9659-3cf574313f49 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49.ffae4ec7-90e5-4ea0-a6c8-0ea12802fed3" returned: 0 in 0.861s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:16 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-bda64488-719d-43fc-896a-6c7297007641 tempest-CreateVolumesFromSnapshotTest-82292396 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49.ffae4ec7-90e5-4ea0-a6c8-0ea12802fed3 is being set with open permissions: ugo+rw Jul 10 06:51:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bda64488-719d-43fc-896a-6c7297007641 tempest-CreateVolumesFromSnapshotTest-82292396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49.ffae4ec7-90e5-4ea0-a6c8-0ea12802fed3 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:16 devstack sudo[102682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49.ffae4ec7-90e5-4ea0-a6c8-0ea12802fed3 Jul 10 06:51:16 devstack sudo[102682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:16 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-c96299ce-f0ff-47d4-b8cb-5304668e5844 tempest-VolumeDependencyTests-238445503 None] Created reservations ['e7bc4a9e-37fc-4295-bc8c-2f4cd7256563', 'd1c8799d-c462-4d74-9f80-a470ceb9a352', 'ce016d0a-7723-40b7-a3b3-1e2a2398475c', '1072db46-dd0d-487e-9354-f070da5cf619'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:51:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c96299ce-f0ff-47d4-b8cb-5304668e5844 tempest-VolumeDependencyTests-238445503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c96299ce-f0ff-47d4-b8cb-5304668e5844 tempest-VolumeDependencyTests-238445503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:17 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-c96299ce-f0ff-47d4-b8cb-5304668e5844 tempest-VolumeDependencyTests-238445503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:51:17 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-c96299ce-f0ff-47d4-b8cb-5304668e5844 tempest-VolumeDependencyTests-238445503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:51:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c96299ce-f0ff-47d4-b8cb-5304668e5844 tempest-VolumeDependencyTests-238445503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c96299ce-f0ff-47d4-b8cb-5304668e5844 tempest-VolumeDependencyTests-238445503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:17 devstack sudo[102685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:51:17 devstack sudo[102685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:17 devstack sudo[102674]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-048b2c56-8609-423b-b91b-3669aa253bb9 tempest-VolumesTransfersV355Test-448114818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.868s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:17 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-048b2c56-8609-423b-b91b-3669aa253bb9 tempest-VolumesTransfersV355Test-448114818 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:51:17 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-048b2c56-8609-423b-b91b-3669aa253bb9 tempest-VolumesTransfersV355Test-448114818 None] Deleted volume successfully. Jul 10 06:51:17 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-903bf50e-2b28-49e7-aa6d-0509108fecb6 tempest-VolumeDependencyTests-238445503 None] Acquiring lock "cinder-c787a2a1-10ec-4fb7-83a9-27da97ec36ef-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:17 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-048b2c56-8609-423b-b91b-3669aa253bb9 tempest-VolumesTransfersV355Test-448114818 None] Lock "cinder-594bc940-f116-4d6c-ab67-5df6a1ba35ea-delete_volume" released by "delete_volume" :: held 3.303s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:51:17 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-903bf50e-2b28-49e7-aa6d-0509108fecb6 tempest-VolumeDependencyTests-238445503 None] Lock "cinder-c787a2a1-10ec-4fb7-83a9-27da97ec36ef-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:17 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-903bf50e-2b28-49e7-aa6d-0509108fecb6 tempest-VolumeDependencyTests-238445503 None] Acquiring lock "cinder-quobyte-c787a2a1-10ec-4fb7-83a9-27da97ec36ef" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:17 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-903bf50e-2b28-49e7-aa6d-0509108fecb6 tempest-VolumeDependencyTests-238445503 None] Lock "cinder-quobyte-c787a2a1-10ec-4fb7-83a9-27da97ec36ef" acquired by "delete_volume" :: waited 0.041s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:17 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f4e463-1d43-42fa-9d4b-654d97f1b1ef]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:51:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-903bf50e-2b28-49e7-aa6d-0509108fecb6 tempest-VolumeDependencyTests-238445503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c787a2a1-10ec-4fb7-83a9-27da97ec36ef {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:17 devstack sudo[102687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c787a2a1-10ec-4fb7-83a9-27da97ec36ef Jul 10 06:51:17 devstack sudo[102687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:17 devstack sudo[102682]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bda64488-719d-43fc-896a-6c7297007641 tempest-CreateVolumesFromSnapshotTest-82292396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49.ffae4ec7-90e5-4ea0-a6c8-0ea12802fed3" returned: 0 in 0.899s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bda64488-719d-43fc-896a-6c7297007641 tempest-CreateVolumesFromSnapshotTest-82292396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:17 devstack sudo[102691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49.info Jul 10 06:51:17 devstack sudo[102691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:18 devstack sudo[102685]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c96299ce-f0ff-47d4-b8cb-5304668e5844 tempest-VolumeDependencyTests-238445503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.923s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:18 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-c96299ce-f0ff-47d4-b8cb-5304668e5844 tempest-VolumeDependencyTests-238445503 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:51:18 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-c96299ce-f0ff-47d4-b8cb-5304668e5844 tempest-VolumeDependencyTests-238445503 None] Deleted volume successfully. Jul 10 06:51:18 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e8d8bfd-abac-4461-a42d-076f364c8ed1 tempest-VolumesTransfersV355Test-1673787352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:51:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-1e8d8bfd-abac-4461-a42d-076f364c8ed1 tempest-VolumesTransfersV355Test-1673787352 None] Flow 'volume_create_manager' (539a09d0-96cf-4aa9-baa2-f03110b4b695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:51:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-1e8d8bfd-abac-4461-a42d-076f364c8ed1 tempest-VolumesTransfersV355Test-1673787352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0f8ca39-24eb-4258-9b87-2f8410305a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-1e8d8bfd-abac-4461-a42d-076f364c8ed1 tempest-VolumesTransfersV355Test-1673787352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0f8ca39-24eb-4258-9b87-2f8410305a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1178058485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88ef8fe3-6c7e-464a-a759-9892bb6f6134,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78557e3d1ade41e78d9c534b4515f7bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:51:18Z,use_quota=True,user_id='2021a96149144e9b87ee357c3c5a2d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-1e8d8bfd-abac-4461-a42d-076f364c8ed1 tempest-VolumesTransfersV355Test-1673787352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5ce7eae-9abf-4786-8596-8cdcd19e4a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-1e8d8bfd-abac-4461-a42d-076f364c8ed1 tempest-VolumesTransfersV355Test-1673787352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5ce7eae-9abf-4786-8596-8cdcd19e4a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-1e8d8bfd-abac-4461-a42d-076f364c8ed1 tempest-VolumesTransfersV355Test-1673787352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c522fd91-f69d-41ea-9ba5-2ff881e07f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-1e8d8bfd-abac-4461-a42d-076f364c8ed1 tempest-VolumesTransfersV355Test-1673787352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c522fd91-f69d-41ea-9ba5-2ff881e07f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88ef8fe3-6c7e-464a-a759-9892bb6f6134', 'volume_name': 'volume-88ef8fe3-6c7e-464a-a759-9892bb6f6134', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-1e8d8bfd-abac-4461-a42d-076f364c8ed1 tempest-VolumesTransfersV355Test-1673787352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68fa3789-1be6-40fe-8eaf-41051fe6a8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-1e8d8bfd-abac-4461-a42d-076f364c8ed1 tempest-VolumesTransfersV355Test-1673787352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68fa3789-1be6-40fe-8eaf-41051fe6a8c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-1e8d8bfd-abac-4461-a42d-076f364c8ed1 tempest-VolumesTransfersV355Test-1673787352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaf71113-dd56-40f9-9041-95cc5ba8ec53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:18 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-1e8d8bfd-abac-4461-a42d-076f364c8ed1 tempest-VolumesTransfersV355Test-1673787352 None] Volume 88ef8fe3-6c7e-464a-a759-9892bb6f6134: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88ef8fe3-6c7e-464a-a759-9892bb6f6134', 'volume_size': 1} Jul 10 06:51:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-1e8d8bfd-abac-4461-a42d-076f364c8ed1 tempest-VolumesTransfersV355Test-1673787352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:18 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c96299ce-f0ff-47d4-b8cb-5304668e5844 tempest-VolumeDependencyTests-238445503 None] Lock "cinder-c823d1d2-9a66-488b-812a-7ced4039a1fa-delete_volume" released by "delete_volume" :: held 3.212s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:51:18 devstack sudo[102687]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-903bf50e-2b28-49e7-aa6d-0509108fecb6 tempest-VolumeDependencyTests-238445503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c787a2a1-10ec-4fb7-83a9-27da97ec36ef" returned: 0 in 0.907s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-903bf50e-2b28-49e7-aa6d-0509108fecb6 tempest-VolumeDependencyTests-238445503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c787a2a1-10ec-4fb7-83a9-27da97ec36ef {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:18 devstack sudo[102697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c787a2a1-10ec-4fb7-83a9-27da97ec36ef Jul 10 06:51:18 devstack sudo[102697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:18 devstack sudo[102691]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bda64488-719d-43fc-896a-6c7297007641 tempest-CreateVolumesFromSnapshotTest-82292396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49.info" returned: 0 in 0.734s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:18 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-bda64488-719d-43fc-896a-6c7297007641 tempest-CreateVolumesFromSnapshotTest-82292396 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49.info is being set with open permissions: ugo+rw Jul 10 06:51:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bda64488-719d-43fc-896a-6c7297007641 tempest-CreateVolumesFromSnapshotTest-82292396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:18 devstack sudo[102700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49.info Jul 10 06:51:18 devstack sudo[102700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-39889fb4-b91c-49d6-bb75-eb07bbfb1c52 req-c78eda81-f179-485c-a500-2f1d95f3df92 tempest-TestShelveInstance-522639284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:19 devstack sudo[102697]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-903bf50e-2b28-49e7-aa6d-0509108fecb6 tempest-VolumeDependencyTests-238445503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c787a2a1-10ec-4fb7-83a9-27da97ec36ef" returned: 0 in 0.741s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:19 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-903bf50e-2b28-49e7-aa6d-0509108fecb6 tempest-VolumeDependencyTests-238445503 None] Lock "cinder-quobyte-c787a2a1-10ec-4fb7-83a9-27da97ec36ef" released by "delete_volume" :: held 1.707s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:51:19 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-903bf50e-2b28-49e7-aa6d-0509108fecb6 tempest-VolumeDependencyTests-238445503 None] Created reservations ['ca46a804-761d-4fa3-b014-48641f565b35', '9569623c-a03a-4e16-b64b-0e2e84d658c0', '6297731c-c5be-4741-9389-13853540e977', '43539ec7-faaa-4a4f-82ef-a3f9c1ba9ee0'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:51:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-903bf50e-2b28-49e7-aa6d-0509108fecb6 tempest-VolumeDependencyTests-238445503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-903bf50e-2b28-49e7-aa6d-0509108fecb6 tempest-VolumeDependencyTests-238445503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:19 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-903bf50e-2b28-49e7-aa6d-0509108fecb6 tempest-VolumeDependencyTests-238445503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:51:19 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-903bf50e-2b28-49e7-aa6d-0509108fecb6 tempest-VolumeDependencyTests-238445503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:51:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-903bf50e-2b28-49e7-aa6d-0509108fecb6 tempest-VolumeDependencyTests-238445503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-903bf50e-2b28-49e7-aa6d-0509108fecb6 tempest-VolumeDependencyTests-238445503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:19 devstack sudo[102712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:51:19 devstack sudo[102712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:19 devstack sudo[102700]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bda64488-719d-43fc-896a-6c7297007641 tempest-CreateVolumesFromSnapshotTest-82292396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49.info" returned: 0 in 0.679s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-bda64488-719d-43fc-896a-6c7297007641 tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.486s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-1e8d8bfd-abac-4461-a42d-076f364c8ed1 tempest-VolumesTransfersV355Test-1673787352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.178s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:19 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-1e8d8bfd-abac-4461-a42d-076f364c8ed1 tempest-VolumesTransfersV355Test-1673787352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1178058485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88ef8fe3-6c7e-464a-a759-9892bb6f6134,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78557e3d1ade41e78d9c534b4515f7bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:51:18Z,use_quota=True,user_id='2021a96149144e9b87ee357c3c5a2d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:51:19 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-1e8d8bfd-abac-4461-a42d-076f364c8ed1 tempest-VolumesTransfersV355Test-1673787352 None] Creating volume 88ef8fe3-6c7e-464a-a759-9892bb6f6134 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:51:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-1e8d8bfd-abac-4461-a42d-076f364c8ed1 tempest-VolumesTransfersV355Test-1673787352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-1e8d8bfd-abac-4461-a42d-076f364c8ed1 tempest-VolumesTransfersV355Test-1673787352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:19 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-1e8d8bfd-abac-4461-a42d-076f364c8ed1 tempest-VolumesTransfersV355Test-1673787352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:51:19 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-1e8d8bfd-abac-4461-a42d-076f364c8ed1 tempest-VolumesTransfersV355Test-1673787352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:51:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-1e8d8bfd-abac-4461-a42d-076f364c8ed1 tempest-VolumesTransfersV355Test-1673787352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:19 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-1e8d8bfd-abac-4461-a42d-076f364c8ed1 tempest-VolumesTransfersV355Test-1673787352 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:51:19 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-1e8d8bfd-abac-4461-a42d-076f364c8ed1 tempest-VolumesTransfersV355Test-1673787352 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:51:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1e8d8bfd-abac-4461-a42d-076f364c8ed1 tempest-VolumesTransfersV355Test-1673787352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-88ef8fe3-6c7e-464a-a759-9892bb6f6134 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:19 devstack sudo[102714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-88ef8fe3-6c7e-464a-a759-9892bb6f6134 1073741824 Jul 10 06:51:19 devstack sudo[102714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:19 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-bda64488-719d-43fc-896a-6c7297007641 tempest-CreateVolumesFromSnapshotTest-82292396 None] Create snapshot completed successfully Jul 10 06:51:19 devstack sudo[102712]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-903bf50e-2b28-49e7-aa6d-0509108fecb6 tempest-VolumeDependencyTests-238445503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.674s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:19 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-903bf50e-2b28-49e7-aa6d-0509108fecb6 tempest-VolumeDependencyTests-238445503 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:51:19 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-903bf50e-2b28-49e7-aa6d-0509108fecb6 tempest-VolumeDependencyTests-238445503 None] Deleted volume successfully. Jul 10 06:51:19 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-903bf50e-2b28-49e7-aa6d-0509108fecb6 tempest-VolumeDependencyTests-238445503 None] Lock "cinder-c787a2a1-10ec-4fb7-83a9-27da97ec36ef-delete_volume" released by "delete_volume" :: held 2.648s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:51:20 devstack sudo[102714]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1e8d8bfd-abac-4461-a42d-076f364c8ed1 tempest-VolumesTransfersV355Test-1673787352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-88ef8fe3-6c7e-464a-a759-9892bb6f6134 1073741824" returned: 0 in 0.947s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1e8d8bfd-abac-4461-a42d-076f364c8ed1 tempest-VolumesTransfersV355Test-1673787352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-88ef8fe3-6c7e-464a-a759-9892bb6f6134 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:20 devstack sudo[102721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-88ef8fe3-6c7e-464a-a759-9892bb6f6134 Jul 10 06:51:20 devstack sudo[102721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:20 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-dac5f0bb-e78b-4ffc-86d9-dfcca38caaa4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:51:20 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dac5f0bb-e78b-4ffc-86d9-dfcca38caaa4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Flow 'volume_create_manager' (ef31cbe4-085d-43df-aa4f-05320b303097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:51:20 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dac5f0bb-e78b-4ffc-86d9-dfcca38caaa4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6fa310b-2632-4efb-ac18-61f7c39a0ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:20 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dac5f0bb-e78b-4ffc-86d9-dfcca38caaa4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6fa310b-2632-4efb-ac18-61f7c39a0ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-560389785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d350d57b-67f0-4d5c-af10-955fa96ebf89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d175e49cbb446c19d15cdb84b59e4d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:51:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:51:21Z,use_quota=True,user_id='562a6d2faf0348ca8423d399f6a33457',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:20 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dac5f0bb-e78b-4ffc-86d9-dfcca38caaa4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c098f718-64c2-473a-a413-868040d07c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:20 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dac5f0bb-e78b-4ffc-86d9-dfcca38caaa4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c098f718-64c2-473a-a413-868040d07c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:20 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dac5f0bb-e78b-4ffc-86d9-dfcca38caaa4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82fbb3ee-1e36-41c6-b13e-8c43295b6edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:20 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dac5f0bb-e78b-4ffc-86d9-dfcca38caaa4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82fbb3ee-1e36-41c6-b13e-8c43295b6edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd350d57b-67f0-4d5c-af10-955fa96ebf89', 'volume_name': 'volume-d350d57b-67f0-4d5c-af10-955fa96ebf89', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:20 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dac5f0bb-e78b-4ffc-86d9-dfcca38caaa4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (372a4242-f0a4-48c1-b59b-8d05ed4d5936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:20 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dac5f0bb-e78b-4ffc-86d9-dfcca38caaa4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (372a4242-f0a4-48c1-b59b-8d05ed4d5936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:20 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dac5f0bb-e78b-4ffc-86d9-dfcca38caaa4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7091f925-0cf5-434d-a770-2333757589ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:20 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-dac5f0bb-e78b-4ffc-86d9-dfcca38caaa4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Volume d350d57b-67f0-4d5c-af10-955fa96ebf89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d350d57b-67f0-4d5c-af10-955fa96ebf89', 'volume_size': 1} Jul 10 06:51:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-dac5f0bb-e78b-4ffc-86d9-dfcca38caaa4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:21 devstack sudo[102721]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1e8d8bfd-abac-4461-a42d-076f364c8ed1 tempest-VolumesTransfersV355Test-1673787352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-88ef8fe3-6c7e-464a-a759-9892bb6f6134" returned: 0 in 0.951s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-1e8d8bfd-abac-4461-a42d-076f364c8ed1 tempest-VolumesTransfersV355Test-1673787352 None] <== create_volume: return (1943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:51:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-1e8d8bfd-abac-4461-a42d-076f364c8ed1 tempest-VolumesTransfersV355Test-1673787352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.947s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-39889fb4-b91c-49d6-bb75-eb07bbfb1c52 req-c78eda81-f179-485c-a500-2f1d95f3df92 tempest-TestShelveInstance-522639284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.343s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-1e8d8bfd-abac-4461-a42d-076f364c8ed1 tempest-VolumesTransfersV355Test-1673787352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaf71113-dd56-40f9-9041-95cc5ba8ec53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88ef8fe3-6c7e-464a-a759-9892bb6f6134', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-1e8d8bfd-abac-4461-a42d-076f364c8ed1 tempest-VolumesTransfersV355Test-1673787352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12d97498-e507-45fe-97ce-ac2a950ec439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:21 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[328e6f0e-136a-496e-8cef-b8e4832752b3]: (4, 'raw') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:51:21 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-1e8d8bfd-abac-4461-a42d-076f364c8ed1 tempest-VolumesTransfersV355Test-1673787352 None] Volume volume-88ef8fe3-6c7e-464a-a759-9892bb6f6134 (88ef8fe3-6c7e-464a-a759-9892bb6f6134): created successfully Jul 10 06:51:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-1e8d8bfd-abac-4461-a42d-076f364c8ed1 tempest-VolumesTransfersV355Test-1673787352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12d97498-e507-45fe-97ce-ac2a950ec439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-1e8d8bfd-abac-4461-a42d-076f364c8ed1 tempest-VolumesTransfersV355Test-1673787352 None] Flow 'volume_create_manager' (539a09d0-96cf-4aa9-baa2-f03110b4b695) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:51:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-39889fb4-b91c-49d6-bb75-eb07bbfb1c52 req-c78eda81-f179-485c-a500-2f1d95f3df92 tempest-TestShelveInstance-522639284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b7985d9-0694-4f31-8003-55116f99eb3c {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:21 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-1e8d8bfd-abac-4461-a42d-076f364c8ed1 tempest-VolumesTransfersV355Test-1673787352 None] Created volume successfully. Jul 10 06:51:21 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-16c1f664-3666-469e-a353-6246191e72ab tempest-CreateVolumesFromSnapshotTest-82292396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:51:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-16c1f664-3666-469e-a353-6246191e72ab tempest-CreateVolumesFromSnapshotTest-82292396 None] Flow 'volume_create_manager' (ab6a8ac8-7466-4137-9e0b-49370840a25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:51:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-16c1f664-3666-469e-a353-6246191e72ab tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d0637c9-91f8-4550-ac52-d9d99429f5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-16c1f664-3666-469e-a353-6246191e72ab tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d0637c9-91f8-4550-ac52-d9d99429f5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1276906282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56dd810f-ea88-4ce2-b55c-5db4027e1eb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d175e49cbb446c19d15cdb84b59e4d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:51:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:51:21Z,use_quota=True,user_id='562a6d2faf0348ca8423d399f6a33457',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-16c1f664-3666-469e-a353-6246191e72ab tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (609b903a-a70f-4b11-94ef-8985a7a1aac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-16c1f664-3666-469e-a353-6246191e72ab tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (609b903a-a70f-4b11-94ef-8985a7a1aac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-16c1f664-3666-469e-a353-6246191e72ab tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b8b7b9-aefb-4da7-8e99-6ac31b7b647f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-16c1f664-3666-469e-a353-6246191e72ab tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b8b7b9-aefb-4da7-8e99-6ac31b7b647f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56dd810f-ea88-4ce2-b55c-5db4027e1eb2', 'volume_name': 'volume-56dd810f-ea88-4ce2-b55c-5db4027e1eb2', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-16c1f664-3666-469e-a353-6246191e72ab tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f3d8408-974b-4be9-bd5a-bc427a70d103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:21 devstack sudo[102758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b7985d9-0694-4f31-8003-55116f99eb3c Jul 10 06:51:21 devstack sudo[102758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-16c1f664-3666-469e-a353-6246191e72ab tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f3d8408-974b-4be9-bd5a-bc427a70d103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-16c1f664-3666-469e-a353-6246191e72ab tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ba08694-a336-43c2-a54a-a7442f8c831e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:21 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-16c1f664-3666-469e-a353-6246191e72ab tempest-CreateVolumesFromSnapshotTest-82292396 None] Volume 56dd810f-ea88-4ce2-b55c-5db4027e1eb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56dd810f-ea88-4ce2-b55c-5db4027e1eb2', 'volume_size': 1} Jul 10 06:51:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-16c1f664-3666-469e-a353-6246191e72ab tempest-CreateVolumesFromSnapshotTest-82292396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:21 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:51:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:51:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:51:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:21 devstack sudo[102762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:51:21 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:22 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-caf05481-e79f-48a0-824e-2d826eaa5892 tempest-CreateVolumesFromSnapshotTest-82292396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:51:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-caf05481-e79f-48a0-824e-2d826eaa5892 tempest-CreateVolumesFromSnapshotTest-82292396 None] Flow 'volume_create_manager' (5c66b42c-50f3-4764-a2b2-12482753af75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:51:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-caf05481-e79f-48a0-824e-2d826eaa5892 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2ade1ab-27e2-4549-9c69-8bc5b5edc5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-caf05481-e79f-48a0-824e-2d826eaa5892 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2ade1ab-27e2-4549-9c69-8bc5b5edc5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1843876769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97df73cc-da45-4780-9f7e-cee6ceb4affd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d175e49cbb446c19d15cdb84b59e4d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:51:22Z,use_quota=True,user_id='562a6d2faf0348ca8423d399f6a33457',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-caf05481-e79f-48a0-824e-2d826eaa5892 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2f1ecc8-87b4-4952-874a-77d6cf985889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-caf05481-e79f-48a0-824e-2d826eaa5892 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2f1ecc8-87b4-4952-874a-77d6cf985889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-caf05481-e79f-48a0-824e-2d826eaa5892 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab4b72d-caf1-4077-85a3-9266edaa5080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-caf05481-e79f-48a0-824e-2d826eaa5892 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab4b72d-caf1-4077-85a3-9266edaa5080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97df73cc-da45-4780-9f7e-cee6ceb4affd', 'volume_name': 'volume-97df73cc-da45-4780-9f7e-cee6ceb4affd', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-caf05481-e79f-48a0-824e-2d826eaa5892 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8ef4ac9-bc65-4cca-b190-425c99828398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-caf05481-e79f-48a0-824e-2d826eaa5892 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8ef4ac9-bc65-4cca-b190-425c99828398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-caf05481-e79f-48a0-824e-2d826eaa5892 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47251a64-59ce-4112-902a-9dbcb42886b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:22 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-caf05481-e79f-48a0-824e-2d826eaa5892 tempest-CreateVolumesFromSnapshotTest-82292396 None] Volume 97df73cc-da45-4780-9f7e-cee6ceb4affd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97df73cc-da45-4780-9f7e-cee6ceb4affd', 'volume_size': 1} Jul 10 06:51:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-caf05481-e79f-48a0-824e-2d826eaa5892 tempest-CreateVolumesFromSnapshotTest-82292396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:22 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7579e46-a2f0-4bbb-b2ae-2979f9110113 tempest-CreateVolumesFromSnapshotTest-82292396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:51:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f7579e46-a2f0-4bbb-b2ae-2979f9110113 tempest-CreateVolumesFromSnapshotTest-82292396 None] Flow 'volume_create_manager' (44df87d7-a516-41ae-85c6-27a7e92b4320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:51:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f7579e46-a2f0-4bbb-b2ae-2979f9110113 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8f70ef6-546a-4d46-9197-3ec9014f2655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f7579e46-a2f0-4bbb-b2ae-2979f9110113 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8f70ef6-546a-4d46-9197-3ec9014f2655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1739257419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d5b7119-a917-4952-ba85-cf6cc90ad1b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d175e49cbb446c19d15cdb84b59e4d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:51:22Z,use_quota=True,user_id='562a6d2faf0348ca8423d399f6a33457',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:22 devstack sudo[102758]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f7579e46-a2f0-4bbb-b2ae-2979f9110113 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (220d8f89-99bb-4ac6-afd3-3809e2119678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f7579e46-a2f0-4bbb-b2ae-2979f9110113 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (220d8f89-99bb-4ac6-afd3-3809e2119678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f7579e46-a2f0-4bbb-b2ae-2979f9110113 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1eebf2a-c80f-4297-a08b-8f8c04a55cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f7579e46-a2f0-4bbb-b2ae-2979f9110113 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1eebf2a-c80f-4297-a08b-8f8c04a55cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d5b7119-a917-4952-ba85-cf6cc90ad1b5', 'volume_name': 'volume-9d5b7119-a917-4952-ba85-cf6cc90ad1b5', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f7579e46-a2f0-4bbb-b2ae-2979f9110113 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (919323ab-394d-40d4-9ed5-1dc7b0b135fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f7579e46-a2f0-4bbb-b2ae-2979f9110113 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (919323ab-394d-40d4-9ed5-1dc7b0b135fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f7579e46-a2f0-4bbb-b2ae-2979f9110113 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99897dad-5788-480b-b479-d3b490c7610b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:22 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-f7579e46-a2f0-4bbb-b2ae-2979f9110113 tempest-CreateVolumesFromSnapshotTest-82292396 None] Volume 9d5b7119-a917-4952-ba85-cf6cc90ad1b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d5b7119-a917-4952-ba85-cf6cc90ad1b5', 'volume_size': 1} Jul 10 06:51:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f7579e46-a2f0-4bbb-b2ae-2979f9110113 tempest-CreateVolumesFromSnapshotTest-82292396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-39889fb4-b91c-49d6-bb75-eb07bbfb1c52 req-c78eda81-f179-485c-a500-2f1d95f3df92 tempest-TestShelveInstance-522639284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b7985d9-0694-4f31-8003-55116f99eb3c" returned: 0 in 1.333s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-39889fb4-b91c-49d6-bb75-eb07bbfb1c52 req-c78eda81-f179-485c-a500-2f1d95f3df92 tempest-TestShelveInstance-522639284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b7985d9-0694-4f31-8003-55116f99eb3c {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:22 devstack sudo[102766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b7985d9-0694-4f31-8003-55116f99eb3c Jul 10 06:51:22 devstack sudo[102766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:23 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.183s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:23 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:51:23 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager._thread_info {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:51:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread count: 28 {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:51:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread info: [<_MainThread(MainThread, started 139245706264704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:51:23 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-085955ab-32cc-472e-8766-87e33f169a94 tempest-CreateVolumesFromSnapshotTest-82292396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:51:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-085955ab-32cc-472e-8766-87e33f169a94 tempest-CreateVolumesFromSnapshotTest-82292396 None] Flow 'volume_create_manager' (4940d7a6-b01c-4350-bf75-02f94611d52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:51:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-085955ab-32cc-472e-8766-87e33f169a94 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1e8fe5a-c720-486a-9be8-68cc7c344d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-085955ab-32cc-472e-8766-87e33f169a94 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1e8fe5a-c720-486a-9be8-68cc7c344d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-324307933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac7254c2-8dce-4f9e-aeef-259c26eada1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d175e49cbb446c19d15cdb84b59e4d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:51:23Z,use_quota=True,user_id='562a6d2faf0348ca8423d399f6a33457',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-085955ab-32cc-472e-8766-87e33f169a94 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6301f421-1ed2-4024-bb40-6a72fc536827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-085955ab-32cc-472e-8766-87e33f169a94 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6301f421-1ed2-4024-bb40-6a72fc536827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-085955ab-32cc-472e-8766-87e33f169a94 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08bab36f-31a2-4b5b-adbc-5ba2929f98a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-085955ab-32cc-472e-8766-87e33f169a94 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08bab36f-31a2-4b5b-adbc-5ba2929f98a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac7254c2-8dce-4f9e-aeef-259c26eada1f', 'volume_name': 'volume-ac7254c2-8dce-4f9e-aeef-259c26eada1f', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-085955ab-32cc-472e-8766-87e33f169a94 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8b428d5-7e6b-4ed2-8e39-15ce36511d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-085955ab-32cc-472e-8766-87e33f169a94 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8b428d5-7e6b-4ed2-8e39-15ce36511d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-085955ab-32cc-472e-8766-87e33f169a94 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b70f53ec-38e7-472b-bb61-0fad488fa5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:23 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-085955ab-32cc-472e-8766-87e33f169a94 tempest-CreateVolumesFromSnapshotTest-82292396 None] Volume ac7254c2-8dce-4f9e-aeef-259c26eada1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac7254c2-8dce-4f9e-aeef-259c26eada1f', 'volume_size': 1} Jul 10 06:51:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-085955ab-32cc-472e-8766-87e33f169a94 tempest-CreateVolumesFromSnapshotTest-82292396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:23 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-48da1faf-628f-484b-a9d1-9c15e94bb15e tempest-VolumesTransfersV355Test-448114818 None] Acquiring lock "cinder-88ef8fe3-6c7e-464a-a759-9892bb6f6134-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:23 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-48da1faf-628f-484b-a9d1-9c15e94bb15e tempest-VolumesTransfersV355Test-448114818 None] Lock "cinder-88ef8fe3-6c7e-464a-a759-9892bb6f6134-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:23 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-48da1faf-628f-484b-a9d1-9c15e94bb15e tempest-VolumesTransfersV355Test-448114818 None] Acquiring lock "cinder-quobyte-88ef8fe3-6c7e-464a-a759-9892bb6f6134" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:23 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-48da1faf-628f-484b-a9d1-9c15e94bb15e tempest-VolumesTransfersV355Test-448114818 None] Lock "cinder-quobyte-88ef8fe3-6c7e-464a-a759-9892bb6f6134" acquired by "delete_volume" :: waited 0.021s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:23 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c042ce-27d2-4f29-90af-f41598f59390]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:51:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-48da1faf-628f-484b-a9d1-9c15e94bb15e tempest-VolumesTransfersV355Test-448114818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-88ef8fe3-6c7e-464a-a759-9892bb6f6134 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:23 devstack sudo[102769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-88ef8fe3-6c7e-464a-a759-9892bb6f6134 Jul 10 06:51:23 devstack sudo[102769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:23 devstack sudo[102766]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-39889fb4-b91c-49d6-bb75-eb07bbfb1c52 req-c78eda81-f179-485c-a500-2f1d95f3df92 tempest-TestShelveInstance-522639284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b7985d9-0694-4f31-8003-55116f99eb3c" returned: 1 in 1.055s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-39889fb4-b91c-49d6-bb75-eb07bbfb1c52 req-c78eda81-f179-485c-a500-2f1d95f3df92 tempest-TestShelveInstance-522639284 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b7985d9-0694-4f31-8003-55116f99eb3c' failed. Not Retrying. {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:51:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-39889fb4-b91c-49d6-bb75-eb07bbfb1c52 req-c78eda81-f179-485c-a500-2f1d95f3df92 tempest-TestShelveInstance-522639284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.491s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-dac5f0bb-e78b-4ffc-86d9-dfcca38caaa4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.835s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:23 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-dac5f0bb-e78b-4ffc-86d9-dfcca38caaa4 tempest-CreateVolumesFromSnapshotTest-82292396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-560389785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d350d57b-67f0-4d5c-af10-955fa96ebf89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d175e49cbb446c19d15cdb84b59e4d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:51:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:51:21Z,use_quota=True,user_id='562a6d2faf0348ca8423d399f6a33457',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:51:23 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-dac5f0bb-e78b-4ffc-86d9-dfcca38caaa4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Creating volume d350d57b-67f0-4d5c-af10-955fa96ebf89 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:51:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-dac5f0bb-e78b-4ffc-86d9-dfcca38caaa4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-dac5f0bb-e78b-4ffc-86d9-dfcca38caaa4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:23 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-dac5f0bb-e78b-4ffc-86d9-dfcca38caaa4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:51:23 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-dac5f0bb-e78b-4ffc-86d9-dfcca38caaa4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:51:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-dac5f0bb-e78b-4ffc-86d9-dfcca38caaa4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:23 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-dac5f0bb-e78b-4ffc-86d9-dfcca38caaa4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:51:23 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-dac5f0bb-e78b-4ffc-86d9-dfcca38caaa4 tempest-CreateVolumesFromSnapshotTest-82292396 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:51:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-dac5f0bb-e78b-4ffc-86d9-dfcca38caaa4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d350d57b-67f0-4d5c-af10-955fa96ebf89 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:23 devstack sudo[102774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d350d57b-67f0-4d5c-af10-955fa96ebf89 1073741824 Jul 10 06:51:23 devstack sudo[102774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-39889fb4-b91c-49d6-bb75-eb07bbfb1c52 req-c78eda81-f179-485c-a500-2f1d95f3df92 tempest-TestShelveInstance-522639284 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804', 'name': 'volume-1b7985d9-0694-4f31-8003-55116f99eb3c', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1be852af-0fb4-4ee2-9d22-84ece1b866ec', 'enforce_multipath': True} {{(pid=87294) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:51:23 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-39889fb4-b91c-49d6-bb75-eb07bbfb1c52 req-c78eda81-f179-485c-a500-2f1d95f3df92 tempest-TestShelveInstance-522639284 None] attachment_update completed successfully. Jul 10 06:51:24 devstack sudo[102769]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-48da1faf-628f-484b-a9d1-9c15e94bb15e tempest-VolumesTransfersV355Test-448114818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-88ef8fe3-6c7e-464a-a759-9892bb6f6134" returned: 0 in 0.903s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-48da1faf-628f-484b-a9d1-9c15e94bb15e tempest-VolumesTransfersV355Test-448114818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-88ef8fe3-6c7e-464a-a759-9892bb6f6134 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:24 devstack sudo[102779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-88ef8fe3-6c7e-464a-a759-9892bb6f6134 Jul 10 06:51:24 devstack sudo[102779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:24 devstack sudo[102774]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-dac5f0bb-e78b-4ffc-86d9-dfcca38caaa4 tempest-CreateVolumesFromSnapshotTest-82292396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d350d57b-67f0-4d5c-af10-955fa96ebf89 1073741824" returned: 0 in 1.073s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-dac5f0bb-e78b-4ffc-86d9-dfcca38caaa4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d350d57b-67f0-4d5c-af10-955fa96ebf89 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:24 devstack sudo[102787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d350d57b-67f0-4d5c-af10-955fa96ebf89 Jul 10 06:51:24 devstack sudo[102787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-48da1faf-628f-484b-a9d1-9c15e94bb15e tempest-VolumesTransfersV355Test-448114818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-88ef8fe3-6c7e-464a-a759-9892bb6f6134" returned: 0 in 0.746s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:24 devstack sudo[102779]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:25 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-48da1faf-628f-484b-a9d1-9c15e94bb15e tempest-VolumesTransfersV355Test-448114818 None] Lock "cinder-quobyte-88ef8fe3-6c7e-464a-a759-9892bb6f6134" released by "delete_volume" :: held 1.704s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:51:25 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-48da1faf-628f-484b-a9d1-9c15e94bb15e tempest-VolumesTransfersV355Test-448114818 None] Created reservations ['05bdc1ce-f84e-4dd6-aa06-7acd683c047c', '7c8c9b96-be65-40e8-ba04-4bf72135a4b5', 'af9fd981-afe2-4d27-bf7b-15010f51440c', '2d69c764-da83-4a3f-9aaf-bce5418fdf3a'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:51:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-48da1faf-628f-484b-a9d1-9c15e94bb15e tempest-VolumesTransfersV355Test-448114818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-48da1faf-628f-484b-a9d1-9c15e94bb15e tempest-VolumesTransfersV355Test-448114818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:25 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-48da1faf-628f-484b-a9d1-9c15e94bb15e tempest-VolumesTransfersV355Test-448114818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:51:25 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-48da1faf-628f-484b-a9d1-9c15e94bb15e tempest-VolumesTransfersV355Test-448114818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:51:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-48da1faf-628f-484b-a9d1-9c15e94bb15e tempest-VolumesTransfersV355Test-448114818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-48da1faf-628f-484b-a9d1-9c15e94bb15e tempest-VolumesTransfersV355Test-448114818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:25 devstack sudo[102789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:51:25 devstack sudo[102789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:25 devstack sudo[102787]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-dac5f0bb-e78b-4ffc-86d9-dfcca38caaa4 tempest-CreateVolumesFromSnapshotTest-82292396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d350d57b-67f0-4d5c-af10-955fa96ebf89" returned: 0 in 0.900s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:25 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-dac5f0bb-e78b-4ffc-86d9-dfcca38caaa4 tempest-CreateVolumesFromSnapshotTest-82292396 None] <== create_volume: return (2024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:51:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-dac5f0bb-e78b-4ffc-86d9-dfcca38caaa4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.028s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-16c1f664-3666-469e-a353-6246191e72ab tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.252s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:25 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-16c1f664-3666-469e-a353-6246191e72ab tempest-CreateVolumesFromSnapshotTest-82292396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1276906282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56dd810f-ea88-4ce2-b55c-5db4027e1eb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d175e49cbb446c19d15cdb84b59e4d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:51:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:51:21Z,use_quota=True,user_id='562a6d2faf0348ca8423d399f6a33457',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:51:25 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-16c1f664-3666-469e-a353-6246191e72ab tempest-CreateVolumesFromSnapshotTest-82292396 None] Creating volume 56dd810f-ea88-4ce2-b55c-5db4027e1eb2 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:51:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-16c1f664-3666-469e-a353-6246191e72ab tempest-CreateVolumesFromSnapshotTest-82292396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-16c1f664-3666-469e-a353-6246191e72ab tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:25 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-16c1f664-3666-469e-a353-6246191e72ab tempest-CreateVolumesFromSnapshotTest-82292396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:51:25 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-16c1f664-3666-469e-a353-6246191e72ab tempest-CreateVolumesFromSnapshotTest-82292396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:51:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-16c1f664-3666-469e-a353-6246191e72ab tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:25 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-16c1f664-3666-469e-a353-6246191e72ab tempest-CreateVolumesFromSnapshotTest-82292396 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:51:25 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-16c1f664-3666-469e-a353-6246191e72ab tempest-CreateVolumesFromSnapshotTest-82292396 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:51:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-16c1f664-3666-469e-a353-6246191e72ab tempest-CreateVolumesFromSnapshotTest-82292396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-56dd810f-ea88-4ce2-b55c-5db4027e1eb2 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:25 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dac5f0bb-e78b-4ffc-86d9-dfcca38caaa4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7091f925-0cf5-434d-a770-2333757589ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d350d57b-67f0-4d5c-af10-955fa96ebf89', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:25 devstack sudo[102792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-56dd810f-ea88-4ce2-b55c-5db4027e1eb2 1073741824 Jul 10 06:51:25 devstack sudo[102792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:25 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dac5f0bb-e78b-4ffc-86d9-dfcca38caaa4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43c7e65b-6c9b-4d46-a6ab-b23df6a16c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:25 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-dac5f0bb-e78b-4ffc-86d9-dfcca38caaa4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Volume volume-d350d57b-67f0-4d5c-af10-955fa96ebf89 (d350d57b-67f0-4d5c-af10-955fa96ebf89): created successfully Jul 10 06:51:25 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dac5f0bb-e78b-4ffc-86d9-dfcca38caaa4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43c7e65b-6c9b-4d46-a6ab-b23df6a16c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:25 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dac5f0bb-e78b-4ffc-86d9-dfcca38caaa4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Flow 'volume_create_manager' (ef31cbe4-085d-43df-aa4f-05320b303097) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:51:25 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-dac5f0bb-e78b-4ffc-86d9-dfcca38caaa4 tempest-CreateVolumesFromSnapshotTest-82292396 None] Created volume successfully. Jul 10 06:51:26 devstack sudo[102789]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-48da1faf-628f-484b-a9d1-9c15e94bb15e tempest-VolumesTransfersV355Test-448114818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.888s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:26 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-48da1faf-628f-484b-a9d1-9c15e94bb15e tempest-VolumesTransfersV355Test-448114818 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:51:26 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-48da1faf-628f-484b-a9d1-9c15e94bb15e tempest-VolumesTransfersV355Test-448114818 None] Deleted volume successfully. Jul 10 06:51:26 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-48da1faf-628f-484b-a9d1-9c15e94bb15e tempest-VolumesTransfersV355Test-448114818 None] Lock "cinder-88ef8fe3-6c7e-464a-a759-9892bb6f6134-delete_volume" released by "delete_volume" :: held 2.863s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:51:26 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:51:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Flow 'volume_create_manager' (76e0714b-9661-419f-b019-78da63a972f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:51:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (399160ca-0cf1-4bc7-90be-2137be75e7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (399160ca-0cf1-4bc7-90be-2137be75e7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7de6427a-7b64-4df5-ae2e-c6d5438d4f47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f2b5edba70841968d06455a75b13e94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:51:27Z,use_quota=True,user_id='6592a304320c4ff68ed23038a0957718',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ca25e47-e82f-4f4a-9b96-68deb3be91da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ca25e47-e82f-4f4a-9b96-68deb3be91da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9ed6d33-edbe-44b4-869e-abd16f4dea18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:26 devstack cinder-volume[87294]: DEBUG cinder.image.glance [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Creating Keystone auth plugin from conf {{(pid=87294) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 06:51:26 devstack sudo[102792]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-16c1f664-3666-469e-a353-6246191e72ab tempest-CreateVolumesFromSnapshotTest-82292396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-56dd810f-ea88-4ce2-b55c-5db4027e1eb2 1073741824" returned: 0 in 1.164s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-16c1f664-3666-469e-a353-6246191e72ab tempest-CreateVolumesFromSnapshotTest-82292396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-56dd810f-ea88-4ce2-b55c-5db4027e1eb2 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:27 devstack sudo[102799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-56dd810f-ea88-4ce2-b55c-5db4027e1eb2 Jul 10 06:51:27 devstack sudo[102799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9ed6d33-edbe-44b4-869e-abd16f4dea18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7de6427a-7b64-4df5-ae2e-c6d5438d4f47', 'volume_name': 'volume-7de6427a-7b64-4df5-ae2e-c6d5438d4f47', 'volume_size': 1, 'image_id': '12b1428b-fef1-4e7c-8711-b89c262b87ba', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/12b1428b-fef1-4e7c-8711-b89c262b87ba', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8150094bdec1427af84ed81a98da2fb1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5f2b5edba70841968d06455a75b13e94', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6da318a02d0856e7a5e6453c4270b13cac97eee700a2d145d56563792b6cc3ffa973d05ca3ebf543ea422170516c2e6329e84f22806c220dff5334c3412fa4b8', 'id': '12b1428b-fef1-4e7c-8711-b89c262b87ba', 'created_at': datetime.datetime(2026, 7, 10, 4, 51, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 51, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/12b1428b-fef1-4e7c-8711-b89c262b87ba/file', 'properties': {}}, 'image_service': }' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (357221b8-8b43-4799-a174-27f20d2f899c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (357221b8-8b43-4799-a174-27f20d2f899c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f6fe38d-930d-41b4-b585-3a1034afb48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:27 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Volume 7de6427a-7b64-4df5-ae2e-c6d5438d4f47: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7de6427a-7b64-4df5-ae2e-c6d5438d4f47', 'volume_size': 1, 'image_id': '12b1428b-fef1-4e7c-8711-b89c262b87ba', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/12b1428b-fef1-4e7c-8711-b89c262b87ba', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8150094bdec1427af84ed81a98da2fb1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5f2b5edba70841968d06455a75b13e94', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6da318a02d0856e7a5e6453c4270b13cac97eee700a2d145d56563792b6cc3ffa973d05ca3ebf543ea422170516c2e6329e84f22806c220dff5334c3412fa4b8', 'id': '12b1428b-fef1-4e7c-8711-b89c262b87ba', 'created_at': datetime.datetime(2026, 7, 10, 4, 51, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 51, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/12b1428b-fef1-4e7c-8711-b89c262b87ba/file', 'properties': {}}, 'image_service': } Jul 10 06:51:27 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Trying to clone 7de6427a-7b64-4df5-ae2e-c6d5438d4f47 from image 12b1428b-fef1-4e7c-8711-b89c262b87ba at location (None, [{'url': 'file:///opt/stack/data/glance/images/12b1428b-fef1-4e7c-8711-b89c262b87ba', 'metadata': {}}]). {{(pid=87294) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 06:51:27 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_12b1428b-fef1-4e7c-8711-b89c262b87ba_es9cqoetdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87294) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 06:51:27 devstack cinder-volume[87294]: INFO cinder.image.image_utils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Image download 0.00 MB at 0.00 MB/s Jul 10 06:51:27 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c7e397-2a31-443d-924b-0c7ae49a0a3e]: (4, 'raw') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:51:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_12b1428b-fef1-4e7c-8711-b89c262b87ba_es9cqoetdevstack@QuobyteHD {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:27 devstack sudo[102801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_12b1428b-fef1-4e7c-8711-b89c262b87ba_es9cqoetdevstack@QuobyteHD Jul 10 06:51:27 devstack sudo[102801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:27 devstack sudo[102799]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-16c1f664-3666-469e-a353-6246191e72ab tempest-CreateVolumesFromSnapshotTest-82292396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-56dd810f-ea88-4ce2-b55c-5db4027e1eb2" returned: 0 in 0.764s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:27 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-16c1f664-3666-469e-a353-6246191e72ab tempest-CreateVolumesFromSnapshotTest-82292396 None] <== create_volume: return (2000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:51:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-16c1f664-3666-469e-a353-6246191e72ab tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.004s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-caf05481-e79f-48a0-824e-2d826eaa5892 tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.669s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:27 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-caf05481-e79f-48a0-824e-2d826eaa5892 tempest-CreateVolumesFromSnapshotTest-82292396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1843876769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97df73cc-da45-4780-9f7e-cee6ceb4affd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d175e49cbb446c19d15cdb84b59e4d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:51:22Z,use_quota=True,user_id='562a6d2faf0348ca8423d399f6a33457',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:51:27 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-caf05481-e79f-48a0-824e-2d826eaa5892 tempest-CreateVolumesFromSnapshotTest-82292396 None] Creating volume 97df73cc-da45-4780-9f7e-cee6ceb4affd {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:51:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-caf05481-e79f-48a0-824e-2d826eaa5892 tempest-CreateVolumesFromSnapshotTest-82292396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-caf05481-e79f-48a0-824e-2d826eaa5892 tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:27 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-caf05481-e79f-48a0-824e-2d826eaa5892 tempest-CreateVolumesFromSnapshotTest-82292396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:51:27 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-caf05481-e79f-48a0-824e-2d826eaa5892 tempest-CreateVolumesFromSnapshotTest-82292396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:51:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-caf05481-e79f-48a0-824e-2d826eaa5892 tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:27 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-caf05481-e79f-48a0-824e-2d826eaa5892 tempest-CreateVolumesFromSnapshotTest-82292396 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:51:27 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-caf05481-e79f-48a0-824e-2d826eaa5892 tempest-CreateVolumesFromSnapshotTest-82292396 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:51:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-caf05481-e79f-48a0-824e-2d826eaa5892 tempest-CreateVolumesFromSnapshotTest-82292396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-97df73cc-da45-4780-9f7e-cee6ceb4affd 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-16c1f664-3666-469e-a353-6246191e72ab tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ba08694-a336-43c2-a54a-a7442f8c831e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56dd810f-ea88-4ce2-b55c-5db4027e1eb2', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:27 devstack sudo[102804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-97df73cc-da45-4780-9f7e-cee6ceb4affd 1073741824 Jul 10 06:51:27 devstack sudo[102804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-16c1f664-3666-469e-a353-6246191e72ab tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f77c0080-7c5c-44c6-8a06-fd1c12022df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:27 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-16c1f664-3666-469e-a353-6246191e72ab tempest-CreateVolumesFromSnapshotTest-82292396 None] Volume volume-56dd810f-ea88-4ce2-b55c-5db4027e1eb2 (56dd810f-ea88-4ce2-b55c-5db4027e1eb2): created successfully Jul 10 06:51:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-16c1f664-3666-469e-a353-6246191e72ab tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f77c0080-7c5c-44c6-8a06-fd1c12022df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-16c1f664-3666-469e-a353-6246191e72ab tempest-CreateVolumesFromSnapshotTest-82292396 None] Flow 'volume_create_manager' (ab6a8ac8-7466-4137-9e0b-49370840a25a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:51:27 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-16c1f664-3666-469e-a353-6246191e72ab tempest-CreateVolumesFromSnapshotTest-82292396 None] Created volume successfully. Jul 10 06:51:28 devstack sudo[102801]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_12b1428b-fef1-4e7c-8711-b89c262b87ba_es9cqoetdevstack@QuobyteHD" returned: 0 in 0.891s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_12b1428b-fef1-4e7c-8711-b89c262b87ba_es9cqoetdevstack@QuobyteHD {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:28 devstack sudo[102808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_12b1428b-fef1-4e7c-8711-b89c262b87ba_es9cqoetdevstack@QuobyteHD Jul 10 06:51:28 devstack sudo[102808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:28 devstack sudo[102804]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-caf05481-e79f-48a0-824e-2d826eaa5892 tempest-CreateVolumesFromSnapshotTest-82292396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-97df73cc-da45-4780-9f7e-cee6ceb4affd 1073741824" returned: 0 in 1.063s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-caf05481-e79f-48a0-824e-2d826eaa5892 tempest-CreateVolumesFromSnapshotTest-82292396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-97df73cc-da45-4780-9f7e-cee6ceb4affd {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:29 devstack sudo[102816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-97df73cc-da45-4780-9f7e-cee6ceb4affd Jul 10 06:51:29 devstack sudo[102816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:29 devstack sudo[102808]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_12b1428b-fef1-4e7c-8711-b89c262b87ba_es9cqoetdevstack@QuobyteHD" returned: 1 in 0.947s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_12b1428b-fef1-4e7c-8711-b89c262b87ba_es9cqoetdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:51:29 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Temporary image 12b1428b-fef1-4e7c-8711-b89c262b87ba is fetched for user 6592a304320c4ff68ed23038a0957718. {{(pid=87294) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 06:51:29 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ad7541-fe8b-4b87-8735-b25e3bb28fc3]: (4, 'raw') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:51:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_12b1428b-fef1-4e7c-8711-b89c262b87ba_es9cqoetdevstack@QuobyteHD {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:29 devstack sudo[102821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_12b1428b-fef1-4e7c-8711-b89c262b87ba_es9cqoetdevstack@QuobyteHD Jul 10 06:51:29 devstack sudo[102821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:29 devstack sudo[102816]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-caf05481-e79f-48a0-824e-2d826eaa5892 tempest-CreateVolumesFromSnapshotTest-82292396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-97df73cc-da45-4780-9f7e-cee6ceb4affd" returned: 0 in 0.941s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:29 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-caf05481-e79f-48a0-824e-2d826eaa5892 tempest-CreateVolumesFromSnapshotTest-82292396 None] <== create_volume: return (2094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:51:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-caf05481-e79f-48a0-824e-2d826eaa5892 tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.097s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f7579e46-a2f0-4bbb-b2ae-2979f9110113 tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.212s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:29 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f7579e46-a2f0-4bbb-b2ae-2979f9110113 tempest-CreateVolumesFromSnapshotTest-82292396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1739257419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d5b7119-a917-4952-ba85-cf6cc90ad1b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d175e49cbb446c19d15cdb84b59e4d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:51:22Z,use_quota=True,user_id='562a6d2faf0348ca8423d399f6a33457',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:51:29 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-f7579e46-a2f0-4bbb-b2ae-2979f9110113 tempest-CreateVolumesFromSnapshotTest-82292396 None] Creating volume 9d5b7119-a917-4952-ba85-cf6cc90ad1b5 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:51:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f7579e46-a2f0-4bbb-b2ae-2979f9110113 tempest-CreateVolumesFromSnapshotTest-82292396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f7579e46-a2f0-4bbb-b2ae-2979f9110113 tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:29 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f7579e46-a2f0-4bbb-b2ae-2979f9110113 tempest-CreateVolumesFromSnapshotTest-82292396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:51:29 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f7579e46-a2f0-4bbb-b2ae-2979f9110113 tempest-CreateVolumesFromSnapshotTest-82292396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:51:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f7579e46-a2f0-4bbb-b2ae-2979f9110113 tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:29 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f7579e46-a2f0-4bbb-b2ae-2979f9110113 tempest-CreateVolumesFromSnapshotTest-82292396 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:51:29 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-f7579e46-a2f0-4bbb-b2ae-2979f9110113 tempest-CreateVolumesFromSnapshotTest-82292396 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:51:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f7579e46-a2f0-4bbb-b2ae-2979f9110113 tempest-CreateVolumesFromSnapshotTest-82292396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d5b7119-a917-4952-ba85-cf6cc90ad1b5 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:29 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-caf05481-e79f-48a0-824e-2d826eaa5892 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47251a64-59ce-4112-902a-9dbcb42886b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97df73cc-da45-4780-9f7e-cee6ceb4affd', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:29 devstack sudo[102825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d5b7119-a917-4952-ba85-cf6cc90ad1b5 1073741824 Jul 10 06:51:29 devstack sudo[102825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:29 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-caf05481-e79f-48a0-824e-2d826eaa5892 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f291973-0c0b-4ed0-a91a-edf6f7ff20de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:30 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-caf05481-e79f-48a0-824e-2d826eaa5892 tempest-CreateVolumesFromSnapshotTest-82292396 None] Volume volume-97df73cc-da45-4780-9f7e-cee6ceb4affd (97df73cc-da45-4780-9f7e-cee6ceb4affd): created successfully Jul 10 06:51:30 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-caf05481-e79f-48a0-824e-2d826eaa5892 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f291973-0c0b-4ed0-a91a-edf6f7ff20de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:30 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-caf05481-e79f-48a0-824e-2d826eaa5892 tempest-CreateVolumesFromSnapshotTest-82292396 None] Flow 'volume_create_manager' (5c66b42c-50f3-4764-a2b2-12482753af75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:51:30 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-caf05481-e79f-48a0-824e-2d826eaa5892 tempest-CreateVolumesFromSnapshotTest-82292396 None] Created volume successfully. Jul 10 06:51:30 devstack sudo[102821]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_12b1428b-fef1-4e7c-8711-b89c262b87ba_es9cqoetdevstack@QuobyteHD" returned: 0 in 1.075s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_12b1428b-fef1-4e7c-8711-b89c262b87ba_es9cqoetdevstack@QuobyteHD {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:30 devstack sudo[102830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_12b1428b-fef1-4e7c-8711-b89c262b87ba_es9cqoetdevstack@QuobyteHD Jul 10 06:51:30 devstack sudo[102830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:31 devstack sudo[102825]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f7579e46-a2f0-4bbb-b2ae-2979f9110113 tempest-CreateVolumesFromSnapshotTest-82292396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d5b7119-a917-4952-ba85-cf6cc90ad1b5 1073741824" returned: 0 in 1.300s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f7579e46-a2f0-4bbb-b2ae-2979f9110113 tempest-CreateVolumesFromSnapshotTest-82292396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d5b7119-a917-4952-ba85-cf6cc90ad1b5 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:31 devstack sudo[102839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d5b7119-a917-4952-ba85-cf6cc90ad1b5 Jul 10 06:51:31 devstack sudo[102839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:31 devstack sudo[102830]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_12b1428b-fef1-4e7c-8711-b89c262b87ba_es9cqoetdevstack@QuobyteHD" returned: 1 in 1.014s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_12b1428b-fef1-4e7c-8711-b89c262b87ba_es9cqoetdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:51:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:32 devstack sudo[102839]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f7579e46-a2f0-4bbb-b2ae-2979f9110113 tempest-CreateVolumesFromSnapshotTest-82292396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d5b7119-a917-4952-ba85-cf6cc90ad1b5" returned: 0 in 0.743s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:32 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f7579e46-a2f0-4bbb-b2ae-2979f9110113 tempest-CreateVolumesFromSnapshotTest-82292396 None] <== create_volume: return (2102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:51:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f7579e46-a2f0-4bbb-b2ae-2979f9110113 tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.106s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-085955ab-32cc-472e-8766-87e33f169a94 tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.809s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:32 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-085955ab-32cc-472e-8766-87e33f169a94 tempest-CreateVolumesFromSnapshotTest-82292396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-324307933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac7254c2-8dce-4f9e-aeef-259c26eada1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d175e49cbb446c19d15cdb84b59e4d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:51:23Z,use_quota=True,user_id='562a6d2faf0348ca8423d399f6a33457',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:51:32 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-085955ab-32cc-472e-8766-87e33f169a94 tempest-CreateVolumesFromSnapshotTest-82292396 None] Creating volume ac7254c2-8dce-4f9e-aeef-259c26eada1f {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:51:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-085955ab-32cc-472e-8766-87e33f169a94 tempest-CreateVolumesFromSnapshotTest-82292396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-085955ab-32cc-472e-8766-87e33f169a94 tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:32 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-085955ab-32cc-472e-8766-87e33f169a94 tempest-CreateVolumesFromSnapshotTest-82292396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:51:32 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-085955ab-32cc-472e-8766-87e33f169a94 tempest-CreateVolumesFromSnapshotTest-82292396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:51:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-085955ab-32cc-472e-8766-87e33f169a94 tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:32 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-085955ab-32cc-472e-8766-87e33f169a94 tempest-CreateVolumesFromSnapshotTest-82292396 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:51:32 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-085955ab-32cc-472e-8766-87e33f169a94 tempest-CreateVolumesFromSnapshotTest-82292396 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:51:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-085955ab-32cc-472e-8766-87e33f169a94 tempest-CreateVolumesFromSnapshotTest-82292396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ac7254c2-8dce-4f9e-aeef-259c26eada1f 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:32 devstack sudo[102848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ac7254c2-8dce-4f9e-aeef-259c26eada1f 1073741824 Jul 10 06:51:32 devstack sudo[102848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:32 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f7579e46-a2f0-4bbb-b2ae-2979f9110113 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99897dad-5788-480b-b479-d3b490c7610b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d5b7119-a917-4952-ba85-cf6cc90ad1b5', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:32 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f7579e46-a2f0-4bbb-b2ae-2979f9110113 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74ddb98a-7e59-4c09-b352-942e2c2912c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:32 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-f7579e46-a2f0-4bbb-b2ae-2979f9110113 tempest-CreateVolumesFromSnapshotTest-82292396 None] Volume volume-9d5b7119-a917-4952-ba85-cf6cc90ad1b5 (9d5b7119-a917-4952-ba85-cf6cc90ad1b5): created successfully Jul 10 06:51:32 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f7579e46-a2f0-4bbb-b2ae-2979f9110113 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74ddb98a-7e59-4c09-b352-942e2c2912c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:32 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f7579e46-a2f0-4bbb-b2ae-2979f9110113 tempest-CreateVolumesFromSnapshotTest-82292396 None] Flow 'volume_create_manager' (44df87d7-a516-41ae-85c6-27a7e92b4320) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:51:32 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-f7579e46-a2f0-4bbb-b2ae-2979f9110113 tempest-CreateVolumesFromSnapshotTest-82292396 None] Created volume successfully. Jul 10 06:51:33 devstack sudo[102848]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-085955ab-32cc-472e-8766-87e33f169a94 tempest-CreateVolumesFromSnapshotTest-82292396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ac7254c2-8dce-4f9e-aeef-259c26eada1f 1073741824" returned: 0 in 1.056s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-085955ab-32cc-472e-8766-87e33f169a94 tempest-CreateVolumesFromSnapshotTest-82292396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ac7254c2-8dce-4f9e-aeef-259c26eada1f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:33 devstack sudo[102921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ac7254c2-8dce-4f9e-aeef-259c26eada1f Jul 10 06:51:33 devstack sudo[102921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:33 devstack sudo[102921]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-085955ab-32cc-472e-8766-87e33f169a94 tempest-CreateVolumesFromSnapshotTest-82292396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ac7254c2-8dce-4f9e-aeef-259c26eada1f" returned: 0 in 0.694s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:33 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-085955ab-32cc-472e-8766-87e33f169a94 tempest-CreateVolumesFromSnapshotTest-82292396 None] <== create_volume: return (1816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:51:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-085955ab-32cc-472e-8766-87e33f169a94 tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.819s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.474s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:33 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7de6427a-7b64-4df5-ae2e-c6d5438d4f47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f2b5edba70841968d06455a75b13e94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:51:27Z,use_quota=True,user_id='6592a304320c4ff68ed23038a0957718',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:51:33 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Creating volume 7de6427a-7b64-4df5-ae2e-c6d5438d4f47 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:51:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:33 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:51:33 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:51:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:33 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:51:33 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:51:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7de6427a-7b64-4df5-ae2e-c6d5438d4f47 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:33 devstack sudo[102924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7de6427a-7b64-4df5-ae2e-c6d5438d4f47 1073741824 Jul 10 06:51:33 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-085955ab-32cc-472e-8766-87e33f169a94 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b70f53ec-38e7-472b-bb61-0fad488fa5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac7254c2-8dce-4f9e-aeef-259c26eada1f', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:33 devstack sudo[102924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:33 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-085955ab-32cc-472e-8766-87e33f169a94 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d1bf728-f00a-429d-b95b-1bcc41e266ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:33 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-085955ab-32cc-472e-8766-87e33f169a94 tempest-CreateVolumesFromSnapshotTest-82292396 None] Volume volume-ac7254c2-8dce-4f9e-aeef-259c26eada1f (ac7254c2-8dce-4f9e-aeef-259c26eada1f): created successfully Jul 10 06:51:33 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-085955ab-32cc-472e-8766-87e33f169a94 tempest-CreateVolumesFromSnapshotTest-82292396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d1bf728-f00a-429d-b95b-1bcc41e266ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:33 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-085955ab-32cc-472e-8766-87e33f169a94 tempest-CreateVolumesFromSnapshotTest-82292396 None] Flow 'volume_create_manager' (4940d7a6-b01c-4350-bf75-02f94611d52f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:51:34 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-085955ab-32cc-472e-8766-87e33f169a94 tempest-CreateVolumesFromSnapshotTest-82292396 None] Created volume successfully. Jul 10 06:51:34 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-20a8abad-45be-46bc-81f4-f7665e51f03a tempest-CreateVolumesFromSnapshotTest-82292396 None] Acquiring lock "cinder-ac7254c2-8dce-4f9e-aeef-259c26eada1f-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:34 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-20a8abad-45be-46bc-81f4-f7665e51f03a tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "cinder-ac7254c2-8dce-4f9e-aeef-259c26eada1f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:34 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-20a8abad-45be-46bc-81f4-f7665e51f03a tempest-CreateVolumesFromSnapshotTest-82292396 None] Acquiring lock "cinder-quobyte-ac7254c2-8dce-4f9e-aeef-259c26eada1f" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:34 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-20a8abad-45be-46bc-81f4-f7665e51f03a tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "cinder-quobyte-ac7254c2-8dce-4f9e-aeef-259c26eada1f" acquired by "delete_volume" :: waited 0.030s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:34 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5726c10-58f3-4f82-a9bc-caa9bcd58b79]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:51:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-20a8abad-45be-46bc-81f4-f7665e51f03a tempest-CreateVolumesFromSnapshotTest-82292396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ac7254c2-8dce-4f9e-aeef-259c26eada1f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:34 devstack sudo[102959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ac7254c2-8dce-4f9e-aeef-259c26eada1f Jul 10 06:51:34 devstack sudo[102959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:35 devstack sudo[102924]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7de6427a-7b64-4df5-ae2e-c6d5438d4f47 1073741824" returned: 0 in 1.427s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7de6427a-7b64-4df5-ae2e-c6d5438d4f47 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:35 devstack sudo[102977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7de6427a-7b64-4df5-ae2e-c6d5438d4f47 Jul 10 06:51:35 devstack sudo[102977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:35 devstack sudo[102959]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-20a8abad-45be-46bc-81f4-f7665e51f03a tempest-CreateVolumesFromSnapshotTest-82292396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ac7254c2-8dce-4f9e-aeef-259c26eada1f" returned: 0 in 1.051s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-20a8abad-45be-46bc-81f4-f7665e51f03a tempest-CreateVolumesFromSnapshotTest-82292396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ac7254c2-8dce-4f9e-aeef-259c26eada1f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:35 devstack sudo[102990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ac7254c2-8dce-4f9e-aeef-259c26eada1f Jul 10 06:51:35 devstack sudo[102990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:36 devstack sudo[102977]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7de6427a-7b64-4df5-ae2e-c6d5438d4f47" returned: 0 in 0.922s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:36 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] <== create_volume: return (2405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:51:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.408s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:36 devstack cinder-volume[87294]: DEBUG cinder.volume.volume_utils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Attempting download of 12b1428b-fef1-4e7c-8711-b89c262b87ba ((None, [{'url': 'file:///opt/stack/data/glance/images/12b1428b-fef1-4e7c-8711-b89c262b87ba', 'metadata': {}}])) to volume 7de6427a-7b64-4df5-ae2e-c6d5438d4f47. {{(pid=87294) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 06:51:36 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47def7d-a649-4dc2-9498-8baa0eff2ca3]: (4, 'raw') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:51:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_12b1428b-fef1-4e7c-8711-b89c262b87ba_jn6bkk2c {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:36 devstack sudo[102990]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-20a8abad-45be-46bc-81f4-f7665e51f03a tempest-CreateVolumesFromSnapshotTest-82292396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-ac7254c2-8dce-4f9e-aeef-259c26eada1f" returned: 0 in 0.941s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:36 devstack sudo[103318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_12b1428b-fef1-4e7c-8711-b89c262b87ba_jn6bkk2c Jul 10 06:51:36 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:36 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-20a8abad-45be-46bc-81f4-f7665e51f03a tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "cinder-quobyte-ac7254c2-8dce-4f9e-aeef-259c26eada1f" released by "delete_volume" :: held 2.054s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:51:36 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-20a8abad-45be-46bc-81f4-f7665e51f03a tempest-CreateVolumesFromSnapshotTest-82292396 None] Created reservations ['477dc079-7602-44c8-9cd2-7a71441f724e', '88ec129d-d919-4105-956a-ae36d1ba2665', 'ab8999f3-3a38-4e37-9357-b87e280f639b', 'fdfc58a7-9b88-4def-b807-0376aa06251a'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:51:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-20a8abad-45be-46bc-81f4-f7665e51f03a tempest-CreateVolumesFromSnapshotTest-82292396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-20a8abad-45be-46bc-81f4-f7665e51f03a tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:36 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-20a8abad-45be-46bc-81f4-f7665e51f03a tempest-CreateVolumesFromSnapshotTest-82292396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:51:36 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-20a8abad-45be-46bc-81f4-f7665e51f03a tempest-CreateVolumesFromSnapshotTest-82292396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:51:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-20a8abad-45be-46bc-81f4-f7665e51f03a tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-20a8abad-45be-46bc-81f4-f7665e51f03a tempest-CreateVolumesFromSnapshotTest-82292396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:36 devstack sudo[103321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:51:36 devstack sudo[103321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:37 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_12b1428b-fef1-4e7c-8711-b89c262b87ba_jn6bkk2c" returned: 0 in 1.239s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_12b1428b-fef1-4e7c-8711-b89c262b87ba_jn6bkk2c {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:37 devstack sudo[103321]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-20a8abad-45be-46bc-81f4-f7665e51f03a tempest-CreateVolumesFromSnapshotTest-82292396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.968s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:37 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-20a8abad-45be-46bc-81f4-f7665e51f03a tempest-CreateVolumesFromSnapshotTest-82292396 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:51:37 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-20a8abad-45be-46bc-81f4-f7665e51f03a tempest-CreateVolumesFromSnapshotTest-82292396 None] Deleted volume successfully. Jul 10 06:51:37 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-20a8abad-45be-46bc-81f4-f7665e51f03a tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "cinder-ac7254c2-8dce-4f9e-aeef-259c26eada1f-delete_volume" released by "delete_volume" :: held 3.395s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:51:37 devstack sudo[103327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_12b1428b-fef1-4e7c-8711-b89c262b87ba_jn6bkk2c Jul 10 06:51:37 devstack sudo[103327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:37 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-9a1146e8-db7a-4180-b54f-069397eda9cf tempest-CreateVolumesFromSnapshotTest-82292396 None] Acquiring lock "cinder-9d5b7119-a917-4952-ba85-cf6cc90ad1b5-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:38 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-9a1146e8-db7a-4180-b54f-069397eda9cf tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "cinder-9d5b7119-a917-4952-ba85-cf6cc90ad1b5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:38 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-9a1146e8-db7a-4180-b54f-069397eda9cf tempest-CreateVolumesFromSnapshotTest-82292396 None] Acquiring lock "cinder-quobyte-9d5b7119-a917-4952-ba85-cf6cc90ad1b5" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:38 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-9a1146e8-db7a-4180-b54f-069397eda9cf tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "cinder-quobyte-9d5b7119-a917-4952-ba85-cf6cc90ad1b5" acquired by "delete_volume" :: waited 0.023s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:38 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b41321-02ab-4a60-94e3-80323eaead34]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:51:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9a1146e8-db7a-4180-b54f-069397eda9cf tempest-CreateVolumesFromSnapshotTest-82292396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d5b7119-a917-4952-ba85-cf6cc90ad1b5 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:38 devstack sudo[103330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d5b7119-a917-4952-ba85-cf6cc90ad1b5 Jul 10 06:51:38 devstack sudo[103330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:38 devstack sudo[103327]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_12b1428b-fef1-4e7c-8711-b89c262b87ba_jn6bkk2c" returned: 1 in 1.084s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_12b1428b-fef1-4e7c-8711-b89c262b87ba_jn6bkk2c' failed. Not Retrying. {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:51:38 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[4099430b-6656-405c-b924-4528d9f7f009]: (4, 'raw') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:51:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_12b1428b-fef1-4e7c-8711-b89c262b87ba_es9cqoetdevstack@QuobyteHD {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:38 devstack sudo[103334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_12b1428b-fef1-4e7c-8711-b89c262b87ba_es9cqoetdevstack@QuobyteHD Jul 10 06:51:38 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:39 devstack sudo[103330]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9a1146e8-db7a-4180-b54f-069397eda9cf tempest-CreateVolumesFromSnapshotTest-82292396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d5b7119-a917-4952-ba85-cf6cc90ad1b5" returned: 0 in 0.993s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9a1146e8-db7a-4180-b54f-069397eda9cf tempest-CreateVolumesFromSnapshotTest-82292396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d5b7119-a917-4952-ba85-cf6cc90ad1b5 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:39 devstack sudo[103339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d5b7119-a917-4952-ba85-cf6cc90ad1b5 Jul 10 06:51:39 devstack sudo[103339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:39 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_12b1428b-fef1-4e7c-8711-b89c262b87ba_es9cqoetdevstack@QuobyteHD" returned: 0 in 0.886s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_12b1428b-fef1-4e7c-8711-b89c262b87ba_es9cqoetdevstack@QuobyteHD {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:39 devstack sudo[103343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_12b1428b-fef1-4e7c-8711-b89c262b87ba_es9cqoetdevstack@QuobyteHD Jul 10 06:51:39 devstack sudo[103343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:40 devstack sudo[103339]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9a1146e8-db7a-4180-b54f-069397eda9cf tempest-CreateVolumesFromSnapshotTest-82292396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9d5b7119-a917-4952-ba85-cf6cc90ad1b5" returned: 0 in 0.892s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:40 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-9a1146e8-db7a-4180-b54f-069397eda9cf tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "cinder-quobyte-9d5b7119-a917-4952-ba85-cf6cc90ad1b5" released by "delete_volume" :: held 1.956s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:51:40 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-9a1146e8-db7a-4180-b54f-069397eda9cf tempest-CreateVolumesFromSnapshotTest-82292396 None] Created reservations ['c14af108-32bf-44bd-8a38-3933c70aa3d5', '4938f158-ef52-4dda-b0f6-68494fdbbecb', '11ef8c4c-c8ed-4775-8eec-7eb12eb0c689', '78fca30e-9318-4213-bb2a-4414fe27dde3'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:51:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9a1146e8-db7a-4180-b54f-069397eda9cf tempest-CreateVolumesFromSnapshotTest-82292396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9a1146e8-db7a-4180-b54f-069397eda9cf tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:40 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9a1146e8-db7a-4180-b54f-069397eda9cf tempest-CreateVolumesFromSnapshotTest-82292396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:51:40 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9a1146e8-db7a-4180-b54f-069397eda9cf tempest-CreateVolumesFromSnapshotTest-82292396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:51:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9a1146e8-db7a-4180-b54f-069397eda9cf tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9a1146e8-db7a-4180-b54f-069397eda9cf tempest-CreateVolumesFromSnapshotTest-82292396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:40 devstack sudo[103347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:51:40 devstack sudo[103347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:41 devstack sudo[103343]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_12b1428b-fef1-4e7c-8711-b89c262b87ba_es9cqoetdevstack@QuobyteHD" returned: 1 in 1.544s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_12b1428b-fef1-4e7c-8711-b89c262b87ba_es9cqoetdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:51:41 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] 12b1428b-fef1-4e7c-8711-b89c262b87ba was raw, converting to raw {{(pid=87294) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 06:51:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_12b1428b-fef1-4e7c-8711-b89c262b87ba_es9cqoetdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7de6427a-7b64-4df5-ae2e-c6d5438d4f47 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:41 devstack sudo[103352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_12b1428b-fef1-4e7c-8711-b89c262b87ba_es9cqoetdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7de6427a-7b64-4df5-ae2e-c6d5438d4f47 Jul 10 06:51:41 devstack sudo[103352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a45fdc0c-db6e-4a29-abe0-cabd4de4156a tempest-CreateVolumesFromSnapshotTest-82292396 None] Acquiring lock "cinder-97df73cc-da45-4780-9f7e-cee6ceb4affd-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a45fdc0c-db6e-4a29-abe0-cabd4de4156a tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "cinder-97df73cc-da45-4780-9f7e-cee6ceb4affd-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a45fdc0c-db6e-4a29-abe0-cabd4de4156a tempest-CreateVolumesFromSnapshotTest-82292396 None] Acquiring lock "cinder-quobyte-97df73cc-da45-4780-9f7e-cee6ceb4affd" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:41 devstack sudo[103347]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9a1146e8-db7a-4180-b54f-069397eda9cf tempest-CreateVolumesFromSnapshotTest-82292396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.303s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:41 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-9a1146e8-db7a-4180-b54f-069397eda9cf tempest-CreateVolumesFromSnapshotTest-82292396 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:51:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a45fdc0c-db6e-4a29-abe0-cabd4de4156a tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "cinder-quobyte-97df73cc-da45-4780-9f7e-cee6ceb4affd" acquired by "delete_volume" :: waited 0.045s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:41 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-9a1146e8-db7a-4180-b54f-069397eda9cf tempest-CreateVolumesFromSnapshotTest-82292396 None] Deleted volume successfully. Jul 10 06:51:41 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[077a175a-ed3a-43ce-9125-1fc0d4874ec8]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:51:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a45fdc0c-db6e-4a29-abe0-cabd4de4156a tempest-CreateVolumesFromSnapshotTest-82292396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-97df73cc-da45-4780-9f7e-cee6ceb4affd {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-9a1146e8-db7a-4180-b54f-069397eda9cf tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "cinder-9d5b7119-a917-4952-ba85-cf6cc90ad1b5-delete_volume" released by "delete_volume" :: held 3.904s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:51:42 devstack sudo[103355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-97df73cc-da45-4780-9f7e-cee6ceb4affd Jul 10 06:51:42 devstack sudo[103355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:42 devstack sudo[103352]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_12b1428b-fef1-4e7c-8711-b89c262b87ba_es9cqoetdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7de6427a-7b64-4df5-ae2e-c6d5438d4f47" returned: 0 in 1.371s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:42 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_12b1428b-fef1-4e7c-8711-b89c262b87ba_es9cqoetdevstack@QuobyteHD, size 0.00 MB, duration 1.37 sec, destination /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7de6427a-7b64-4df5-ae2e-c6d5438d4f47 {{(pid=87294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 06:51:42 devstack cinder-volume[87294]: INFO cinder.image.image_utils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 06:51:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7de6427a-7b64-4df5-ae2e-c6d5438d4f47 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:42 devstack sudo[103360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7de6427a-7b64-4df5-ae2e-c6d5438d4f47 1G Jul 10 06:51:42 devstack sudo[103360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:42 devstack sudo[103355]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a45fdc0c-db6e-4a29-abe0-cabd4de4156a tempest-CreateVolumesFromSnapshotTest-82292396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-97df73cc-da45-4780-9f7e-cee6ceb4affd" returned: 0 in 1.073s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a45fdc0c-db6e-4a29-abe0-cabd4de4156a tempest-CreateVolumesFromSnapshotTest-82292396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-97df73cc-da45-4780-9f7e-cee6ceb4affd {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:42 devstack sudo[103365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-97df73cc-da45-4780-9f7e-cee6ceb4affd Jul 10 06:51:43 devstack sudo[103365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:43 devstack sudo[103360]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7de6427a-7b64-4df5-ae2e-c6d5438d4f47 1G" returned: 0 in 1.238s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:43 devstack sudo[103365]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a45fdc0c-db6e-4a29-abe0-cabd4de4156a tempest-CreateVolumesFromSnapshotTest-82292396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-97df73cc-da45-4780-9f7e-cee6ceb4affd" returned: 0 in 0.860s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:43 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a45fdc0c-db6e-4a29-abe0-cabd4de4156a tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "cinder-quobyte-97df73cc-da45-4780-9f7e-cee6ceb4affd" released by "delete_volume" :: held 2.027s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:51:43 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f319a98-2122-44b9-8a6a-0d624d3f8473]: (4, 'raw') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:51:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7de6427a-7b64-4df5-ae2e-c6d5438d4f47 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:43 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-a45fdc0c-db6e-4a29-abe0-cabd4de4156a tempest-CreateVolumesFromSnapshotTest-82292396 None] Created reservations ['b5fb71c9-92c9-4ed8-adec-d807b4884d27', '43583a82-90cb-4f4a-aa98-392fd2439c1f', '33dae416-3ed2-4f48-bbc3-abf4d4f45a26', '281e6e20-c256-460e-b201-e138ddf3ceee'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:51:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a45fdc0c-db6e-4a29-abe0-cabd4de4156a tempest-CreateVolumesFromSnapshotTest-82292396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a45fdc0c-db6e-4a29-abe0-cabd4de4156a tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:44 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-a45fdc0c-db6e-4a29-abe0-cabd4de4156a tempest-CreateVolumesFromSnapshotTest-82292396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:51:44 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-a45fdc0c-db6e-4a29-abe0-cabd4de4156a tempest-CreateVolumesFromSnapshotTest-82292396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:51:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a45fdc0c-db6e-4a29-abe0-cabd4de4156a tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a45fdc0c-db6e-4a29-abe0-cabd4de4156a tempest-CreateVolumesFromSnapshotTest-82292396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:44 devstack sudo[103371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7de6427a-7b64-4df5-ae2e-c6d5438d4f47 Jul 10 06:51:44 devstack sudo[103371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:44 devstack sudo[103372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:51:44 devstack sudo[103372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:44 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-746fa08c-80fe-4465-bf31-4d173c6b2041 tempest-CreateVolumesFromSnapshotTest-82292396 None] Acquiring lock "cinder-56dd810f-ea88-4ce2-b55c-5db4027e1eb2-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:44 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-746fa08c-80fe-4465-bf31-4d173c6b2041 tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "cinder-56dd810f-ea88-4ce2-b55c-5db4027e1eb2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:44 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-746fa08c-80fe-4465-bf31-4d173c6b2041 tempest-CreateVolumesFromSnapshotTest-82292396 None] Acquiring lock "cinder-quobyte-56dd810f-ea88-4ce2-b55c-5db4027e1eb2" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:44 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-746fa08c-80fe-4465-bf31-4d173c6b2041 tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "cinder-quobyte-56dd810f-ea88-4ce2-b55c-5db4027e1eb2" acquired by "delete_volume" :: waited 0.028s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:44 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[782d750a-30e7-44a2-8108-05ee156e9c15]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:51:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-746fa08c-80fe-4465-bf31-4d173c6b2041 tempest-CreateVolumesFromSnapshotTest-82292396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-56dd810f-ea88-4ce2-b55c-5db4027e1eb2 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:44 devstack sudo[103375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-56dd810f-ea88-4ce2-b55c-5db4027e1eb2 Jul 10 06:51:44 devstack sudo[103375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:45 devstack sudo[103372]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a45fdc0c-db6e-4a29-abe0-cabd4de4156a tempest-CreateVolumesFromSnapshotTest-82292396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.034s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:45 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-a45fdc0c-db6e-4a29-abe0-cabd4de4156a tempest-CreateVolumesFromSnapshotTest-82292396 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:51:45 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-a45fdc0c-db6e-4a29-abe0-cabd4de4156a tempest-CreateVolumesFromSnapshotTest-82292396 None] Deleted volume successfully. Jul 10 06:51:45 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a45fdc0c-db6e-4a29-abe0-cabd4de4156a tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "cinder-97df73cc-da45-4780-9f7e-cee6ceb4affd-delete_volume" released by "delete_volume" :: held 3.514s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:51:45 devstack sudo[103371]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7de6427a-7b64-4df5-ae2e-c6d5438d4f47" returned: 0 in 1.462s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7de6427a-7b64-4df5-ae2e-c6d5438d4f47 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:45 devstack sudo[103380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7de6427a-7b64-4df5-ae2e-c6d5438d4f47 Jul 10 06:51:45 devstack sudo[103380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:45 devstack sudo[103375]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-746fa08c-80fe-4465-bf31-4d173c6b2041 tempest-CreateVolumesFromSnapshotTest-82292396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-56dd810f-ea88-4ce2-b55c-5db4027e1eb2" returned: 0 in 1.426s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-746fa08c-80fe-4465-bf31-4d173c6b2041 tempest-CreateVolumesFromSnapshotTest-82292396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-56dd810f-ea88-4ce2-b55c-5db4027e1eb2 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:45 devstack sudo[103385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-56dd810f-ea88-4ce2-b55c-5db4027e1eb2 Jul 10 06:51:45 devstack sudo[103385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:46 devstack sudo[103380]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7de6427a-7b64-4df5-ae2e-c6d5438d4f47" returned: 1 in 0.833s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7de6427a-7b64-4df5-ae2e-c6d5438d4f47' failed. Not Retrying. {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:51:46 devstack cinder-volume[87294]: DEBUG cinder.volume.volume_utils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Downloaded image 12b1428b-fef1-4e7c-8711-b89c262b87ba ((None, [{'url': 'file:///opt/stack/data/glance/images/12b1428b-fef1-4e7c-8711-b89c262b87ba', 'metadata': {}}])) to volume 7de6427a-7b64-4df5-ae2e-c6d5438d4f47 successfully. {{(pid=87294) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 06:51:46 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Temporary image 12b1428b-fef1-4e7c-8711-b89c262b87ba for user 6592a304320c4ff68ed23038a0957718 is deleted. {{(pid=87294) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 06:51:46 devstack cinder-volume[87294]: DEBUG cinder.volume.volume_utils [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Marking volume 7de6427a-7b64-4df5-ae2e-c6d5438d4f47 as bootable. {{(pid=87294) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 06:51:46 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Copying metadata from image 12b1428b-fef1-4e7c-8711-b89c262b87ba to 7de6427a-7b64-4df5-ae2e-c6d5438d4f47. {{(pid=87294) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 06:51:46 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Creating volume glance metadata for volume 7de6427a-7b64-4df5-ae2e-c6d5438d4f47 backed by image 12b1428b-fef1-4e7c-8711-b89c262b87ba with: {'image_id': '12b1428b-fef1-4e7c-8711-b89c262b87ba', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '8150094bdec1427af84ed81a98da2fb1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87294) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 06:51:46 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f6fe38d-930d-41b4-b585-3a1034afb48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7de6427a-7b64-4df5-ae2e-c6d5438d4f47', 'volume_size': 1, 'image_id': '12b1428b-fef1-4e7c-8711-b89c262b87ba', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/12b1428b-fef1-4e7c-8711-b89c262b87ba', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8150094bdec1427af84ed81a98da2fb1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5f2b5edba70841968d06455a75b13e94', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6da318a02d0856e7a5e6453c4270b13cac97eee700a2d145d56563792b6cc3ffa973d05ca3ebf543ea422170516c2e6329e84f22806c220dff5334c3412fa4b8', 'id': '12b1428b-fef1-4e7c-8711-b89c262b87ba', 'created_at': datetime.datetime(2026, 7, 10, 4, 51, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 51, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/12b1428b-fef1-4e7c-8711-b89c262b87ba/file', 'properties': {}}, 'image_service': }' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:46 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67921225-6a9a-42bc-a9e5-cf7e5370bb32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:46 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Volume volume-7de6427a-7b64-4df5-ae2e-c6d5438d4f47 (7de6427a-7b64-4df5-ae2e-c6d5438d4f47): created successfully Jul 10 06:51:46 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67921225-6a9a-42bc-a9e5-cf7e5370bb32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:46 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Flow 'volume_create_manager' (76e0714b-9661-419f-b019-78da63a972f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:51:46 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-aced1d5e-1833-4525-8577-c59e6d5bfb25 tempest-VolumeImageDependencyTests-500850187 None] Created volume successfully. Jul 10 06:51:46 devstack sudo[103385]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-746fa08c-80fe-4465-bf31-4d173c6b2041 tempest-CreateVolumesFromSnapshotTest-82292396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-56dd810f-ea88-4ce2-b55c-5db4027e1eb2" returned: 0 in 0.778s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:46 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-746fa08c-80fe-4465-bf31-4d173c6b2041 tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "cinder-quobyte-56dd810f-ea88-4ce2-b55c-5db4027e1eb2" released by "delete_volume" :: held 2.290s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:51:46 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-746fa08c-80fe-4465-bf31-4d173c6b2041 tempest-CreateVolumesFromSnapshotTest-82292396 None] Created reservations ['a140e83a-5c12-4305-b812-79b034517b30', '59af1881-2b05-4ec1-ab7b-267b2eda6aaf', 'b7ed1945-49fc-499d-8667-6f4527d1399c', '1bdd7066-c4f0-491d-ae66-c1efbee13694'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:51:46 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-ec4c7e3a-92bc-4af0-ae47-c530f912f126 tempest-VolumeImageDependencyTests-500850187 None] Acquiring lock "cinder-7de6427a-7b64-4df5-ae2e-c6d5438d4f47-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:46 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-ec4c7e3a-92bc-4af0-ae47-c530f912f126 tempest-VolumeImageDependencyTests-500850187 None] Lock "cinder-7de6427a-7b64-4df5-ae2e-c6d5438d4f47-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-746fa08c-80fe-4465-bf31-4d173c6b2041 tempest-CreateVolumesFromSnapshotTest-82292396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-746fa08c-80fe-4465-bf31-4d173c6b2041 tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:46 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-746fa08c-80fe-4465-bf31-4d173c6b2041 tempest-CreateVolumesFromSnapshotTest-82292396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:51:46 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-746fa08c-80fe-4465-bf31-4d173c6b2041 tempest-CreateVolumesFromSnapshotTest-82292396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:51:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-746fa08c-80fe-4465-bf31-4d173c6b2041 tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-746fa08c-80fe-4465-bf31-4d173c6b2041 tempest-CreateVolumesFromSnapshotTest-82292396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:46 devstack sudo[103391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:51:46 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-ec4c7e3a-92bc-4af0-ae47-c530f912f126 tempest-VolumeImageDependencyTests-500850187 None] Acquiring lock "cinder-quobyte-7de6427a-7b64-4df5-ae2e-c6d5438d4f47" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:46 devstack sudo[103391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:46 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-ec4c7e3a-92bc-4af0-ae47-c530f912f126 tempest-VolumeImageDependencyTests-500850187 None] Lock "cinder-quobyte-7de6427a-7b64-4df5-ae2e-c6d5438d4f47" acquired by "delete_volume" :: waited 0.020s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:46 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4db5beb-2fd8-4678-b697-d12a8c3a316b]: (4, 'raw') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:51:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ec4c7e3a-92bc-4af0-ae47-c530f912f126 tempest-VolumeImageDependencyTests-500850187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7de6427a-7b64-4df5-ae2e-c6d5438d4f47 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:47 devstack sudo[103393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7de6427a-7b64-4df5-ae2e-c6d5438d4f47 Jul 10 06:51:47 devstack sudo[103393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:47 devstack sudo[103391]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-746fa08c-80fe-4465-bf31-4d173c6b2041 tempest-CreateVolumesFromSnapshotTest-82292396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.918s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:47 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-746fa08c-80fe-4465-bf31-4d173c6b2041 tempest-CreateVolumesFromSnapshotTest-82292396 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:51:47 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-746fa08c-80fe-4465-bf31-4d173c6b2041 tempest-CreateVolumesFromSnapshotTest-82292396 None] Deleted volume successfully. Jul 10 06:51:47 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-746fa08c-80fe-4465-bf31-4d173c6b2041 tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "cinder-56dd810f-ea88-4ce2-b55c-5db4027e1eb2-delete_volume" released by "delete_volume" :: held 3.565s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:51:47 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-defa96d5-0406-4da2-b6bd-18751c843068 tempest-CreateVolumesFromSnapshotTest-82292396 None] Acquiring lock "cinder-d350d57b-67f0-4d5c-af10-955fa96ebf89-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:47 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-defa96d5-0406-4da2-b6bd-18751c843068 tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "cinder-d350d57b-67f0-4d5c-af10-955fa96ebf89-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:47 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-defa96d5-0406-4da2-b6bd-18751c843068 tempest-CreateVolumesFromSnapshotTest-82292396 None] Acquiring lock "cinder-quobyte-d350d57b-67f0-4d5c-af10-955fa96ebf89" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:47 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-defa96d5-0406-4da2-b6bd-18751c843068 tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "cinder-quobyte-d350d57b-67f0-4d5c-af10-955fa96ebf89" acquired by "delete_volume" :: waited 0.023s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:48 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[9778cef8-0190-4474-ad81-03ab9df72237]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:51:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-defa96d5-0406-4da2-b6bd-18751c843068 tempest-CreateVolumesFromSnapshotTest-82292396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d350d57b-67f0-4d5c-af10-955fa96ebf89 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:48 devstack sudo[103396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d350d57b-67f0-4d5c-af10-955fa96ebf89 Jul 10 06:51:48 devstack sudo[103396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:48 devstack sudo[103393]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ec4c7e3a-92bc-4af0-ae47-c530f912f126 tempest-VolumeImageDependencyTests-500850187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7de6427a-7b64-4df5-ae2e-c6d5438d4f47" returned: 0 in 1.345s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ec4c7e3a-92bc-4af0-ae47-c530f912f126 tempest-VolumeImageDependencyTests-500850187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7de6427a-7b64-4df5-ae2e-c6d5438d4f47 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:48 devstack sudo[103400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7de6427a-7b64-4df5-ae2e-c6d5438d4f47 Jul 10 06:51:48 devstack sudo[103400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:49 devstack sudo[103396]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-defa96d5-0406-4da2-b6bd-18751c843068 tempest-CreateVolumesFromSnapshotTest-82292396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d350d57b-67f0-4d5c-af10-955fa96ebf89" returned: 0 in 1.027s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-defa96d5-0406-4da2-b6bd-18751c843068 tempest-CreateVolumesFromSnapshotTest-82292396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d350d57b-67f0-4d5c-af10-955fa96ebf89 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:49 devstack sudo[103405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d350d57b-67f0-4d5c-af10-955fa96ebf89 Jul 10 06:51:49 devstack sudo[103405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:49 devstack sudo[103400]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ec4c7e3a-92bc-4af0-ae47-c530f912f126 tempest-VolumeImageDependencyTests-500850187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7de6427a-7b64-4df5-ae2e-c6d5438d4f47" returned: 1 in 1.180s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ec4c7e3a-92bc-4af0-ae47-c530f912f126 tempest-VolumeImageDependencyTests-500850187 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7de6427a-7b64-4df5-ae2e-c6d5438d4f47' failed. Not Retrying. {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:51:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ec4c7e3a-92bc-4af0-ae47-c530f912f126 tempest-VolumeImageDependencyTests-500850187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7de6427a-7b64-4df5-ae2e-c6d5438d4f47 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:49 devstack sudo[103410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7de6427a-7b64-4df5-ae2e-c6d5438d4f47 Jul 10 06:51:49 devstack sudo[103410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:49 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-b27ca610-cb4a-4263-8b79-26fb7b75105c tempest-VolumesActionsTest-88700137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:51:49 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b27ca610-cb4a-4263-8b79-26fb7b75105c tempest-VolumesActionsTest-88700137 None] Flow 'volume_create_manager' (e8d4a0fe-a9ac-45d8-9bd0-c21022ad6e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:51:49 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b27ca610-cb4a-4263-8b79-26fb7b75105c tempest-VolumesActionsTest-88700137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b68cc86-03d6-491d-aeff-7c28e2c71aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:49 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b27ca610-cb4a-4263-8b79-26fb7b75105c tempest-VolumesActionsTest-88700137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b68cc86-03d6-491d-aeff-7c28e2c71aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-953333426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3dfdc94-ff2f-48fb-ab55-f3296c8baa12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42b15336686e4defad8c3dea07764d3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:51:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:51:50Z,use_quota=True,user_id='9cbdca2ab73748ec92be15328e52dbec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:49 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b27ca610-cb4a-4263-8b79-26fb7b75105c tempest-VolumesActionsTest-88700137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1389a2f-7b8e-41cb-9bb7-8db6119aa159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:49 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b27ca610-cb4a-4263-8b79-26fb7b75105c tempest-VolumesActionsTest-88700137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1389a2f-7b8e-41cb-9bb7-8db6119aa159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:49 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b27ca610-cb4a-4263-8b79-26fb7b75105c tempest-VolumesActionsTest-88700137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (019cf956-4bb7-4225-a4ab-0f57d55bd261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:49 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b27ca610-cb4a-4263-8b79-26fb7b75105c tempest-VolumesActionsTest-88700137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (019cf956-4bb7-4225-a4ab-0f57d55bd261) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3dfdc94-ff2f-48fb-ab55-f3296c8baa12', 'volume_name': 'volume-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:49 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b27ca610-cb4a-4263-8b79-26fb7b75105c tempest-VolumesActionsTest-88700137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f25d8b24-6e9f-4aca-a332-3a9b0865a0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:49 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b27ca610-cb4a-4263-8b79-26fb7b75105c tempest-VolumesActionsTest-88700137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f25d8b24-6e9f-4aca-a332-3a9b0865a0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:49 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b27ca610-cb4a-4263-8b79-26fb7b75105c tempest-VolumesActionsTest-88700137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f69ac500-9475-41fb-8406-733b105972f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:49 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-b27ca610-cb4a-4263-8b79-26fb7b75105c tempest-VolumesActionsTest-88700137 None] Volume d3dfdc94-ff2f-48fb-ab55-f3296c8baa12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12', 'volume_size': 1} Jul 10 06:51:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b27ca610-cb4a-4263-8b79-26fb7b75105c tempest-VolumesActionsTest-88700137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b27ca610-cb4a-4263-8b79-26fb7b75105c tempest-VolumesActionsTest-88700137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:49 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b27ca610-cb4a-4263-8b79-26fb7b75105c tempest-VolumesActionsTest-88700137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:51:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-953333426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3dfdc94-ff2f-48fb-ab55-f3296c8baa12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42b15336686e4defad8c3dea07764d3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:51:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:51:50Z,use_quota=True,user_id='9cbdca2ab73748ec92be15328e52dbec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:51:49 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-b27ca610-cb4a-4263-8b79-26fb7b75105c tempest-VolumesActionsTest-88700137 None] Creating volume d3dfdc94-ff2f-48fb-ab55-f3296c8baa12 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:51:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b27ca610-cb4a-4263-8b79-26fb7b75105c tempest-VolumesActionsTest-88700137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b27ca610-cb4a-4263-8b79-26fb7b75105c tempest-VolumesActionsTest-88700137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:49 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b27ca610-cb4a-4263-8b79-26fb7b75105c tempest-VolumesActionsTest-88700137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:51:49 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b27ca610-cb4a-4263-8b79-26fb7b75105c tempest-VolumesActionsTest-88700137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:51:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b27ca610-cb4a-4263-8b79-26fb7b75105c tempest-VolumesActionsTest-88700137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:49 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b27ca610-cb4a-4263-8b79-26fb7b75105c tempest-VolumesActionsTest-88700137 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:51:49 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-b27ca610-cb4a-4263-8b79-26fb7b75105c tempest-VolumesActionsTest-88700137 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:51:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b27ca610-cb4a-4263-8b79-26fb7b75105c tempest-VolumesActionsTest-88700137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:49 devstack sudo[103412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12 1073741824 Jul 10 06:51:49 devstack sudo[103412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:49 devstack sudo[103405]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-defa96d5-0406-4da2-b6bd-18751c843068 tempest-CreateVolumesFromSnapshotTest-82292396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d350d57b-67f0-4d5c-af10-955fa96ebf89" returned: 0 in 0.897s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:49 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-defa96d5-0406-4da2-b6bd-18751c843068 tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "cinder-quobyte-d350d57b-67f0-4d5c-af10-955fa96ebf89" released by "delete_volume" :: held 2.020s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:51:50 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-defa96d5-0406-4da2-b6bd-18751c843068 tempest-CreateVolumesFromSnapshotTest-82292396 None] Created reservations ['22962e4c-cedb-4007-a913-2a849d0c3890', 'ebeecdc0-5199-4b47-b6a7-86a2bae6e561', '3128f391-6760-48da-a6c2-d0051da60aa9', '16d5fb03-1994-4508-93c6-014d5d6badf7'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:51:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-defa96d5-0406-4da2-b6bd-18751c843068 tempest-CreateVolumesFromSnapshotTest-82292396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-defa96d5-0406-4da2-b6bd-18751c843068 tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:50 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-defa96d5-0406-4da2-b6bd-18751c843068 tempest-CreateVolumesFromSnapshotTest-82292396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:51:50 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-defa96d5-0406-4da2-b6bd-18751c843068 tempest-CreateVolumesFromSnapshotTest-82292396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:51:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-defa96d5-0406-4da2-b6bd-18751c843068 tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-defa96d5-0406-4da2-b6bd-18751c843068 tempest-CreateVolumesFromSnapshotTest-82292396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:50 devstack sudo[103417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:51:50 devstack sudo[103417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:50 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-808cd438-e5e0-4c13-84e7-e954e831edc0 tempest-CreateVolumesFromSnapshotTest-82292396 None] Acquiring lock "cinder-ffae4ec7-90e5-4ea0-a6c8-0ea12802fed3-delete_snapshot" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:50 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-808cd438-e5e0-4c13-84e7-e954e831edc0 tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "cinder-ffae4ec7-90e5-4ea0-a6c8-0ea12802fed3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:50 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-808cd438-e5e0-4c13-84e7-e954e831edc0 tempest-CreateVolumesFromSnapshotTest-82292396 None] Acquiring lock "cinder-quobyte-fa59d3cd-2996-49c3-9659-3cf574313f49" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:50 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-808cd438-e5e0-4c13-84e7-e954e831edc0 tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "cinder-quobyte-fa59d3cd-2996-49c3-9659-3cf574313f49" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:50 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-808cd438-e5e0-4c13-84e7-e954e831edc0 tempest-CreateVolumesFromSnapshotTest-82292396 None] Acquiring lock "cinder-quobyte-ffae4ec7-90e5-4ea0-a6c8-0ea12802fed3" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:50 devstack sudo[103410]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ec4c7e3a-92bc-4af0-ae47-c530f912f126 tempest-VolumeImageDependencyTests-500850187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7de6427a-7b64-4df5-ae2e-c6d5438d4f47" returned: 0 in 0.936s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:50 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-808cd438-e5e0-4c13-84e7-e954e831edc0 tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "cinder-quobyte-ffae4ec7-90e5-4ea0-a6c8-0ea12802fed3" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:50 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-808cd438-e5e0-4c13-84e7-e954e831edc0 tempest-CreateVolumesFromSnapshotTest-82292396 None] Deleting offline snapshot ffae4ec7-90e5-4ea0-a6c8-0ea12802fed3 of volume fa59d3cd-2996-49c3-9659-3cf574313f49 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:51:50 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-808cd438-e5e0-4c13-84e7-e954e831edc0 tempest-CreateVolumesFromSnapshotTest-82292396 None] snapshot_file for this snap is: volume-fa59d3cd-2996-49c3-9659-3cf574313f49.ffae4ec7-90e5-4ea0-a6c8-0ea12802fed3 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:51:50 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-ec4c7e3a-92bc-4af0-ae47-c530f912f126 tempest-VolumeImageDependencyTests-500850187 None] Lock "cinder-quobyte-7de6427a-7b64-4df5-ae2e-c6d5438d4f47" released by "delete_volume" :: held 3.594s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:51:50 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e801bb8-7a55-4ad3-8b3a-809fa63918b0]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:51:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-808cd438-e5e0-4c13-84e7-e954e831edc0 tempest-CreateVolumesFromSnapshotTest-82292396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49.ffae4ec7-90e5-4ea0-a6c8-0ea12802fed3 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:50 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-ec4c7e3a-92bc-4af0-ae47-c530f912f126 tempest-VolumeImageDependencyTests-500850187 None] Created reservations ['70d4a1bb-c15f-45f1-bb67-aafb6ad52894', 'c7fafb1f-4ef1-4b54-b3f9-8c1e87ccec91', 'a2e6e934-b214-44b7-b84d-e5babb1403e0', '8f9320e7-7b18-4318-956e-6e56cf42414c'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:51:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ec4c7e3a-92bc-4af0-ae47-c530f912f126 tempest-VolumeImageDependencyTests-500850187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ec4c7e3a-92bc-4af0-ae47-c530f912f126 tempest-VolumeImageDependencyTests-500850187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:50 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-ec4c7e3a-92bc-4af0-ae47-c530f912f126 tempest-VolumeImageDependencyTests-500850187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:51:50 devstack sudo[103422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49.ffae4ec7-90e5-4ea0-a6c8-0ea12802fed3 Jul 10 06:51:50 devstack sudo[103422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:50 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-ec4c7e3a-92bc-4af0-ae47-c530f912f126 tempest-VolumeImageDependencyTests-500850187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:51:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ec4c7e3a-92bc-4af0-ae47-c530f912f126 tempest-VolumeImageDependencyTests-500850187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ec4c7e3a-92bc-4af0-ae47-c530f912f126 tempest-VolumeImageDependencyTests-500850187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:50 devstack sudo[103424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:51:50 devstack sudo[103424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:50 devstack sudo[103412]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b27ca610-cb4a-4263-8b79-26fb7b75105c tempest-VolumesActionsTest-88700137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12 1073741824" returned: 0 in 1.294s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:51 devstack sudo[103417]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-defa96d5-0406-4da2-b6bd-18751c843068 tempest-CreateVolumesFromSnapshotTest-82292396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.902s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:51 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-defa96d5-0406-4da2-b6bd-18751c843068 tempest-CreateVolumesFromSnapshotTest-82292396 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:51:51 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-defa96d5-0406-4da2-b6bd-18751c843068 tempest-CreateVolumesFromSnapshotTest-82292396 None] Deleted volume successfully. Jul 10 06:51:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b27ca610-cb4a-4263-8b79-26fb7b75105c tempest-VolumesActionsTest-88700137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:51 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-defa96d5-0406-4da2-b6bd-18751c843068 tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "cinder-d350d57b-67f0-4d5c-af10-955fa96ebf89-delete_volume" released by "delete_volume" :: held 3.248s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:51:51 devstack sudo[103428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12 Jul 10 06:51:51 devstack sudo[103428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:51 devstack sudo[103424]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ec4c7e3a-92bc-4af0-ae47-c530f912f126 tempest-VolumeImageDependencyTests-500850187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.114s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:51 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-ec4c7e3a-92bc-4af0-ae47-c530f912f126 tempest-VolumeImageDependencyTests-500850187 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:51:51 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-ec4c7e3a-92bc-4af0-ae47-c530f912f126 tempest-VolumeImageDependencyTests-500850187 None] Deleted volume successfully. Jul 10 06:51:51 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-ec4c7e3a-92bc-4af0-ae47-c530f912f126 tempest-VolumeImageDependencyTests-500850187 None] Lock "cinder-7de6427a-7b64-4df5-ae2e-c6d5438d4f47-delete_volume" released by "delete_volume" :: held 5.104s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:51:51 devstack sudo[103422]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-808cd438-e5e0-4c13-84e7-e954e831edc0 tempest-CreateVolumesFromSnapshotTest-82292396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49.ffae4ec7-90e5-4ea0-a6c8-0ea12802fed3" returned: 0 in 1.447s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:51 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-808cd438-e5e0-4c13-84e7-e954e831edc0 tempest-CreateVolumesFromSnapshotTest-82292396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa59d3cd-2996-49c3-9659-3cf574313f49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:51:51 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8599b9-1a9e-4d2e-8fc2-52c9448129de]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:51:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-808cd438-e5e0-4c13-84e7-e954e831edc0 tempest-CreateVolumesFromSnapshotTest-82292396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:52 devstack sudo[103428]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b27ca610-cb4a-4263-8b79-26fb7b75105c tempest-VolumesActionsTest-88700137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12" returned: 0 in 0.950s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:52 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b27ca610-cb4a-4263-8b79-26fb7b75105c tempest-VolumesActionsTest-88700137 None] <== create_volume: return (2345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:51:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b27ca610-cb4a-4263-8b79-26fb7b75105c tempest-VolumesActionsTest-88700137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.347s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:52 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b27ca610-cb4a-4263-8b79-26fb7b75105c tempest-VolumesActionsTest-88700137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f69ac500-9475-41fb-8406-733b105972f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:52 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b27ca610-cb4a-4263-8b79-26fb7b75105c tempest-VolumesActionsTest-88700137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf98b52f-6f4f-4f2a-9c80-55dca5089c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:51:52 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-b27ca610-cb4a-4263-8b79-26fb7b75105c tempest-VolumesActionsTest-88700137 None] Volume volume-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12 (d3dfdc94-ff2f-48fb-ab55-f3296c8baa12): created successfully Jul 10 06:51:52 devstack sudo[103435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49 Jul 10 06:51:52 devstack sudo[103435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:52 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b27ca610-cb4a-4263-8b79-26fb7b75105c tempest-VolumesActionsTest-88700137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf98b52f-6f4f-4f2a-9c80-55dca5089c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:51:52 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b27ca610-cb4a-4263-8b79-26fb7b75105c tempest-VolumesActionsTest-88700137 None] Flow 'volume_create_manager' (e8d4a0fe-a9ac-45d8-9bd0-c21022ad6e4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:51:52 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-b27ca610-cb4a-4263-8b79-26fb7b75105c tempest-VolumesActionsTest-88700137 None] Created volume successfully. Jul 10 06:51:52 devstack sudo[103435]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-808cd438-e5e0-4c13-84e7-e954e831edc0 tempest-CreateVolumesFromSnapshotTest-82292396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49" returned: 0 in 0.918s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-808cd438-e5e0-4c13-84e7-e954e831edc0 tempest-CreateVolumesFromSnapshotTest-82292396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49.ffae4ec7-90e5-4ea0-a6c8-0ea12802fed3 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:52 devstack sudo[103473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49.ffae4ec7-90e5-4ea0-a6c8-0ea12802fed3 Jul 10 06:51:52 devstack sudo[103473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:53 devstack sudo[103473]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-808cd438-e5e0-4c13-84e7-e954e831edc0 tempest-CreateVolumesFromSnapshotTest-82292396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49.ffae4ec7-90e5-4ea0-a6c8-0ea12802fed3" returned: 0 in 0.955s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-808cd438-e5e0-4c13-84e7-e954e831edc0 tempest-CreateVolumesFromSnapshotTest-82292396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49.ffae4ec7-90e5-4ea0-a6c8-0ea12802fed3 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:53 devstack sudo[103478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49.ffae4ec7-90e5-4ea0-a6c8-0ea12802fed3 Jul 10 06:51:53 devstack sudo[103478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:54 devstack sudo[103478]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-808cd438-e5e0-4c13-84e7-e954e831edc0 tempest-CreateVolumesFromSnapshotTest-82292396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49.ffae4ec7-90e5-4ea0-a6c8-0ea12802fed3" returned: 0 in 0.745s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:54 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-808cd438-e5e0-4c13-84e7-e954e831edc0 tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "cinder-quobyte-ffae4ec7-90e5-4ea0-a6c8-0ea12802fed3" released by "_delete_snapshot" :: held 4.201s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:51:54 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-808cd438-e5e0-4c13-84e7-e954e831edc0 tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "cinder-quobyte-fa59d3cd-2996-49c3-9659-3cf574313f49" released by "delete_snapshot" :: held 4.243s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:51:54 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-808cd438-e5e0-4c13-84e7-e954e831edc0 tempest-CreateVolumesFromSnapshotTest-82292396 None] Created reservations ['0c630802-4e13-441a-a7c7-69a918f3e740', '6a809074-32f9-44c2-aa59-ebcf46961153', 'ccb2a72f-b5fa-4c2d-9d95-fbcf224766b0', '1f1f12a0-694b-4151-9db7-7842cc04f635'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:51:54 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-808cd438-e5e0-4c13-84e7-e954e831edc0 tempest-CreateVolumesFromSnapshotTest-82292396 None] Delete snapshot completed successfully. Jul 10 06:51:54 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-808cd438-e5e0-4c13-84e7-e954e831edc0 tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "cinder-ffae4ec7-90e5-4ea0-a6c8-0ea12802fed3-delete_snapshot" released by "delete_snapshot" :: held 4.429s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:51:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-44a10566-85fd-4b2e-8201-a7f382ac948e tempest-CreateVolumesFromSnapshotTest-82292396 None] Acquiring lock "cinder-fa59d3cd-2996-49c3-9659-3cf574313f49-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-44a10566-85fd-4b2e-8201-a7f382ac948e tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "cinder-fa59d3cd-2996-49c3-9659-3cf574313f49-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:55 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:UPDATE=163,cinder:SELECT=119,cinder:DELETE=14,cinder:INSERT=44 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:51:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-44a10566-85fd-4b2e-8201-a7f382ac948e tempest-CreateVolumesFromSnapshotTest-82292396 None] Acquiring lock "cinder-quobyte-fa59d3cd-2996-49c3-9659-3cf574313f49" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:51:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-44a10566-85fd-4b2e-8201-a7f382ac948e tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "cinder-quobyte-fa59d3cd-2996-49c3-9659-3cf574313f49" acquired by "delete_volume" :: waited 0.019s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:51:55 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad06239-00ae-4bd6-844d-bedbc2204a98]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:51:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-44a10566-85fd-4b2e-8201-a7f382ac948e tempest-CreateVolumesFromSnapshotTest-82292396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:55 devstack sudo[103485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49 Jul 10 06:51:55 devstack sudo[103485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:56 devstack sudo[103485]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-44a10566-85fd-4b2e-8201-a7f382ac948e tempest-CreateVolumesFromSnapshotTest-82292396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49" returned: 0 in 0.874s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-44a10566-85fd-4b2e-8201-a7f382ac948e tempest-CreateVolumesFromSnapshotTest-82292396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:56 devstack sudo[103493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49 Jul 10 06:51:56 devstack sudo[103493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:57 devstack sudo[103493]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-44a10566-85fd-4b2e-8201-a7f382ac948e tempest-CreateVolumesFromSnapshotTest-82292396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-fa59d3cd-2996-49c3-9659-3cf574313f49" returned: 0 in 0.709s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:57 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-44a10566-85fd-4b2e-8201-a7f382ac948e tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "cinder-quobyte-fa59d3cd-2996-49c3-9659-3cf574313f49" released by "delete_volume" :: held 1.665s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:51:57 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-44a10566-85fd-4b2e-8201-a7f382ac948e tempest-CreateVolumesFromSnapshotTest-82292396 None] Created reservations ['0e1b15ea-85ad-4127-8e42-7a398db765ff', 'b03963dd-4c09-4c73-a3e4-de8f4dca6e29', '66ebd0eb-6904-4f2d-88d4-cecfd3191f48', 'b21fc0e5-d558-4e7c-96df-6f36ae5771db'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:51:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-44a10566-85fd-4b2e-8201-a7f382ac948e tempest-CreateVolumesFromSnapshotTest-82292396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:51:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-44a10566-85fd-4b2e-8201-a7f382ac948e tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:51:57 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-44a10566-85fd-4b2e-8201-a7f382ac948e tempest-CreateVolumesFromSnapshotTest-82292396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:51:57 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-44a10566-85fd-4b2e-8201-a7f382ac948e tempest-CreateVolumesFromSnapshotTest-82292396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:51:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-44a10566-85fd-4b2e-8201-a7f382ac948e tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:51:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-44a10566-85fd-4b2e-8201-a7f382ac948e tempest-CreateVolumesFromSnapshotTest-82292396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:51:57 devstack sudo[103497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:51:57 devstack sudo[103497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:51:58 devstack sudo[103497]: pam_unix(sudo:session): session closed for user root Jul 10 06:51:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-44a10566-85fd-4b2e-8201-a7f382ac948e tempest-CreateVolumesFromSnapshotTest-82292396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.715s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:51:58 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-44a10566-85fd-4b2e-8201-a7f382ac948e tempest-CreateVolumesFromSnapshotTest-82292396 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:51:58 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-44a10566-85fd-4b2e-8201-a7f382ac948e tempest-CreateVolumesFromSnapshotTest-82292396 None] Deleted volume successfully. Jul 10 06:51:58 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-44a10566-85fd-4b2e-8201-a7f382ac948e tempest-CreateVolumesFromSnapshotTest-82292396 None] Lock "cinder-fa59d3cd-2996-49c3-9659-3cf574313f49-delete_volume" released by "delete_volume" :: held 2.683s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:52:07 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=10 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:52:08 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:UPDATE=139,cinder:SELECT=107,cinder:DELETE=13,cinder:INSERT=37 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:52:12 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a6b0c9a5-5e27-4d24-893e-6b6761473de3 tempest-VolumesActionsTest-88700137 None] Acquiring lock "cinder-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12" by "attach_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:52:12 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a6b0c9a5-5e27-4d24-893e-6b6761473de3 tempest-VolumesActionsTest-88700137 None] Lock "cinder-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12" acquired by "attach_volume" :: waited 0.034s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:52:13 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-a6b0c9a5-5e27-4d24-893e-6b6761473de3 tempest-VolumesActionsTest-88700137 None] Attaching volume d3dfdc94-ff2f-48fb-ab55-f3296c8baa12 to instance 9ef076a1-ac28-4b63-8d37-6fe4c324cdf3 at mountpoint /dev/vdb on host None. Jul 10 06:52:13 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-a6b0c9a5-5e27-4d24-893e-6b6761473de3 tempest-VolumesActionsTest-88700137 None] Attach volume completed successfully. Jul 10 06:52:13 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a6b0c9a5-5e27-4d24-893e-6b6761473de3 tempest-VolumesActionsTest-88700137 None] Lock "cinder-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12" released by "attach_volume" :: held 0.161s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:52:13 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-67221ae6-d01d-40be-8a54-e97fcb0c6795 tempest-VolumesActionsTest-88700137 None] Acquiring lock "cinder-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12-detach_volume" by "detach_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:52:13 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-67221ae6-d01d-40be-8a54-e97fcb0c6795 tempest-VolumesActionsTest-88700137 None] Lock "cinder-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:52:13 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-67221ae6-d01d-40be-8a54-e97fcb0c6795 tempest-VolumesActionsTest-88700137 None] Detaching volume d3dfdc94-ff2f-48fb-ab55-f3296c8baa12 from instance 9ef076a1-ac28-4b63-8d37-6fe4c324cdf3. Jul 10 06:52:13 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-67221ae6-d01d-40be-8a54-e97fcb0c6795 tempest-VolumesActionsTest-88700137 None] Detach volume completed successfully. Jul 10 06:52:13 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-67221ae6-d01d-40be-8a54-e97fcb0c6795 tempest-VolumesActionsTest-88700137 None] Lock "cinder-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12-detach_volume" released by "detach_volume" :: held 0.077s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:52:17 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4134e06-e862-4b6d-8416-426017b71a25 tempest-SnapshotDependencyTests-1681923608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:52:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b4134e06-e862-4b6d-8416-426017b71a25 tempest-SnapshotDependencyTests-1681923608 None] Flow 'volume_create_manager' (40c9609f-ae29-48c6-8ff2-9bb3213ea694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:52:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b4134e06-e862-4b6d-8416-426017b71a25 tempest-SnapshotDependencyTests-1681923608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (442523a8-0b1c-40a3-81b2-8fdaba0c81e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:52:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b4134e06-e862-4b6d-8416-426017b71a25 tempest-SnapshotDependencyTests-1681923608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (442523a8-0b1c-40a3-81b2-8fdaba0c81e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-367972168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fc9b64a-13b5-456d-8a80-730348a337c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95ecc076bb204d6fa471f199534cae8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:52:17Z,use_quota=True,user_id='1725385082214249bc5cfa36a649cc11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:52:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b4134e06-e862-4b6d-8416-426017b71a25 tempest-SnapshotDependencyTests-1681923608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7d74620-e7f5-420d-8129-4a8f302f402d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:52:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b4134e06-e862-4b6d-8416-426017b71a25 tempest-SnapshotDependencyTests-1681923608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7d74620-e7f5-420d-8129-4a8f302f402d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:52:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b4134e06-e862-4b6d-8416-426017b71a25 tempest-SnapshotDependencyTests-1681923608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6823c2a-828d-4e60-8d47-e0fdef2531ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:52:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b4134e06-e862-4b6d-8416-426017b71a25 tempest-SnapshotDependencyTests-1681923608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6823c2a-828d-4e60-8d47-e0fdef2531ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fc9b64a-13b5-456d-8a80-730348a337c6', 'volume_name': 'volume-0fc9b64a-13b5-456d-8a80-730348a337c6', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:52:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b4134e06-e862-4b6d-8416-426017b71a25 tempest-SnapshotDependencyTests-1681923608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b218947-3b1e-4499-8b1b-6562cbe1fd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:52:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b4134e06-e862-4b6d-8416-426017b71a25 tempest-SnapshotDependencyTests-1681923608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b218947-3b1e-4499-8b1b-6562cbe1fd71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:52:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b4134e06-e862-4b6d-8416-426017b71a25 tempest-SnapshotDependencyTests-1681923608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f2a581d-3415-411d-8c40-4364eab3f812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:52:17 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-b4134e06-e862-4b6d-8416-426017b71a25 tempest-SnapshotDependencyTests-1681923608 None] Volume 0fc9b64a-13b5-456d-8a80-730348a337c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fc9b64a-13b5-456d-8a80-730348a337c6', 'volume_size': 1} Jul 10 06:52:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b4134e06-e862-4b6d-8416-426017b71a25 tempest-SnapshotDependencyTests-1681923608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:52:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b4134e06-e862-4b6d-8416-426017b71a25 tempest-SnapshotDependencyTests-1681923608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:52:17 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b4134e06-e862-4b6d-8416-426017b71a25 tempest-SnapshotDependencyTests-1681923608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-367972168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fc9b64a-13b5-456d-8a80-730348a337c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95ecc076bb204d6fa471f199534cae8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:52:17Z,use_quota=True,user_id='1725385082214249bc5cfa36a649cc11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:52:17 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-b4134e06-e862-4b6d-8416-426017b71a25 tempest-SnapshotDependencyTests-1681923608 None] Creating volume 0fc9b64a-13b5-456d-8a80-730348a337c6 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:52:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b4134e06-e862-4b6d-8416-426017b71a25 tempest-SnapshotDependencyTests-1681923608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:52:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b4134e06-e862-4b6d-8416-426017b71a25 tempest-SnapshotDependencyTests-1681923608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:52:17 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b4134e06-e862-4b6d-8416-426017b71a25 tempest-SnapshotDependencyTests-1681923608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:52:17 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b4134e06-e862-4b6d-8416-426017b71a25 tempest-SnapshotDependencyTests-1681923608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:52:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b4134e06-e862-4b6d-8416-426017b71a25 tempest-SnapshotDependencyTests-1681923608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:52:17 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b4134e06-e862-4b6d-8416-426017b71a25 tempest-SnapshotDependencyTests-1681923608 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:52:17 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-b4134e06-e862-4b6d-8416-426017b71a25 tempest-SnapshotDependencyTests-1681923608 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:52:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b4134e06-e862-4b6d-8416-426017b71a25 tempest-SnapshotDependencyTests-1681923608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:17 devstack sudo[103616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6 1073741824 Jul 10 06:52:17 devstack sudo[103616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:18 devstack sudo[103616]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b4134e06-e862-4b6d-8416-426017b71a25 tempest-SnapshotDependencyTests-1681923608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6 1073741824" returned: 0 in 1.081s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b4134e06-e862-4b6d-8416-426017b71a25 tempest-SnapshotDependencyTests-1681923608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:18 devstack sudo[103628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6 Jul 10 06:52:18 devstack sudo[103628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:19 devstack sudo[103628]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b4134e06-e862-4b6d-8416-426017b71a25 tempest-SnapshotDependencyTests-1681923608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6" returned: 0 in 0.829s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:19 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b4134e06-e862-4b6d-8416-426017b71a25 tempest-SnapshotDependencyTests-1681923608 None] <== create_volume: return (1955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:52:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b4134e06-e862-4b6d-8416-426017b71a25 tempest-SnapshotDependencyTests-1681923608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.960s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:52:19 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b4134e06-e862-4b6d-8416-426017b71a25 tempest-SnapshotDependencyTests-1681923608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f2a581d-3415-411d-8c40-4364eab3f812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fc9b64a-13b5-456d-8a80-730348a337c6', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:52:19 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b4134e06-e862-4b6d-8416-426017b71a25 tempest-SnapshotDependencyTests-1681923608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57e44d1a-a0b6-44c1-8a42-46c9492fcd85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:52:19 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-b4134e06-e862-4b6d-8416-426017b71a25 tempest-SnapshotDependencyTests-1681923608 None] Volume volume-0fc9b64a-13b5-456d-8a80-730348a337c6 (0fc9b64a-13b5-456d-8a80-730348a337c6): created successfully Jul 10 06:52:19 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b4134e06-e862-4b6d-8416-426017b71a25 tempest-SnapshotDependencyTests-1681923608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57e44d1a-a0b6-44c1-8a42-46c9492fcd85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:52:19 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b4134e06-e862-4b6d-8416-426017b71a25 tempest-SnapshotDependencyTests-1681923608 None] Flow 'volume_create_manager' (40c9609f-ae29-48c6-8ff2-9bb3213ea694) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:52:19 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-b4134e06-e862-4b6d-8416-426017b71a25 tempest-SnapshotDependencyTests-1681923608 None] Created volume successfully. Jul 10 06:52:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-1336fca8-0ac7-4325-96e4-38c3741c0371 tempest-SnapshotDependencyTests-1681923608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:52:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-1336fca8-0ac7-4325-96e4-38c3741c0371 tempest-SnapshotDependencyTests-1681923608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:52:20 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-1336fca8-0ac7-4325-96e4-38c3741c0371 tempest-SnapshotDependencyTests-1681923608 None] Creating offline snapshot 7ede01e9-ae34-4f83-b57e-b3d883851e41 of volume 0fc9b64a-13b5-456d-8a80-730348a337c6 {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:52:20 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8da0e83-5d0d-4a88-9798-b1a8bf45e5be]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:52:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1336fca8-0ac7-4325-96e4-38c3741c0371 tempest-SnapshotDependencyTests-1681923608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:20 devstack sudo[103650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6 Jul 10 06:52:20 devstack sudo[103650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:21 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-9c47284e-7f97-41d3-ab69-56b525a5916d req-9c99ee32-b565-4f05-8fdf-96d38d925eea tempest-TestShelveInstance-522639284 None] Terminate volume connection completed successfully. Jul 10 06:52:21 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-9c47284e-7f97-41d3-ab69-56b525a5916d req-9c99ee32-b565-4f05-8fdf-96d38d925eea tempest-TestShelveInstance-522639284 None] Deleting attachment 1be852af-0fb4-4ee2-9d22-84ece1b866ec. {{(pid=87294) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:52:21 devstack sudo[103650]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1336fca8-0ac7-4325-96e4-38c3741c0371 tempest-SnapshotDependencyTests-1681923608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6" returned: 0 in 0.786s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1336fca8-0ac7-4325-96e4-38c3741c0371 tempest-SnapshotDependencyTests-1681923608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6.7ede01e9-ae34-4f83-b57e-b3d883851e41 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:21 devstack sudo[103655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6.7ede01e9-ae34-4f83-b57e-b3d883851e41 1G Jul 10 06:52:21 devstack sudo[103655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:21 devstack cinder-volume[87294]: DEBUG cinder.coordination [req-9c47284e-7f97-41d3-ab69-56b525a5916d req-d5ff50f5-c71b-40f6-b0b9-b20d392e813b tempest-TestShelveInstance-522639284 None] Acquiring lock "cinder-1b7985d9-0694-4f31-8003-55116f99eb3c-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:52:21 devstack cinder-volume[87294]: DEBUG cinder.coordination [req-9c47284e-7f97-41d3-ab69-56b525a5916d req-d5ff50f5-c71b-40f6-b0b9-b20d392e813b tempest-TestShelveInstance-522639284 None] Lock "cinder-1b7985d9-0694-4f31-8003-55116f99eb3c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:52:21 devstack cinder-volume[87294]: DEBUG cinder.coordination [req-9c47284e-7f97-41d3-ab69-56b525a5916d req-d5ff50f5-c71b-40f6-b0b9-b20d392e813b tempest-TestShelveInstance-522639284 None] Acquiring lock "cinder-quobyte-1b7985d9-0694-4f31-8003-55116f99eb3c" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:52:21 devstack cinder-volume[87294]: DEBUG cinder.coordination [req-9c47284e-7f97-41d3-ab69-56b525a5916d req-d5ff50f5-c71b-40f6-b0b9-b20d392e813b tempest-TestShelveInstance-522639284 None] Lock "cinder-quobyte-1b7985d9-0694-4f31-8003-55116f99eb3c" acquired by "delete_volume" :: waited 0.023s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:52:21 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:52:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:52:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:52:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:52:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:52:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:52:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:21 devstack sudo[103691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:52:21 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f517b0c-79be-4b9a-bf60-4c18ee632c00]: (4, 'raw') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:52:21 devstack sudo[103691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-9c47284e-7f97-41d3-ab69-56b525a5916d req-d5ff50f5-c71b-40f6-b0b9-b20d392e813b tempest-TestShelveInstance-522639284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b7985d9-0694-4f31-8003-55116f99eb3c {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:22 devstack sudo[103693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b7985d9-0694-4f31-8003-55116f99eb3c Jul 10 06:52:22 devstack sudo[103693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:22 devstack sudo[103655]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1336fca8-0ac7-4325-96e4-38c3741c0371 tempest-SnapshotDependencyTests-1681923608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6.7ede01e9-ae34-4f83-b57e-b3d883851e41 1G" returned: 0 in 0.912s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1336fca8-0ac7-4325-96e4-38c3741c0371 tempest-SnapshotDependencyTests-1681923608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fc9b64a-13b5-456d-8a80-730348a337c6 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6.7ede01e9-ae34-4f83-b57e-b3d883851e41 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:22 devstack sudo[103702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fc9b64a-13b5-456d-8a80-730348a337c6 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6.7ede01e9-ae34-4f83-b57e-b3d883851e41 Jul 10 06:52:22 devstack sudo[103702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:22 devstack sudo[103691]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.747s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:22 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:52:22 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager._thread_info {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:52:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread count: 28 {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:52:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread info: [<_MainThread(MainThread, started 139245706264704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:52:22 devstack sudo[103693]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-9c47284e-7f97-41d3-ab69-56b525a5916d req-d5ff50f5-c71b-40f6-b0b9-b20d392e813b tempest-TestShelveInstance-522639284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b7985d9-0694-4f31-8003-55116f99eb3c" returned: 0 in 0.892s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-9c47284e-7f97-41d3-ab69-56b525a5916d req-d5ff50f5-c71b-40f6-b0b9-b20d392e813b tempest-TestShelveInstance-522639284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b7985d9-0694-4f31-8003-55116f99eb3c {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:22 devstack sudo[103707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b7985d9-0694-4f31-8003-55116f99eb3c Jul 10 06:52:22 devstack sudo[103707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:23 devstack sudo[103702]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1336fca8-0ac7-4325-96e4-38c3741c0371 tempest-SnapshotDependencyTests-1681923608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fc9b64a-13b5-456d-8a80-730348a337c6 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6.7ede01e9-ae34-4f83-b57e-b3d883851e41" returned: 0 in 0.882s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:23 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-1336fca8-0ac7-4325-96e4-38c3741c0371 tempest-SnapshotDependencyTests-1681923608 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6.7ede01e9-ae34-4f83-b57e-b3d883851e41 is being set with open permissions: ugo+rw Jul 10 06:52:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1336fca8-0ac7-4325-96e4-38c3741c0371 tempest-SnapshotDependencyTests-1681923608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6.7ede01e9-ae34-4f83-b57e-b3d883851e41 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:23 devstack sudo[103713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6.7ede01e9-ae34-4f83-b57e-b3d883851e41 Jul 10 06:52:23 devstack sudo[103713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:23 devstack sudo[103707]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-9c47284e-7f97-41d3-ab69-56b525a5916d req-d5ff50f5-c71b-40f6-b0b9-b20d392e813b tempest-TestShelveInstance-522639284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b7985d9-0694-4f31-8003-55116f99eb3c" returned: 1 in 0.861s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-9c47284e-7f97-41d3-ab69-56b525a5916d req-d5ff50f5-c71b-40f6-b0b9-b20d392e813b tempest-TestShelveInstance-522639284 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b7985d9-0694-4f31-8003-55116f99eb3c' failed. Not Retrying. {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:52:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-9c47284e-7f97-41d3-ab69-56b525a5916d req-d5ff50f5-c71b-40f6-b0b9-b20d392e813b tempest-TestShelveInstance-522639284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b7985d9-0694-4f31-8003-55116f99eb3c {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:23 devstack sudo[103721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b7985d9-0694-4f31-8003-55116f99eb3c Jul 10 06:52:23 devstack sudo[103721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:24 devstack sudo[103713]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1336fca8-0ac7-4325-96e4-38c3741c0371 tempest-SnapshotDependencyTests-1681923608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6.7ede01e9-ae34-4f83-b57e-b3d883851e41" returned: 0 in 0.807s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1336fca8-0ac7-4325-96e4-38c3741c0371 tempest-SnapshotDependencyTests-1681923608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:24 devstack sudo[103724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6.info Jul 10 06:52:24 devstack sudo[103724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:24 devstack sudo[103721]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-9c47284e-7f97-41d3-ab69-56b525a5916d req-d5ff50f5-c71b-40f6-b0b9-b20d392e813b tempest-TestShelveInstance-522639284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1b7985d9-0694-4f31-8003-55116f99eb3c" returned: 0 in 0.675s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:24 devstack cinder-volume[87294]: DEBUG cinder.coordination [req-9c47284e-7f97-41d3-ab69-56b525a5916d req-d5ff50f5-c71b-40f6-b0b9-b20d392e813b tempest-TestShelveInstance-522639284 None] Lock "cinder-quobyte-1b7985d9-0694-4f31-8003-55116f99eb3c" released by "delete_volume" :: held 2.532s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:52:24 devstack cinder-volume[87294]: DEBUG cinder.quota [req-9c47284e-7f97-41d3-ab69-56b525a5916d req-d5ff50f5-c71b-40f6-b0b9-b20d392e813b tempest-TestShelveInstance-522639284 None] Created reservations ['5abb98d5-61b6-44e4-892c-28efe5f35db2', '0736f748-dac4-487b-8912-15a296b7382b', '108a3533-d444-4213-9e36-62cfdff8fb7b', '2f83f5b3-3d10-435d-a54c-5b1177e5ce69'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:52:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-9c47284e-7f97-41d3-ab69-56b525a5916d req-d5ff50f5-c71b-40f6-b0b9-b20d392e813b tempest-TestShelveInstance-522639284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:52:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-9c47284e-7f97-41d3-ab69-56b525a5916d req-d5ff50f5-c71b-40f6-b0b9-b20d392e813b tempest-TestShelveInstance-522639284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:52:24 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [req-9c47284e-7f97-41d3-ab69-56b525a5916d req-d5ff50f5-c71b-40f6-b0b9-b20d392e813b tempest-TestShelveInstance-522639284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:52:24 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [req-9c47284e-7f97-41d3-ab69-56b525a5916d req-d5ff50f5-c71b-40f6-b0b9-b20d392e813b tempest-TestShelveInstance-522639284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:52:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-9c47284e-7f97-41d3-ab69-56b525a5916d req-d5ff50f5-c71b-40f6-b0b9-b20d392e813b tempest-TestShelveInstance-522639284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:52:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-9c47284e-7f97-41d3-ab69-56b525a5916d req-d5ff50f5-c71b-40f6-b0b9-b20d392e813b tempest-TestShelveInstance-522639284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:24 devstack sudo[103727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:52:24 devstack sudo[103727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:24 devstack sudo[103724]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1336fca8-0ac7-4325-96e4-38c3741c0371 tempest-SnapshotDependencyTests-1681923608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6.info" returned: 0 in 0.700s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:24 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-1336fca8-0ac7-4325-96e4-38c3741c0371 tempest-SnapshotDependencyTests-1681923608 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6.info is being set with open permissions: ugo+rw Jul 10 06:52:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1336fca8-0ac7-4325-96e4-38c3741c0371 tempest-SnapshotDependencyTests-1681923608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:24 devstack sudo[103730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6.info Jul 10 06:52:24 devstack sudo[103730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:25 devstack sudo[103727]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-9c47284e-7f97-41d3-ab69-56b525a5916d req-d5ff50f5-c71b-40f6-b0b9-b20d392e813b tempest-TestShelveInstance-522639284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.746s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:25 devstack cinder-volume[87294]: DEBUG cinder.manager [req-9c47284e-7f97-41d3-ab69-56b525a5916d req-d5ff50f5-c71b-40f6-b0b9-b20d392e813b tempest-TestShelveInstance-522639284 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:52:25 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-9c47284e-7f97-41d3-ab69-56b525a5916d req-d5ff50f5-c71b-40f6-b0b9-b20d392e813b tempest-TestShelveInstance-522639284 None] Deleted volume successfully. Jul 10 06:52:25 devstack cinder-volume[87294]: DEBUG cinder.coordination [req-9c47284e-7f97-41d3-ab69-56b525a5916d req-d5ff50f5-c71b-40f6-b0b9-b20d392e813b tempest-TestShelveInstance-522639284 None] Lock "cinder-1b7985d9-0694-4f31-8003-55116f99eb3c-delete_volume" released by "delete_volume" :: held 3.560s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:52:25 devstack sudo[103730]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1336fca8-0ac7-4325-96e4-38c3741c0371 tempest-SnapshotDependencyTests-1681923608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6.info" returned: 0 in 0.711s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-1336fca8-0ac7-4325-96e4-38c3741c0371 tempest-SnapshotDependencyTests-1681923608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.894s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:52:25 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-1336fca8-0ac7-4325-96e4-38c3741c0371 tempest-SnapshotDependencyTests-1681923608 None] Create snapshot completed successfully Jul 10 06:52:26 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:52:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Flow 'volume_create_manager' (ef8b39a8-3598-4e19-b8b7-c2ec1aa850dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:52:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2ff9ee1-50c6-47ae-8559-f89d189d7eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:52:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2ff9ee1-50c6-47ae-8559-f89d189d7eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28a828be-f94e-4326-ac61-62932ddfba2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95ecc076bb204d6fa471f199534cae8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:52:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7ede01e9-ae34-4f83-b57e-b3d883851e41,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:52:27Z,use_quota=True,user_id='1725385082214249bc5cfa36a649cc11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:52:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4beb5a17-1e90-4e2c-9f45-80bf93c8f021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:52:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4beb5a17-1e90-4e2c-9f45-80bf93c8f021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:52:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13398e2e-1a3f-4e46-8e56-c8cb9d273151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:52:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13398e2e-1a3f-4e46-8e56-c8cb9d273151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '28a828be-f94e-4326-ac61-62932ddfba2b', 'volume_name': 'volume-28a828be-f94e-4326-ac61-62932ddfba2b', 'volume_size': 1, 'snapshot_id': '7ede01e9-ae34-4f83-b57e-b3d883851e41'}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:52:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f145e21-f362-4e94-b1b2-82fd6dcaeeb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:52:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f145e21-f362-4e94-b1b2-82fd6dcaeeb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:52:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebb01c06-a155-4554-986c-ff2d4b2d17d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:52:26 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Volume 28a828be-f94e-4326-ac61-62932ddfba2b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-28a828be-f94e-4326-ac61-62932ddfba2b', 'volume_size': 1, 'snapshot_id': '7ede01e9-ae34-4f83-b57e-b3d883851e41'} Jul 10 06:52:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:52:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:52:26 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Acquiring lock "cinder-quobyte-7ede01e9-ae34-4f83-b57e-b3d883851e41-28a828be-f94e-4326-ac61-62932ddfba2b" by "_create_volume_from_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:52:26 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Lock "cinder-quobyte-7ede01e9-ae34-4f83-b57e-b3d883851e41-28a828be-f94e-4326-ac61-62932ddfba2b" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:52:26 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Creating volume 28a828be-f94e-4326-ac61-62932ddfba2b from snapshot 7ede01e9-ae34-4f83-b57e-b3d883851e41 {{(pid=87294) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 06:52:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:52:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:52:26 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:52:26 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:52:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:52:26 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:52:26 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Acquiring lock "cinder-quobyte-28a828be-f94e-4326-ac61-62932ddfba2b" by "_copy_volume_from_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:52:26 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Lock "cinder-quobyte-28a828be-f94e-4326-ac61-62932ddfba2b" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:52:26 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] snapshot: 7ede01e9-ae34-4f83-b57e-b3d883851e41, volume: 28a828be-f94e-4326-ac61-62932ddfba2b, {{(pid=87294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 06:52:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:52:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:52:26 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:52:26 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:52:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:52:26 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5235e1-0ea0-4575-b736-c85a1de4b15b]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:52:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6.7ede01e9-ae34-4f83-b57e-b3d883851e41 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:26 devstack sudo[103734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6.7ede01e9-ae34-4f83-b57e-b3d883851e41 Jul 10 06:52:26 devstack sudo[103734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:27 devstack sudo[103734]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6.7ede01e9-ae34-4f83-b57e-b3d883851e41" returned: 0 in 0.832s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:27 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fc9b64a-13b5-456d-8a80-730348a337c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:52:27 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6 {{(pid=87294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 06:52:27 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Creating direct copy from snapshot {{(pid=87294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 06:52:27 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[255d7837-615f-4686-95d5-77f32b4a32a2]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:52:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:27 devstack sudo[103741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6 Jul 10 06:52:27 devstack sudo[103741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:28 devstack sudo[103741]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6" returned: 0 in 0.928s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:28 devstack cinder-volume[87294]: DEBUG cinder.utils [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Path /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-28a828be-f94e-4326-ac61-62932ddfba2b not found in is_blk_device check {{(pid=87294) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 06:52:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-28a828be-f94e-4326-ac61-62932ddfba2b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:28 devstack sudo[103746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-28a828be-f94e-4326-ac61-62932ddfba2b Jul 10 06:52:28 devstack sudo[103746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:35 devstack sudo[103746]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-28a828be-f94e-4326-ac61-62932ddfba2b" returned: 0 in 6.614s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:35 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a3a412-95f9-442a-9e2d-92843932c36b]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:52:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:35 devstack sudo[103790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6 Jul 10 06:52:35 devstack sudo[103790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:36 devstack sudo[103790]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6" returned: 0 in 1.100s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:36 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6, size 1024.00 MB, duration 6.62 sec, destination /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-28a828be-f94e-4326-ac61-62932ddfba2b {{(pid=87294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 06:52:36 devstack cinder-volume[87294]: INFO cinder.image.image_utils [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Converted 1024.00 MB image at 154.78 MB/s Jul 10 06:52:36 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-28a828be-f94e-4326-ac61-62932ddfba2b is being set with open permissions: ugo+rw Jul 10 06:52:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-28a828be-f94e-4326-ac61-62932ddfba2b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:36 devstack sudo[103796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-28a828be-f94e-4326-ac61-62932ddfba2b Jul 10 06:52:36 devstack sudo[103796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:36 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:INSERT=4,cinder:SELECT=19,cinder:UPDATE=15,cinder:DELETE=1 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:52:36 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:SELECT=22,cinder:UPDATE=18,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:52:37 devstack sudo[103796]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-28a828be-f94e-4326-ac61-62932ddfba2b" returned: 0 in 0.821s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:37 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Lock "cinder-quobyte-28a828be-f94e-4326-ac61-62932ddfba2b" released by "_copy_volume_from_snapshot" :: held 10.424s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:52:37 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Lock "cinder-quobyte-7ede01e9-ae34-4f83-b57e-b3d883851e41-28a828be-f94e-4326-ac61-62932ddfba2b" released by "_create_volume_from_snapshot" :: held 10.458s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:52:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.475s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:52:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebb01c06-a155-4554-986c-ff2d4b2d17d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28a828be-f94e-4326-ac61-62932ddfba2b', 'volume_size': 1, 'snapshot_id': '7ede01e9-ae34-4f83-b57e-b3d883851e41'}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:52:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93d2befa-6657-4a11-b0cf-8aa02c01a493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:52:37 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Volume volume-28a828be-f94e-4326-ac61-62932ddfba2b (28a828be-f94e-4326-ac61-62932ddfba2b): created successfully Jul 10 06:52:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93d2befa-6657-4a11-b0cf-8aa02c01a493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:52:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Flow 'volume_create_manager' (ef8b39a8-3598-4e19-b8b7-c2ec1aa850dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:52:37 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-43af6a7f-b632-4e26-8378-4db6c076c612 tempest-SnapshotDependencyTests-1681923608 None] Created volume successfully. Jul 10 06:52:37 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d822b468-7661-453c-b6c0-04454c119872 tempest-SnapshotDependencyTests-1681923608 None] Acquiring lock "cinder-7ede01e9-ae34-4f83-b57e-b3d883851e41-delete_snapshot" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:52:37 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d822b468-7661-453c-b6c0-04454c119872 tempest-SnapshotDependencyTests-1681923608 None] Lock "cinder-7ede01e9-ae34-4f83-b57e-b3d883851e41-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:52:37 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d822b468-7661-453c-b6c0-04454c119872 tempest-SnapshotDependencyTests-1681923608 None] Acquiring lock "cinder-quobyte-0fc9b64a-13b5-456d-8a80-730348a337c6" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:52:37 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d822b468-7661-453c-b6c0-04454c119872 tempest-SnapshotDependencyTests-1681923608 None] Lock "cinder-quobyte-0fc9b64a-13b5-456d-8a80-730348a337c6" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:52:37 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d822b468-7661-453c-b6c0-04454c119872 tempest-SnapshotDependencyTests-1681923608 None] Acquiring lock "cinder-quobyte-7ede01e9-ae34-4f83-b57e-b3d883851e41" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:52:37 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d822b468-7661-453c-b6c0-04454c119872 tempest-SnapshotDependencyTests-1681923608 None] Lock "cinder-quobyte-7ede01e9-ae34-4f83-b57e-b3d883851e41" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:52:37 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-d822b468-7661-453c-b6c0-04454c119872 tempest-SnapshotDependencyTests-1681923608 None] Deleting offline snapshot 7ede01e9-ae34-4f83-b57e-b3d883851e41 of volume 0fc9b64a-13b5-456d-8a80-730348a337c6 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:52:38 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-d822b468-7661-453c-b6c0-04454c119872 tempest-SnapshotDependencyTests-1681923608 None] snapshot_file for this snap is: volume-0fc9b64a-13b5-456d-8a80-730348a337c6.7ede01e9-ae34-4f83-b57e-b3d883851e41 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:52:38 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[67eca57c-babd-4fb0-9125-7025b4eefa9d]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:52:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d822b468-7661-453c-b6c0-04454c119872 tempest-SnapshotDependencyTests-1681923608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6.7ede01e9-ae34-4f83-b57e-b3d883851e41 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:38 devstack sudo[103846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6.7ede01e9-ae34-4f83-b57e-b3d883851e41 Jul 10 06:52:38 devstack sudo[103846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:38 devstack sudo[103846]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d822b468-7661-453c-b6c0-04454c119872 tempest-SnapshotDependencyTests-1681923608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6.7ede01e9-ae34-4f83-b57e-b3d883851e41" returned: 0 in 0.856s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:38 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-d822b468-7661-453c-b6c0-04454c119872 tempest-SnapshotDependencyTests-1681923608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fc9b64a-13b5-456d-8a80-730348a337c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:52:38 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e64c54-d7b5-4dd1-9fb7-7c17102fd998]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:52:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d822b468-7661-453c-b6c0-04454c119872 tempest-SnapshotDependencyTests-1681923608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:39 devstack sudo[103871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6 Jul 10 06:52:39 devstack sudo[103871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:39 devstack sudo[103871]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d822b468-7661-453c-b6c0-04454c119872 tempest-SnapshotDependencyTests-1681923608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6" returned: 0 in 0.906s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d822b468-7661-453c-b6c0-04454c119872 tempest-SnapshotDependencyTests-1681923608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6.7ede01e9-ae34-4f83-b57e-b3d883851e41 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:39 devstack sudo[103879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6.7ede01e9-ae34-4f83-b57e-b3d883851e41 Jul 10 06:52:39 devstack sudo[103879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:40 devstack sudo[103879]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d822b468-7661-453c-b6c0-04454c119872 tempest-SnapshotDependencyTests-1681923608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6.7ede01e9-ae34-4f83-b57e-b3d883851e41" returned: 0 in 0.995s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d822b468-7661-453c-b6c0-04454c119872 tempest-SnapshotDependencyTests-1681923608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6.7ede01e9-ae34-4f83-b57e-b3d883851e41 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:40 devstack sudo[103884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6.7ede01e9-ae34-4f83-b57e-b3d883851e41 Jul 10 06:52:40 devstack sudo[103884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:41 devstack sudo[103884]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d822b468-7661-453c-b6c0-04454c119872 tempest-SnapshotDependencyTests-1681923608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6.7ede01e9-ae34-4f83-b57e-b3d883851e41" returned: 0 in 0.779s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d822b468-7661-453c-b6c0-04454c119872 tempest-SnapshotDependencyTests-1681923608 None] Lock "cinder-quobyte-7ede01e9-ae34-4f83-b57e-b3d883851e41" released by "_delete_snapshot" :: held 3.701s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:52:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d822b468-7661-453c-b6c0-04454c119872 tempest-SnapshotDependencyTests-1681923608 None] Lock "cinder-quobyte-0fc9b64a-13b5-456d-8a80-730348a337c6" released by "delete_snapshot" :: held 3.734s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:52:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-164ade63-0a90-4a34-8699-57af3ddea4e7 tempest-VolumesActionsTest-88700137 None] Acquiring lock "cinder-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12" by "attach_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:52:41 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-d822b468-7661-453c-b6c0-04454c119872 tempest-SnapshotDependencyTests-1681923608 None] Created reservations ['c83d3147-04d3-46e1-8531-e1ff2f0e6e49', '99c5a908-c501-4dd5-9627-73afbab8097b', 'd56a4304-86b6-4aa2-952f-f33f9766c847', '854a5d0b-341a-465f-b231-d2ac21202717'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:52:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-164ade63-0a90-4a34-8699-57af3ddea4e7 tempest-VolumesActionsTest-88700137 None] Lock "cinder-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12" acquired by "attach_volume" :: waited 0.032s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:52:41 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-164ade63-0a90-4a34-8699-57af3ddea4e7 tempest-VolumesActionsTest-88700137 None] Attaching volume d3dfdc94-ff2f-48fb-ab55-f3296c8baa12 to instance 47d8ae44-b769-47f5-9214-3dc90d67ad0b at mountpoint /dev/vdb on host None. Jul 10 06:52:41 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-d822b468-7661-453c-b6c0-04454c119872 tempest-SnapshotDependencyTests-1681923608 None] Delete snapshot completed successfully. Jul 10 06:52:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d822b468-7661-453c-b6c0-04454c119872 tempest-SnapshotDependencyTests-1681923608 None] Lock "cinder-7ede01e9-ae34-4f83-b57e-b3d883851e41-delete_snapshot" released by "delete_snapshot" :: held 3.962s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:52:41 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-164ade63-0a90-4a34-8699-57af3ddea4e7 tempest-VolumesActionsTest-88700137 None] Attach volume completed successfully. Jul 10 06:52:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-164ade63-0a90-4a34-8699-57af3ddea4e7 tempest-VolumesActionsTest-88700137 None] Lock "cinder-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12" released by "attach_volume" :: held 0.136s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:52:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-68605331-d8b4-4a94-8ea1-b3b950b7ae11 tempest-SnapshotDependencyTests-1681923608 None] Acquiring lock "cinder-0fc9b64a-13b5-456d-8a80-730348a337c6-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:52:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-68605331-d8b4-4a94-8ea1-b3b950b7ae11 tempest-SnapshotDependencyTests-1681923608 None] Lock "cinder-0fc9b64a-13b5-456d-8a80-730348a337c6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:52:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-68605331-d8b4-4a94-8ea1-b3b950b7ae11 tempest-SnapshotDependencyTests-1681923608 None] Acquiring lock "cinder-quobyte-0fc9b64a-13b5-456d-8a80-730348a337c6" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:52:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-68605331-d8b4-4a94-8ea1-b3b950b7ae11 tempest-SnapshotDependencyTests-1681923608 None] Lock "cinder-quobyte-0fc9b64a-13b5-456d-8a80-730348a337c6" acquired by "delete_volume" :: waited 0.020s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:52:42 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[36121543-cc41-4a88-ac87-f31b2b03d50f]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:52:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-68605331-d8b4-4a94-8ea1-b3b950b7ae11 tempest-SnapshotDependencyTests-1681923608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-8257840b-68f1-4e9f-9343-7a4b400165c7 tempest-VolumesActionsTest-88700137 None] Acquiring lock "cinder-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12-detach_volume" by "detach_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:52:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-8257840b-68f1-4e9f-9343-7a4b400165c7 tempest-VolumesActionsTest-88700137 None] Lock "cinder-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:52:42 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-8257840b-68f1-4e9f-9343-7a4b400165c7 tempest-VolumesActionsTest-88700137 None] Detaching volume d3dfdc94-ff2f-48fb-ab55-f3296c8baa12 from instance 47d8ae44-b769-47f5-9214-3dc90d67ad0b. Jul 10 06:52:42 devstack sudo[103887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6 Jul 10 06:52:42 devstack sudo[103887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:42 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-8257840b-68f1-4e9f-9343-7a4b400165c7 tempest-VolumesActionsTest-88700137 None] Detach volume completed successfully. Jul 10 06:52:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-8257840b-68f1-4e9f-9343-7a4b400165c7 tempest-VolumesActionsTest-88700137 None] Lock "cinder-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12-detach_volume" released by "detach_volume" :: held 0.090s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:52:43 devstack sudo[103887]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-68605331-d8b4-4a94-8ea1-b3b950b7ae11 tempest-SnapshotDependencyTests-1681923608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6" returned: 0 in 0.916s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-68605331-d8b4-4a94-8ea1-b3b950b7ae11 tempest-SnapshotDependencyTests-1681923608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:43 devstack sudo[103893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6 Jul 10 06:52:43 devstack sudo[103893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:44 devstack sudo[103893]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-68605331-d8b4-4a94-8ea1-b3b950b7ae11 tempest-SnapshotDependencyTests-1681923608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0fc9b64a-13b5-456d-8a80-730348a337c6" returned: 0 in 0.787s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:44 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-68605331-d8b4-4a94-8ea1-b3b950b7ae11 tempest-SnapshotDependencyTests-1681923608 None] Lock "cinder-quobyte-0fc9b64a-13b5-456d-8a80-730348a337c6" released by "delete_volume" :: held 1.802s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:52:44 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-68605331-d8b4-4a94-8ea1-b3b950b7ae11 tempest-SnapshotDependencyTests-1681923608 None] Created reservations ['23743e57-da33-44c5-b3df-e91287af41ef', '02b36e86-e44e-4f61-9dd6-8178ac31a0c9', 'c5c7c748-da35-486c-9a5d-da0900a67961', 'e988c818-fd3e-4f60-9808-5b19733b67f7'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:52:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-68605331-d8b4-4a94-8ea1-b3b950b7ae11 tempest-SnapshotDependencyTests-1681923608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:52:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-68605331-d8b4-4a94-8ea1-b3b950b7ae11 tempest-SnapshotDependencyTests-1681923608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:52:44 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-68605331-d8b4-4a94-8ea1-b3b950b7ae11 tempest-SnapshotDependencyTests-1681923608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:52:44 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-68605331-d8b4-4a94-8ea1-b3b950b7ae11 tempest-SnapshotDependencyTests-1681923608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:52:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-68605331-d8b4-4a94-8ea1-b3b950b7ae11 tempest-SnapshotDependencyTests-1681923608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:52:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-68605331-d8b4-4a94-8ea1-b3b950b7ae11 tempest-SnapshotDependencyTests-1681923608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:44 devstack sudo[103897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:52:44 devstack sudo[103897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:44 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1fe06d18-d10b-423b-a99b-be609e9ee4a7 tempest-SnapshotDependencyTests-1681923608 None] Acquiring lock "cinder-28a828be-f94e-4326-ac61-62932ddfba2b-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:52:44 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1fe06d18-d10b-423b-a99b-be609e9ee4a7 tempest-SnapshotDependencyTests-1681923608 None] Lock "cinder-28a828be-f94e-4326-ac61-62932ddfba2b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:52:44 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1fe06d18-d10b-423b-a99b-be609e9ee4a7 tempest-SnapshotDependencyTests-1681923608 None] Acquiring lock "cinder-quobyte-28a828be-f94e-4326-ac61-62932ddfba2b" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:52:44 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1fe06d18-d10b-423b-a99b-be609e9ee4a7 tempest-SnapshotDependencyTests-1681923608 None] Lock "cinder-quobyte-28a828be-f94e-4326-ac61-62932ddfba2b" acquired by "delete_volume" :: waited 0.018s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:52:44 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[26552a9d-0ee9-466d-902e-de1d8092ecca]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:52:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1fe06d18-d10b-423b-a99b-be609e9ee4a7 tempest-SnapshotDependencyTests-1681923608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-28a828be-f94e-4326-ac61-62932ddfba2b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:44 devstack sudo[103903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-28a828be-f94e-4326-ac61-62932ddfba2b Jul 10 06:52:44 devstack sudo[103903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:45 devstack sudo[103897]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-68605331-d8b4-4a94-8ea1-b3b950b7ae11 tempest-SnapshotDependencyTests-1681923608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.735s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:45 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-68605331-d8b4-4a94-8ea1-b3b950b7ae11 tempest-SnapshotDependencyTests-1681923608 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:52:45 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-68605331-d8b4-4a94-8ea1-b3b950b7ae11 tempest-SnapshotDependencyTests-1681923608 None] Deleted volume successfully. Jul 10 06:52:45 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-68605331-d8b4-4a94-8ea1-b3b950b7ae11 tempest-SnapshotDependencyTests-1681923608 None] Lock "cinder-0fc9b64a-13b5-456d-8a80-730348a337c6-delete_volume" released by "delete_volume" :: held 2.878s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:52:45 devstack sudo[103903]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1fe06d18-d10b-423b-a99b-be609e9ee4a7 tempest-SnapshotDependencyTests-1681923608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-28a828be-f94e-4326-ac61-62932ddfba2b" returned: 0 in 1.054s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1fe06d18-d10b-423b-a99b-be609e9ee4a7 tempest-SnapshotDependencyTests-1681923608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-28a828be-f94e-4326-ac61-62932ddfba2b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:45 devstack sudo[103925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-28a828be-f94e-4326-ac61-62932ddfba2b Jul 10 06:52:45 devstack sudo[103925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:46 devstack sudo[103925]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1fe06d18-d10b-423b-a99b-be609e9ee4a7 tempest-SnapshotDependencyTests-1681923608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-28a828be-f94e-4326-ac61-62932ddfba2b" returned: 0 in 0.772s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:46 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1fe06d18-d10b-423b-a99b-be609e9ee4a7 tempest-SnapshotDependencyTests-1681923608 None] Lock "cinder-quobyte-28a828be-f94e-4326-ac61-62932ddfba2b" released by "delete_volume" :: held 1.916s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:52:46 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:52:46 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Flow 'volume_create_manager' (8435d050-bf11-4412-b569-9c3e1f370cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:52:46 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cdb49e7-ac34-4534-8977-4b2aa1003c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:52:46 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cdb49e7-ac34-4534-8977-4b2aa1003c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:52:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d1bd67a-1c2c-4cf8-a947-f84d53851d85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd18b7ce1ea14129830dd1e14c4767c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:52:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:52:46Z,use_quota=True,user_id='9a503f047d6f40099c96b50b0bb1388a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63f91666-018e-4cef-b7e2-ca0969177be6),volume_type_id=63f91666-018e-4cef-b7e2-ca0969177be6)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:52:46 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c43731f-78bc-45fc-8792-5ec56447b8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:52:46 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c43731f-78bc-45fc-8792-5ec56447b8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:52:46 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f021f148-9893-439e-98dd-91fba15e6ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:52:46 devstack cinder-volume[87294]: DEBUG cinder.image.glance [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Creating Keystone auth plugin from conf {{(pid=87294) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 06:52:46 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-1fe06d18-d10b-423b-a99b-be609e9ee4a7 tempest-SnapshotDependencyTests-1681923608 None] Created reservations ['e422aa0d-5d5d-4bca-a072-126d75b48d2d', 'cda2ea00-a6d2-4d7a-b531-9c11f6d4670d', 'f1c08f8b-52eb-4fbf-8751-d2e152aa66ed', '4bf2d604-d6bf-4202-8351-89176d83022b'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:52:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-1fe06d18-d10b-423b-a99b-be609e9ee4a7 tempest-SnapshotDependencyTests-1681923608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:52:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-1fe06d18-d10b-423b-a99b-be609e9ee4a7 tempest-SnapshotDependencyTests-1681923608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:52:46 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-1fe06d18-d10b-423b-a99b-be609e9ee4a7 tempest-SnapshotDependencyTests-1681923608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:52:46 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-1fe06d18-d10b-423b-a99b-be609e9ee4a7 tempest-SnapshotDependencyTests-1681923608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:52:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-1fe06d18-d10b-423b-a99b-be609e9ee4a7 tempest-SnapshotDependencyTests-1681923608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:52:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1fe06d18-d10b-423b-a99b-be609e9ee4a7 tempest-SnapshotDependencyTests-1681923608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:46 devstack sudo[103930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:52:46 devstack sudo[103930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:46 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f021f148-9893-439e-98dd-91fba15e6ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2d1bd67a-1c2c-4cf8-a947-f84d53851d85', 'volume_name': 'volume-2d1bd67a-1c2c-4cf8-a947-f84d53851d85', 'volume_size': 1, 'image_id': '89ba0c2e-4354-41cb-a611-66f1c907ed88', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89ba0c2e-4354-41cb-a611-66f1c907ed88', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c8de704cac105723abf4534c6cec9198', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bd18b7ce1ea14129830dd1e14c4767c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fe92856ab62081ba29a096171f7e49873f61a38c3bfc2a5554c7f83fbbd97016c0200cb5a6f573157ba159ff182446f14c2252832ccc4ce5123c921d58e7abb6', 'id': '89ba0c2e-4354-41cb-a611-66f1c907ed88', 'created_at': datetime.datetime(2026, 7, 10, 4, 52, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 52, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89ba0c2e-4354-41cb-a611-66f1c907ed88/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:52:46 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c0667f5-233b-415e-80d1-7e80af4926a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:52:47 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c0667f5-233b-415e-80d1-7e80af4926a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:52:47 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9c86cc7-20e5-4ca5-8903-8c15712c71a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:52:47 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Volume 2d1bd67a-1c2c-4cf8-a947-f84d53851d85: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2d1bd67a-1c2c-4cf8-a947-f84d53851d85', 'volume_size': 1, 'image_id': '89ba0c2e-4354-41cb-a611-66f1c907ed88', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89ba0c2e-4354-41cb-a611-66f1c907ed88', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c8de704cac105723abf4534c6cec9198', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bd18b7ce1ea14129830dd1e14c4767c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fe92856ab62081ba29a096171f7e49873f61a38c3bfc2a5554c7f83fbbd97016c0200cb5a6f573157ba159ff182446f14c2252832ccc4ce5123c921d58e7abb6', 'id': '89ba0c2e-4354-41cb-a611-66f1c907ed88', 'created_at': datetime.datetime(2026, 7, 10, 4, 52, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 52, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89ba0c2e-4354-41cb-a611-66f1c907ed88/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 10 06:52:47 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Trying to clone 2d1bd67a-1c2c-4cf8-a947-f84d53851d85 from image 89ba0c2e-4354-41cb-a611-66f1c907ed88 at location (None, [{'url': 'file:///opt/stack/data/glance/images/89ba0c2e-4354-41cb-a611-66f1c907ed88', 'metadata': {}}]). {{(pid=87294) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 06:52:47 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_89ba0c2e-4354-41cb-a611-66f1c907ed88_rhxq8355devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87294) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 06:52:47 devstack cinder-volume[87294]: INFO cinder.image.image_utils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Image download 0.00 MB at 0.00 MB/s Jul 10 06:52:47 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[1203f071-e1b2-4cf7-9847-c9103ac67fcb]: (4, 'raw') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:52:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89ba0c2e-4354-41cb-a611-66f1c907ed88_rhxq8355devstack@QuobyteHD {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:47 devstack sudo[103932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89ba0c2e-4354-41cb-a611-66f1c907ed88_rhxq8355devstack@QuobyteHD Jul 10 06:52:47 devstack sudo[103932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:47 devstack sudo[103930]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1fe06d18-d10b-423b-a99b-be609e9ee4a7 tempest-SnapshotDependencyTests-1681923608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.724s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:47 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-1fe06d18-d10b-423b-a99b-be609e9ee4a7 tempest-SnapshotDependencyTests-1681923608 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:52:47 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-1fe06d18-d10b-423b-a99b-be609e9ee4a7 tempest-SnapshotDependencyTests-1681923608 None] Deleted volume successfully. Jul 10 06:52:47 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1fe06d18-d10b-423b-a99b-be609e9ee4a7 tempest-SnapshotDependencyTests-1681923608 None] Lock "cinder-28a828be-f94e-4326-ac61-62932ddfba2b-delete_volume" released by "delete_volume" :: held 2.978s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:52:48 devstack sudo[103932]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89ba0c2e-4354-41cb-a611-66f1c907ed88_rhxq8355devstack@QuobyteHD" returned: 0 in 0.848s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89ba0c2e-4354-41cb-a611-66f1c907ed88_rhxq8355devstack@QuobyteHD {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:48 devstack sudo[103937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89ba0c2e-4354-41cb-a611-66f1c907ed88_rhxq8355devstack@QuobyteHD Jul 10 06:52:48 devstack sudo[103937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:48 devstack sudo[103937]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89ba0c2e-4354-41cb-a611-66f1c907ed88_rhxq8355devstack@QuobyteHD" returned: 1 in 0.780s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89ba0c2e-4354-41cb-a611-66f1c907ed88_rhxq8355devstack@QuobyteHD' failed. Not Retrying. {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:52:48 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Temporary image 89ba0c2e-4354-41cb-a611-66f1c907ed88 is fetched for user 9a503f047d6f40099c96b50b0bb1388a. {{(pid=87294) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 06:52:48 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd56fab-ff12-4f21-9a55-3627a5f6b668]: (4, 'raw') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:52:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89ba0c2e-4354-41cb-a611-66f1c907ed88_rhxq8355devstack@QuobyteHD {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:49 devstack sudo[103943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89ba0c2e-4354-41cb-a611-66f1c907ed88_rhxq8355devstack@QuobyteHD Jul 10 06:52:49 devstack sudo[103943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:49 devstack sudo[103943]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89ba0c2e-4354-41cb-a611-66f1c907ed88_rhxq8355devstack@QuobyteHD" returned: 0 in 0.754s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89ba0c2e-4354-41cb-a611-66f1c907ed88_rhxq8355devstack@QuobyteHD {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:49 devstack sudo[103947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89ba0c2e-4354-41cb-a611-66f1c907ed88_rhxq8355devstack@QuobyteHD Jul 10 06:52:49 devstack sudo[103947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:50 devstack sudo[103947]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89ba0c2e-4354-41cb-a611-66f1c907ed88_rhxq8355devstack@QuobyteHD" returned: 1 in 0.874s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89ba0c2e-4354-41cb-a611-66f1c907ed88_rhxq8355devstack@QuobyteHD' failed. Not Retrying. {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:52:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:52:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:52:50 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:52:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d1bd67a-1c2c-4cf8-a947-f84d53851d85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd18b7ce1ea14129830dd1e14c4767c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:52:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:52:46Z,use_quota=True,user_id='9a503f047d6f40099c96b50b0bb1388a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63f91666-018e-4cef-b7e2-ca0969177be6),volume_type_id=63f91666-018e-4cef-b7e2-ca0969177be6)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:52:50 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Creating volume 2d1bd67a-1c2c-4cf8-a947-f84d53851d85 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:52:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:52:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:52:50 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:52:50 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:52:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:52:50 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:52:50 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:52:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2d1bd67a-1c2c-4cf8-a947-f84d53851d85 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:50 devstack sudo[103953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2d1bd67a-1c2c-4cf8-a947-f84d53851d85 1073741824 Jul 10 06:52:50 devstack sudo[103953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:51 devstack sudo[103953]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2d1bd67a-1c2c-4cf8-a947-f84d53851d85 1073741824" returned: 0 in 0.997s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2d1bd67a-1c2c-4cf8-a947-f84d53851d85 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:51 devstack sudo[103960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2d1bd67a-1c2c-4cf8-a947-f84d53851d85 Jul 10 06:52:51 devstack sudo[103960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:52 devstack sudo[103960]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2d1bd67a-1c2c-4cf8-a947-f84d53851d85" returned: 0 in 0.730s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:52 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] <== create_volume: return (1796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:52:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.801s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:52:52 devstack cinder-volume[87294]: DEBUG cinder.volume.volume_utils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Attempting download of 89ba0c2e-4354-41cb-a611-66f1c907ed88 ((None, [{'url': 'file:///opt/stack/data/glance/images/89ba0c2e-4354-41cb-a611-66f1c907ed88', 'metadata': {}}])) to volume 2d1bd67a-1c2c-4cf8-a947-f84d53851d85. {{(pid=87294) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 06:52:52 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4356a01-23db-4502-be30-fea774dff574]: (4, 'raw') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:52:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89ba0c2e-4354-41cb-a611-66f1c907ed88_ed4_p0ie {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:52 devstack sudo[103964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89ba0c2e-4354-41cb-a611-66f1c907ed88_ed4_p0ie Jul 10 06:52:52 devstack sudo[103964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-69ace546-c049-4cf9-af1d-7a91805440e3 tempest-VolumesActionsTest-88700137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:52:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-69ace546-c049-4cf9-af1d-7a91805440e3 tempest-VolumesActionsTest-88700137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:52:52 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d36e84-fe2f-4c85-8daf-47ab1fd304d2]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:52:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-69ace546-c049-4cf9-af1d-7a91805440e3 tempest-VolumesActionsTest-88700137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:52 devstack sudo[103966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12 Jul 10 06:52:52 devstack sudo[103966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:53 devstack sudo[103964]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89ba0c2e-4354-41cb-a611-66f1c907ed88_ed4_p0ie" returned: 0 in 0.808s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89ba0c2e-4354-41cb-a611-66f1c907ed88_ed4_p0ie {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:53 devstack sudo[103970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89ba0c2e-4354-41cb-a611-66f1c907ed88_ed4_p0ie Jul 10 06:52:53 devstack sudo[103970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:53 devstack sudo[103966]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-69ace546-c049-4cf9-af1d-7a91805440e3 tempest-VolumesActionsTest-88700137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12" returned: 0 in 0.846s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:53 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67f1ca2-a079-4895-955f-b12b8c182d4e]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:52:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-69ace546-c049-4cf9-af1d-7a91805440e3 tempest-VolumesActionsTest-88700137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:53 devstack sudo[103975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12 Jul 10 06:52:53 devstack sudo[103975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:54 devstack sudo[103970]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89ba0c2e-4354-41cb-a611-66f1c907ed88_ed4_p0ie" returned: 1 in 0.876s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89ba0c2e-4354-41cb-a611-66f1c907ed88_ed4_p0ie' failed. Not Retrying. {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:52:54 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[31078245-eeaf-4401-8479-2534170ca5d7]: (4, 'raw') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:52:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89ba0c2e-4354-41cb-a611-66f1c907ed88_rhxq8355devstack@QuobyteHD {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:54 devstack sudo[103980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89ba0c2e-4354-41cb-a611-66f1c907ed88_rhxq8355devstack@QuobyteHD Jul 10 06:52:54 devstack sudo[103980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:54 devstack sudo[103975]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-69ace546-c049-4cf9-af1d-7a91805440e3 tempest-VolumesActionsTest-88700137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12" returned: 0 in 0.890s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-69ace546-c049-4cf9-af1d-7a91805440e3 tempest-VolumesActionsTest-88700137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12 /opt/stack/data/cinder/conversion/d3dfdc94-ff2f-48fb-ab55-f3296c8baa12.temp_image.1c3a9457-b959-431b-b777-4e8d92c1d0cavnbzeqqu.img {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:54 devstack sudo[103985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12 /opt/stack/data/cinder/conversion/d3dfdc94-ff2f-48fb-ab55-f3296c8baa12.temp_image.1c3a9457-b959-431b-b777-4e8d92c1d0cavnbzeqqu.img Jul 10 06:52:54 devstack sudo[103985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:54 devstack sudo[103980]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89ba0c2e-4354-41cb-a611-66f1c907ed88_rhxq8355devstack@QuobyteHD" returned: 0 in 0.861s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89ba0c2e-4354-41cb-a611-66f1c907ed88_rhxq8355devstack@QuobyteHD {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:55 devstack sudo[103990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89ba0c2e-4354-41cb-a611-66f1c907ed88_rhxq8355devstack@QuobyteHD Jul 10 06:52:55 devstack sudo[103990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:56 devstack sudo[103990]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89ba0c2e-4354-41cb-a611-66f1c907ed88_rhxq8355devstack@QuobyteHD" returned: 1 in 1.722s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89ba0c2e-4354-41cb-a611-66f1c907ed88_rhxq8355devstack@QuobyteHD' failed. Not Retrying. {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:52:56 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] 89ba0c2e-4354-41cb-a611-66f1c907ed88 was raw, converting to raw {{(pid=87294) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 06:52:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_89ba0c2e-4354-41cb-a611-66f1c907ed88_rhxq8355devstack@QuobyteHD /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2d1bd67a-1c2c-4cf8-a947-f84d53851d85 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:56 devstack sudo[104008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_89ba0c2e-4354-41cb-a611-66f1c907ed88_rhxq8355devstack@QuobyteHD /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2d1bd67a-1c2c-4cf8-a947-f84d53851d85 Jul 10 06:52:56 devstack sudo[104008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:58 devstack sudo[104008]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_89ba0c2e-4354-41cb-a611-66f1c907ed88_rhxq8355devstack@QuobyteHD /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2d1bd67a-1c2c-4cf8-a947-f84d53851d85" returned: 0 in 1.864s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:52:58 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_89ba0c2e-4354-41cb-a611-66f1c907ed88_rhxq8355devstack@QuobyteHD, size 0.00 MB, duration 1.87 sec, destination /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2d1bd67a-1c2c-4cf8-a947-f84d53851d85 {{(pid=87294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 06:52:58 devstack cinder-volume[87294]: INFO cinder.image.image_utils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 06:52:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2d1bd67a-1c2c-4cf8-a947-f84d53851d85 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:52:58 devstack sudo[104014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2d1bd67a-1c2c-4cf8-a947-f84d53851d85 1G Jul 10 06:52:58 devstack sudo[104014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:52:59 devstack sudo[104014]: pam_unix(sudo:session): session closed for user root Jul 10 06:52:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2d1bd67a-1c2c-4cf8-a947-f84d53851d85 1G" returned: 0 in 1.400s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:00 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c35079b-4cc4-4dd9-8680-47708dc42784]: (4, 'raw') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2d1bd67a-1c2c-4cf8-a947-f84d53851d85 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:00 devstack sudo[103985]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-69ace546-c049-4cf9-af1d-7a91805440e3 tempest-VolumesActionsTest-88700137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12 /opt/stack/data/cinder/conversion/d3dfdc94-ff2f-48fb-ab55-f3296c8baa12.temp_image.1c3a9457-b959-431b-b777-4e8d92c1d0cavnbzeqqu.img" returned: 0 in 5.550s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:00 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad471d8b-c94a-400e-bc3f-1ae2116fa828]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-69ace546-c049-4cf9-af1d-7a91805440e3 tempest-VolumesActionsTest-88700137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:00 devstack sudo[104021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2d1bd67a-1c2c-4cf8-a947-f84d53851d85 Jul 10 06:53:00 devstack sudo[104021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:00 devstack sudo[104022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12 Jul 10 06:53:00 devstack sudo[104022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:00 devstack sudo[104021]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2d1bd67a-1c2c-4cf8-a947-f84d53851d85" returned: 0 in 0.753s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2d1bd67a-1c2c-4cf8-a947-f84d53851d85 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:00 devstack sudo[104029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2d1bd67a-1c2c-4cf8-a947-f84d53851d85 Jul 10 06:53:00 devstack sudo[104029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:01 devstack sudo[104022]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-69ace546-c049-4cf9-af1d-7a91805440e3 tempest-VolumesActionsTest-88700137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12" returned: 0 in 0.987s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:01 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-69ace546-c049-4cf9-af1d-7a91805440e3 tempest-VolumesActionsTest-88700137 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12, size 1024.00 MB, duration 5.55 sec, destination /opt/stack/data/cinder/conversion/d3dfdc94-ff2f-48fb-ab55-f3296c8baa12.temp_image.1c3a9457-b959-431b-b777-4e8d92c1d0cavnbzeqqu.img {{(pid=87294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 06:53:01 devstack cinder-volume[87294]: INFO cinder.image.image_utils [None req-69ace546-c049-4cf9-af1d-7a91805440e3 tempest-VolumesActionsTest-88700137 None] Converted 1024.00 MB image at 184.45 MB/s Jul 10 06:53:01 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-69ace546-c049-4cf9-af1d-7a91805440e3 tempest-VolumesActionsTest-88700137 None] 1c3a9457-b959-431b-b777-4e8d92c1d0ca was raw, no need to convert to raw {{(pid=87294) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 10 06:53:01 devstack sudo[104029]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2d1bd67a-1c2c-4cf8-a947-f84d53851d85" returned: 1 in 0.787s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2d1bd67a-1c2c-4cf8-a947-f84d53851d85' failed. Not Retrying. {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:53:01 devstack cinder-volume[87294]: DEBUG cinder.volume.volume_utils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Downloaded image 89ba0c2e-4354-41cb-a611-66f1c907ed88 ((None, [{'url': 'file:///opt/stack/data/glance/images/89ba0c2e-4354-41cb-a611-66f1c907ed88', 'metadata': {}}])) to volume 2d1bd67a-1c2c-4cf8-a947-f84d53851d85 successfully. {{(pid=87294) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 06:53:01 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Temporary image 89ba0c2e-4354-41cb-a611-66f1c907ed88 for user 9a503f047d6f40099c96b50b0bb1388a is deleted. {{(pid=87294) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 06:53:01 devstack cinder-volume[87294]: DEBUG cinder.volume.volume_utils [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Marking volume 2d1bd67a-1c2c-4cf8-a947-f84d53851d85 as bootable. {{(pid=87294) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 06:53:01 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Copying metadata from image 89ba0c2e-4354-41cb-a611-66f1c907ed88 to 2d1bd67a-1c2c-4cf8-a947-f84d53851d85. {{(pid=87294) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 06:53:01 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Creating volume glance metadata for volume 2d1bd67a-1c2c-4cf8-a947-f84d53851d85 backed by image 89ba0c2e-4354-41cb-a611-66f1c907ed88 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '89ba0c2e-4354-41cb-a611-66f1c907ed88', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'c8de704cac105723abf4534c6cec9198', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87294) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 06:53:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9c86cc7-20e5-4ca5-8903-8c15712c71a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d1bd67a-1c2c-4cf8-a947-f84d53851d85', 'volume_size': 1, 'image_id': '89ba0c2e-4354-41cb-a611-66f1c907ed88', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89ba0c2e-4354-41cb-a611-66f1c907ed88', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c8de704cac105723abf4534c6cec9198', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bd18b7ce1ea14129830dd1e14c4767c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fe92856ab62081ba29a096171f7e49873f61a38c3bfc2a5554c7f83fbbd97016c0200cb5a6f573157ba159ff182446f14c2252832ccc4ce5123c921d58e7abb6', 'id': '89ba0c2e-4354-41cb-a611-66f1c907ed88', 'created_at': datetime.datetime(2026, 7, 10, 4, 52, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 52, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89ba0c2e-4354-41cb-a611-66f1c907ed88/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (983776c7-8a5b-4b8d-9f97-30c5d885ee5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:01 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Volume volume-2d1bd67a-1c2c-4cf8-a947-f84d53851d85 (2d1bd67a-1c2c-4cf8-a947-f84d53851d85): created successfully Jul 10 06:53:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (983776c7-8a5b-4b8d-9f97-30c5d885ee5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Flow 'volume_create_manager' (8435d050-bf11-4412-b569-9c3e1f370cef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:53:01 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-755b05bc-6776-48ec-bb95-662374e268ec tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Created volume successfully. Jul 10 06:53:02 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-4b1c1086-7a77-4c33-9797-89a6bd0fd591 tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Acquiring lock "cinder-2d1bd67a-1c2c-4cf8-a947-f84d53851d85-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:53:02 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-4b1c1086-7a77-4c33-9797-89a6bd0fd591 tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Lock "cinder-2d1bd67a-1c2c-4cf8-a947-f84d53851d85-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:53:02 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-4b1c1086-7a77-4c33-9797-89a6bd0fd591 tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Acquiring lock "cinder-quobyte-2d1bd67a-1c2c-4cf8-a947-f84d53851d85" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:53:02 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-4b1c1086-7a77-4c33-9797-89a6bd0fd591 tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Lock "cinder-quobyte-2d1bd67a-1c2c-4cf8-a947-f84d53851d85" acquired by "delete_volume" :: waited 0.023s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:53:03 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f9f956-cfcf-4ae4-aca0-f2802aedaf03]: (4, 'raw') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-4b1c1086-7a77-4c33-9797-89a6bd0fd591 tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2d1bd67a-1c2c-4cf8-a947-f84d53851d85 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:03 devstack sudo[104035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2d1bd67a-1c2c-4cf8-a947-f84d53851d85 Jul 10 06:53:03 devstack sudo[104035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:03 devstack sudo[104035]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-4b1c1086-7a77-4c33-9797-89a6bd0fd591 tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2d1bd67a-1c2c-4cf8-a947-f84d53851d85" returned: 0 in 0.790s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-4b1c1086-7a77-4c33-9797-89a6bd0fd591 tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2d1bd67a-1c2c-4cf8-a947-f84d53851d85 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:03 devstack sudo[104039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2d1bd67a-1c2c-4cf8-a947-f84d53851d85 Jul 10 06:53:03 devstack sudo[104039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:04 devstack sudo[104039]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-4b1c1086-7a77-4c33-9797-89a6bd0fd591 tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2d1bd67a-1c2c-4cf8-a947-f84d53851d85" returned: 1 in 0.773s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-4b1c1086-7a77-4c33-9797-89a6bd0fd591 tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2d1bd67a-1c2c-4cf8-a947-f84d53851d85' failed. Not Retrying. {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:53:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-4b1c1086-7a77-4c33-9797-89a6bd0fd591 tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2d1bd67a-1c2c-4cf8-a947-f84d53851d85 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:04 devstack sudo[104044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2d1bd67a-1c2c-4cf8-a947-f84d53851d85 Jul 10 06:53:04 devstack sudo[104044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:05 devstack sudo[104044]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-4b1c1086-7a77-4c33-9797-89a6bd0fd591 tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2d1bd67a-1c2c-4cf8-a947-f84d53851d85" returned: 0 in 0.753s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:05 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-4b1c1086-7a77-4c33-9797-89a6bd0fd591 tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Lock "cinder-quobyte-2d1bd67a-1c2c-4cf8-a947-f84d53851d85" released by "delete_volume" :: held 2.387s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:53:05 devstack cinder-volume[87294]: WARNING cinder.quota [None req-4b1c1086-7a77-4c33-9797-89a6bd0fd591 tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:53:05 devstack cinder-volume[87294]: WARNING cinder.quota [None req-4b1c1086-7a77-4c33-9797-89a6bd0fd591 tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 10 06:53:05 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-4b1c1086-7a77-4c33-9797-89a6bd0fd591 tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Created reservations ['f57cdf46-36db-4524-82dd-0b602104efaa', '6506d180-bdd9-42c6-a9e5-e2a0d0550661', '36a8d7f6-17e6-4851-8511-813488e808a7', 'b7428717-52b4-4c09-8c88-8d1c85b9e378'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:53:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-4b1c1086-7a77-4c33-9797-89a6bd0fd591 tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-4b1c1086-7a77-4c33-9797-89a6bd0fd591 tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:05 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-4b1c1086-7a77-4c33-9797-89a6bd0fd591 tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:53:05 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-4b1c1086-7a77-4c33-9797-89a6bd0fd591 tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:53:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-4b1c1086-7a77-4c33-9797-89a6bd0fd591 tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-4b1c1086-7a77-4c33-9797-89a6bd0fd591 tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:05 devstack sudo[104047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:53:05 devstack sudo[104047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:06 devstack sudo[104047]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-4b1c1086-7a77-4c33-9797-89a6bd0fd591 tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.726s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:06 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-4b1c1086-7a77-4c33-9797-89a6bd0fd591 tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:53:06 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-4b1c1086-7a77-4c33-9797-89a6bd0fd591 tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Deleted volume successfully. Jul 10 06:53:06 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-4b1c1086-7a77-4c33-9797-89a6bd0fd591 tempest-VolumeAndVolumeTypeFromImageTest-422341435 None] Lock "cinder-2d1bd67a-1c2c-4cf8-a947-f84d53851d85-delete_volume" released by "delete_volume" :: held 3.441s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:53:11 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-59c04970-0961-41ca-bbe6-3192b2cd7a6d tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:53:12 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-59c04970-0961-41ca-bbe6-3192b2cd7a6d tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Flow 'volume_create_manager' (5ca945db-f445-4692-aa5d-2889d819d0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:53:12 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-59c04970-0961-41ca-bbe6-3192b2cd7a6d tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c26027e-362f-4f0b-8bcd-29a5bd02f4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:12 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-59c04970-0961-41ca-bbe6-3192b2cd7a6d tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c26027e-362f-4f0b-8bcd-29a5bd02f4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1120110487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d63b84c5-8d98-4a08-b84d-66e46104dac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f47af8e94ddb4ef68a9c4a9f3823d90b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:53:12Z,use_quota=True,user_id='d227d6e09a094806a96201d81a9b9b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:12 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-59c04970-0961-41ca-bbe6-3192b2cd7a6d tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a5a0f4c-e0ef-4e99-ac31-83d8ba93867f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:12 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-59c04970-0961-41ca-bbe6-3192b2cd7a6d tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a5a0f4c-e0ef-4e99-ac31-83d8ba93867f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:12 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-59c04970-0961-41ca-bbe6-3192b2cd7a6d tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19733084-33b6-4d5b-8fd5-720157995aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:12 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-59c04970-0961-41ca-bbe6-3192b2cd7a6d tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19733084-33b6-4d5b-8fd5-720157995aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd63b84c5-8d98-4a08-b84d-66e46104dac5', 'volume_name': 'volume-d63b84c5-8d98-4a08-b84d-66e46104dac5', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:12 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-59c04970-0961-41ca-bbe6-3192b2cd7a6d tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33d2e271-17d6-4986-b530-90522b3fc271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:12 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-59c04970-0961-41ca-bbe6-3192b2cd7a6d tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33d2e271-17d6-4986-b530-90522b3fc271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:12 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-59c04970-0961-41ca-bbe6-3192b2cd7a6d tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33eacfbd-4661-4f4c-a204-2ead49d6d699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:12 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-59c04970-0961-41ca-bbe6-3192b2cd7a6d tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Volume d63b84c5-8d98-4a08-b84d-66e46104dac5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d63b84c5-8d98-4a08-b84d-66e46104dac5', 'volume_size': 1} Jul 10 06:53:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-59c04970-0961-41ca-bbe6-3192b2cd7a6d tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-69ace546-c049-4cf9-af1d-7a91805440e3 tempest-VolumesActionsTest-88700137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.713s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:20 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-69ace546-c049-4cf9-af1d-7a91805440e3 tempest-VolumesActionsTest-88700137 None] Uploaded volume to glance image-id: 1c3a9457-b959-431b-b777-4e8d92c1d0ca. {{(pid=87294) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 10 06:53:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-59c04970-0961-41ca-bbe6-3192b2cd7a6d tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.369s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:20 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-59c04970-0961-41ca-bbe6-3192b2cd7a6d tempest-CreateVolumesFromSourceVolumeTest-561332917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1120110487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d63b84c5-8d98-4a08-b84d-66e46104dac5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f47af8e94ddb4ef68a9c4a9f3823d90b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:53:12Z,use_quota=True,user_id='d227d6e09a094806a96201d81a9b9b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:53:20 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-59c04970-0961-41ca-bbe6-3192b2cd7a6d tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Creating volume d63b84c5-8d98-4a08-b84d-66e46104dac5 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:53:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-59c04970-0961-41ca-bbe6-3192b2cd7a6d tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-59c04970-0961-41ca-bbe6-3192b2cd7a6d tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:20 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-59c04970-0961-41ca-bbe6-3192b2cd7a6d tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:53:20 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-59c04970-0961-41ca-bbe6-3192b2cd7a6d tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:53:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-59c04970-0961-41ca-bbe6-3192b2cd7a6d tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:20 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-59c04970-0961-41ca-bbe6-3192b2cd7a6d tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:53:20 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-59c04970-0961-41ca-bbe6-3192b2cd7a6d tempest-CreateVolumesFromSourceVolumeTest-561332917 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:53:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-59c04970-0961-41ca-bbe6-3192b2cd7a6d tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d63b84c5-8d98-4a08-b84d-66e46104dac5 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:20 devstack sudo[104052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d63b84c5-8d98-4a08-b84d-66e46104dac5 1073741824 Jul 10 06:53:20 devstack sudo[104052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:20 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-69ace546-c049-4cf9-af1d-7a91805440e3 tempest-VolumesActionsTest-88700137 None] Copy volume to image completed successfully. Jul 10 06:53:21 devstack sudo[104052]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-59c04970-0961-41ca-bbe6-3192b2cd7a6d tempest-CreateVolumesFromSourceVolumeTest-561332917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d63b84c5-8d98-4a08-b84d-66e46104dac5 1073741824" returned: 0 in 0.819s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-59c04970-0961-41ca-bbe6-3192b2cd7a6d tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d63b84c5-8d98-4a08-b84d-66e46104dac5 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:21 devstack sudo[104058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d63b84c5-8d98-4a08-b84d-66e46104dac5 Jul 10 06:53:21 devstack sudo[104058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:21 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:53:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:53:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:53:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e41245a9-2e0f-48a9-ac94-73289869fcc2 tempest-VolumesActionsTest-88700137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:21 devstack sudo[104061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:53:21 devstack sudo[104061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:21 devstack sudo[104058]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-59c04970-0961-41ca-bbe6-3192b2cd7a6d tempest-CreateVolumesFromSourceVolumeTest-561332917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d63b84c5-8d98-4a08-b84d-66e46104dac5" returned: 0 in 0.651s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-59c04970-0961-41ca-bbe6-3192b2cd7a6d tempest-CreateVolumesFromSourceVolumeTest-561332917 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:53:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-59c04970-0961-41ca-bbe6-3192b2cd7a6d tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.512s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e41245a9-2e0f-48a9-ac94-73289869fcc2 tempest-VolumesActionsTest-88700137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.044s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:21 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f4d3e4-8244-4659-9e72-2af133869b91]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e41245a9-2e0f-48a9-ac94-73289869fcc2 tempest-VolumesActionsTest-88700137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-59c04970-0961-41ca-bbe6-3192b2cd7a6d tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33eacfbd-4661-4f4c-a204-2ead49d6d699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d63b84c5-8d98-4a08-b84d-66e46104dac5', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-59c04970-0961-41ca-bbe6-3192b2cd7a6d tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b775a0d8-a97b-4786-bf8f-8d9deadf6d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:22 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-59c04970-0961-41ca-bbe6-3192b2cd7a6d tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Volume volume-d63b84c5-8d98-4a08-b84d-66e46104dac5 (d63b84c5-8d98-4a08-b84d-66e46104dac5): created successfully Jul 10 06:53:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-59c04970-0961-41ca-bbe6-3192b2cd7a6d tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b775a0d8-a97b-4786-bf8f-8d9deadf6d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-59c04970-0961-41ca-bbe6-3192b2cd7a6d tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Flow 'volume_create_manager' (5ca945db-f445-4692-aa5d-2889d819d0b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:53:22 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-59c04970-0961-41ca-bbe6-3192b2cd7a6d tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Created volume successfully. Jul 10 06:53:22 devstack sudo[104063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12 Jul 10 06:53:22 devstack sudo[104063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:22 devstack sudo[104061]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.808s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:22 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:53:22 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager._thread_info {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:53:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread count: 28 {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:53:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread info: [<_MainThread(MainThread, started 139245706264704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:53:22 devstack sudo[104063]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e41245a9-2e0f-48a9-ac94-73289869fcc2 tempest-VolumesActionsTest-88700137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12" returned: 0 in 0.918s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:22 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[696ffac2-02b2-41ce-9103-5303513f94d0]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e41245a9-2e0f-48a9-ac94-73289869fcc2 tempest-VolumesActionsTest-88700137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:23 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-30f18622-652f-45a6-ae2e-61cc640ff2a9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:53:23 devstack sudo[104105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12 Jul 10 06:53:23 devstack sudo[104105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-30f18622-652f-45a6-ae2e-61cc640ff2a9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Flow 'volume_create_manager' (4843cfd2-7d7f-41a9-b369-13d2b099957b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:53:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-30f18622-652f-45a6-ae2e-61cc640ff2a9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d342fa7-a510-4931-8f7d-0919dade79ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-30f18622-652f-45a6-ae2e-61cc640ff2a9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d342fa7-a510-4931-8f7d-0919dade79ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1375112759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2f94f2e-5f8a-41fd-b800-7e0389aaf5b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f47af8e94ddb4ef68a9c4a9f3823d90b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:53:23Z,use_quota=True,user_id='d227d6e09a094806a96201d81a9b9b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-30f18622-652f-45a6-ae2e-61cc640ff2a9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b89ab55-7c84-45e9-a655-3c37b6cf6ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-30f18622-652f-45a6-ae2e-61cc640ff2a9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b89ab55-7c84-45e9-a655-3c37b6cf6ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-30f18622-652f-45a6-ae2e-61cc640ff2a9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63091460-5128-42ff-b1da-b2f35a5e2209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-30f18622-652f-45a6-ae2e-61cc640ff2a9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63091460-5128-42ff-b1da-b2f35a5e2209) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2f94f2e-5f8a-41fd-b800-7e0389aaf5b3', 'volume_name': 'volume-e2f94f2e-5f8a-41fd-b800-7e0389aaf5b3', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-30f18622-652f-45a6-ae2e-61cc640ff2a9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aaea240-9f6c-4bf2-aa90-08b193cde5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-30f18622-652f-45a6-ae2e-61cc640ff2a9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aaea240-9f6c-4bf2-aa90-08b193cde5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-30f18622-652f-45a6-ae2e-61cc640ff2a9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e28a11a1-cc0c-4167-80cf-d0b5c6656988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:23 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-30f18622-652f-45a6-ae2e-61cc640ff2a9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Volume e2f94f2e-5f8a-41fd-b800-7e0389aaf5b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2f94f2e-5f8a-41fd-b800-7e0389aaf5b3', 'volume_size': 1} Jul 10 06:53:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-30f18622-652f-45a6-ae2e-61cc640ff2a9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:23 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-95437090-c222-4734-af77-8cbd0597f7d2 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:53:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-95437090-c222-4734-af77-8cbd0597f7d2 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Flow 'volume_create_manager' (c4da2c2e-4082-4bbf-88d7-c4c77b74c663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:53:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-95437090-c222-4734-af77-8cbd0597f7d2 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56363df9-d5e5-48e2-9f89-7e3a9cb7e229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-95437090-c222-4734-af77-8cbd0597f7d2 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56363df9-d5e5-48e2-9f89-7e3a9cb7e229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2078346708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48be3033-b02e-4fb1-aa11-716315610b4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f47af8e94ddb4ef68a9c4a9f3823d90b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:53:23Z,use_quota=True,user_id='d227d6e09a094806a96201d81a9b9b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-95437090-c222-4734-af77-8cbd0597f7d2 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd28814-7369-4080-9bf9-e0250b7ace69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-95437090-c222-4734-af77-8cbd0597f7d2 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd28814-7369-4080-9bf9-e0250b7ace69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-95437090-c222-4734-af77-8cbd0597f7d2 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4b17c3d-f916-496d-bf3d-ebfbc41ea503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-95437090-c222-4734-af77-8cbd0597f7d2 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4b17c3d-f916-496d-bf3d-ebfbc41ea503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48be3033-b02e-4fb1-aa11-716315610b4a', 'volume_name': 'volume-48be3033-b02e-4fb1-aa11-716315610b4a', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-95437090-c222-4734-af77-8cbd0597f7d2 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d2b4148-da99-4a8b-bfb0-8643e5502715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-95437090-c222-4734-af77-8cbd0597f7d2 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d2b4148-da99-4a8b-bfb0-8643e5502715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-95437090-c222-4734-af77-8cbd0597f7d2 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02d868b8-30f4-48bc-8eb2-35f0ece9d793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:23 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-95437090-c222-4734-af77-8cbd0597f7d2 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Volume 48be3033-b02e-4fb1-aa11-716315610b4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48be3033-b02e-4fb1-aa11-716315610b4a', 'volume_size': 1} Jul 10 06:53:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-95437090-c222-4734-af77-8cbd0597f7d2 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:23 devstack sudo[104105]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e41245a9-2e0f-48a9-ac94-73289869fcc2 tempest-VolumesActionsTest-88700137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12" returned: 0 in 0.835s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e41245a9-2e0f-48a9-ac94-73289869fcc2 tempest-VolumesActionsTest-88700137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12 /opt/stack/data/cinder/conversion/d3dfdc94-ff2f-48fb-ab55-f3296c8baa12.temp_image.0f5ec422-70a4-48ce-94fa-cab9456685feqi1qzkcl.img {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:23 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2f3e6c7-9b0f-4318-b9e6-c4177ba36a99 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:53:23 devstack sudo[104110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12 /opt/stack/data/cinder/conversion/d3dfdc94-ff2f-48fb-ab55-f3296c8baa12.temp_image.0f5ec422-70a4-48ce-94fa-cab9456685feqi1qzkcl.img Jul 10 06:53:23 devstack sudo[104110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b2f3e6c7-9b0f-4318-b9e6-c4177ba36a99 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Flow 'volume_create_manager' (db8ee336-143f-49e7-8843-09083dbbb40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:53:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b2f3e6c7-9b0f-4318-b9e6-c4177ba36a99 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90cf4a10-28a0-449d-a6d7-e52e9489dece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b2f3e6c7-9b0f-4318-b9e6-c4177ba36a99 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90cf4a10-28a0-449d-a6d7-e52e9489dece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2057491088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91d7c86b-cd8b-45fc-8b81-cbfc1acf0ae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f47af8e94ddb4ef68a9c4a9f3823d90b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:53:24Z,use_quota=True,user_id='d227d6e09a094806a96201d81a9b9b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b2f3e6c7-9b0f-4318-b9e6-c4177ba36a99 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f3c115-c6c2-462a-9826-4649e873d08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b2f3e6c7-9b0f-4318-b9e6-c4177ba36a99 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f3c115-c6c2-462a-9826-4649e873d08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b2f3e6c7-9b0f-4318-b9e6-c4177ba36a99 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cb8784e-1cc5-4489-95da-5918a8f54311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b2f3e6c7-9b0f-4318-b9e6-c4177ba36a99 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cb8784e-1cc5-4489-95da-5918a8f54311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91d7c86b-cd8b-45fc-8b81-cbfc1acf0ae6', 'volume_name': 'volume-91d7c86b-cd8b-45fc-8b81-cbfc1acf0ae6', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b2f3e6c7-9b0f-4318-b9e6-c4177ba36a99 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19f691a1-ae91-4398-bc3a-338f61cab879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b2f3e6c7-9b0f-4318-b9e6-c4177ba36a99 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19f691a1-ae91-4398-bc3a-338f61cab879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b2f3e6c7-9b0f-4318-b9e6-c4177ba36a99 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ffaae17-6961-4243-9b4f-6cc56def7063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:23 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-b2f3e6c7-9b0f-4318-b9e6-c4177ba36a99 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Volume 91d7c86b-cd8b-45fc-8b81-cbfc1acf0ae6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91d7c86b-cd8b-45fc-8b81-cbfc1acf0ae6', 'volume_size': 1} Jul 10 06:53:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b2f3e6c7-9b0f-4318-b9e6-c4177ba36a99 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:24 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0b1d54e-7c7a-4699-b6f1-d1838f90a058 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:53:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d0b1d54e-7c7a-4699-b6f1-d1838f90a058 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Flow 'volume_create_manager' (595cc709-7ce4-4e86-8a26-41ddbb6c12af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:53:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d0b1d54e-7c7a-4699-b6f1-d1838f90a058 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d17f69b-c047-456b-b8ca-c805e2505ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d0b1d54e-7c7a-4699-b6f1-d1838f90a058 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d17f69b-c047-456b-b8ca-c805e2505ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-566449627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9892903-e797-4724-8266-eaea09b90ff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f47af8e94ddb4ef68a9c4a9f3823d90b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:53:24Z,use_quota=True,user_id='d227d6e09a094806a96201d81a9b9b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d0b1d54e-7c7a-4699-b6f1-d1838f90a058 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f2cd727-1877-418c-8cb6-41386215717a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d0b1d54e-7c7a-4699-b6f1-d1838f90a058 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f2cd727-1877-418c-8cb6-41386215717a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d0b1d54e-7c7a-4699-b6f1-d1838f90a058 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29d308e5-9fd6-4494-a38f-6b2a335f75f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d0b1d54e-7c7a-4699-b6f1-d1838f90a058 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29d308e5-9fd6-4494-a38f-6b2a335f75f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9892903-e797-4724-8266-eaea09b90ff6', 'volume_name': 'volume-e9892903-e797-4724-8266-eaea09b90ff6', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d0b1d54e-7c7a-4699-b6f1-d1838f90a058 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4d95fda-a045-46f0-91c3-01cecbc0ecc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d0b1d54e-7c7a-4699-b6f1-d1838f90a058 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4d95fda-a045-46f0-91c3-01cecbc0ecc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d0b1d54e-7c7a-4699-b6f1-d1838f90a058 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a4dae39-e857-4c01-bd0e-12fcde731100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:24 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-d0b1d54e-7c7a-4699-b6f1-d1838f90a058 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Volume e9892903-e797-4724-8266-eaea09b90ff6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9892903-e797-4724-8266-eaea09b90ff6', 'volume_size': 1} Jul 10 06:53:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d0b1d54e-7c7a-4699-b6f1-d1838f90a058 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:24 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-f60fd8b3-980c-44de-8932-f812a40930ad tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:53:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f60fd8b3-980c-44de-8932-f812a40930ad tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Flow 'volume_create_manager' (bfa3d87f-e00a-4051-9a74-0430fccb5b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:53:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f60fd8b3-980c-44de-8932-f812a40930ad tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afaa42ab-3b49-4c88-9be4-3007b4761225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f60fd8b3-980c-44de-8932-f812a40930ad tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afaa42ab-3b49-4c88-9be4-3007b4761225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2056266739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9d6bea4-2459-4957-af39-f462b7c7ccf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f47af8e94ddb4ef68a9c4a9f3823d90b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:53:25Z,use_quota=True,user_id='d227d6e09a094806a96201d81a9b9b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f60fd8b3-980c-44de-8932-f812a40930ad tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (631de3fc-af4c-4714-9255-f398e81048e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f60fd8b3-980c-44de-8932-f812a40930ad tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (631de3fc-af4c-4714-9255-f398e81048e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f60fd8b3-980c-44de-8932-f812a40930ad tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abb02a74-c2ee-4440-971d-8ecf8e1e4683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f60fd8b3-980c-44de-8932-f812a40930ad tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abb02a74-c2ee-4440-971d-8ecf8e1e4683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9d6bea4-2459-4957-af39-f462b7c7ccf5', 'volume_name': 'volume-d9d6bea4-2459-4957-af39-f462b7c7ccf5', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f60fd8b3-980c-44de-8932-f812a40930ad tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f63f0c0-a22b-46f4-82bc-4b0dd46e2ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f60fd8b3-980c-44de-8932-f812a40930ad tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f63f0c0-a22b-46f4-82bc-4b0dd46e2ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f60fd8b3-980c-44de-8932-f812a40930ad tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9629cb03-b3e5-4c53-b8c2-53fc71d443e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:24 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-f60fd8b3-980c-44de-8932-f812a40930ad tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Volume d9d6bea4-2459-4957-af39-f462b7c7ccf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9d6bea4-2459-4957-af39-f462b7c7ccf5', 'volume_size': 1} Jul 10 06:53:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f60fd8b3-980c-44de-8932-f812a40930ad tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:28 devstack sudo[104110]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e41245a9-2e0f-48a9-ac94-73289869fcc2 tempest-VolumesActionsTest-88700137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12 /opt/stack/data/cinder/conversion/d3dfdc94-ff2f-48fb-ab55-f3296c8baa12.temp_image.0f5ec422-70a4-48ce-94fa-cab9456685feqi1qzkcl.img" returned: 0 in 4.428s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:28 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[da897c05-905a-4422-8ffa-ff3e75508b36]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e41245a9-2e0f-48a9-ac94-73289869fcc2 tempest-VolumesActionsTest-88700137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:28 devstack sudo[104123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12 Jul 10 06:53:28 devstack sudo[104123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:29 devstack sudo[104123]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e41245a9-2e0f-48a9-ac94-73289869fcc2 tempest-VolumesActionsTest-88700137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12" returned: 0 in 0.963s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:29 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-e41245a9-2e0f-48a9-ac94-73289869fcc2 tempest-VolumesActionsTest-88700137 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12, size 1024.00 MB, duration 4.43 sec, destination /opt/stack/data/cinder/conversion/d3dfdc94-ff2f-48fb-ab55-f3296c8baa12.temp_image.0f5ec422-70a4-48ce-94fa-cab9456685feqi1qzkcl.img {{(pid=87294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 06:53:29 devstack cinder-volume[87294]: INFO cinder.image.image_utils [None req-e41245a9-2e0f-48a9-ac94-73289869fcc2 tempest-VolumesActionsTest-88700137 None] Converted 1024.00 MB image at 231.19 MB/s Jul 10 06:53:29 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-e41245a9-2e0f-48a9-ac94-73289869fcc2 tempest-VolumesActionsTest-88700137 None] 0f5ec422-70a4-48ce-94fa-cab9456685fe was raw, converting to qcow2 {{(pid=87294) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 10 06:53:29 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[acdbc82b-5b84-42b0-b3e0-9532ed224430]: (4, 'raw') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e41245a9-2e0f-48a9-ac94-73289869fcc2 tempest-VolumesActionsTest-88700137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d3dfdc94-ff2f-48fb-ab55-f3296c8baa12.temp_image.0f5ec422-70a4-48ce-94fa-cab9456685feqi1qzkcl.img {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:29 devstack sudo[104128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d3dfdc94-ff2f-48fb-ab55-f3296c8baa12.temp_image.0f5ec422-70a4-48ce-94fa-cab9456685feqi1qzkcl.img Jul 10 06:53:29 devstack sudo[104128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:29 devstack sudo[104128]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e41245a9-2e0f-48a9-ac94-73289869fcc2 tempest-VolumesActionsTest-88700137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d3dfdc94-ff2f-48fb-ab55-f3296c8baa12.temp_image.0f5ec422-70a4-48ce-94fa-cab9456685feqi1qzkcl.img" returned: 0 in 0.746s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e41245a9-2e0f-48a9-ac94-73289869fcc2 tempest-VolumesActionsTest-88700137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d3dfdc94-ff2f-48fb-ab55-f3296c8baa12.temp_image.0f5ec422-70a4-48ce-94fa-cab9456685feqi1qzkcl.img {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:30 devstack sudo[104133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d3dfdc94-ff2f-48fb-ab55-f3296c8baa12.temp_image.0f5ec422-70a4-48ce-94fa-cab9456685feqi1qzkcl.img Jul 10 06:53:30 devstack sudo[104133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:30 devstack sudo[104133]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e41245a9-2e0f-48a9-ac94-73289869fcc2 tempest-VolumesActionsTest-88700137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d3dfdc94-ff2f-48fb-ab55-f3296c8baa12.temp_image.0f5ec422-70a4-48ce-94fa-cab9456685feqi1qzkcl.img" returned: 1 in 0.770s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e41245a9-2e0f-48a9-ac94-73289869fcc2 tempest-VolumesActionsTest-88700137 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d3dfdc94-ff2f-48fb-ab55-f3296c8baa12.temp_image.0f5ec422-70a4-48ce-94fa-cab9456685feqi1qzkcl.img' failed. Not Retrying. {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:53:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e41245a9-2e0f-48a9-ac94-73289869fcc2 tempest-VolumesActionsTest-88700137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d3dfdc94-ff2f-48fb-ab55-f3296c8baa12.temp_image.0f5ec422-70a4-48ce-94fa-cab9456685feqi1qzkcl.img /opt/stack/data/cinder/conversion/vol_upload_t_xkcvlx {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:30 devstack sudo[104140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d3dfdc94-ff2f-48fb-ab55-f3296c8baa12.temp_image.0f5ec422-70a4-48ce-94fa-cab9456685feqi1qzkcl.img /opt/stack/data/cinder/conversion/vol_upload_t_xkcvlx Jul 10 06:53:30 devstack sudo[104140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:31 devstack sudo[104140]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e41245a9-2e0f-48a9-ac94-73289869fcc2 tempest-VolumesActionsTest-88700137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d3dfdc94-ff2f-48fb-ab55-f3296c8baa12.temp_image.0f5ec422-70a4-48ce-94fa-cab9456685feqi1qzkcl.img /opt/stack/data/cinder/conversion/vol_upload_t_xkcvlx" returned: 0 in 0.634s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:31 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-e41245a9-2e0f-48a9-ac94-73289869fcc2 tempest-VolumesActionsTest-88700137 None] Image conversion details: src /opt/stack/data/cinder/conversion/d3dfdc94-ff2f-48fb-ab55-f3296c8baa12.temp_image.0f5ec422-70a4-48ce-94fa-cab9456685feqi1qzkcl.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_t_xkcvlx {{(pid=87294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 06:53:31 devstack cinder-volume[87294]: INFO cinder.image.image_utils [None req-e41245a9-2e0f-48a9-ac94-73289869fcc2 tempest-VolumesActionsTest-88700137 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 10 06:53:31 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc4066d-c96e-462e-99e2-b6cd71df70c1]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e41245a9-2e0f-48a9-ac94-73289869fcc2 tempest-VolumesActionsTest-88700137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_t_xkcvlx {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:31 devstack sudo[104145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_t_xkcvlx Jul 10 06:53:31 devstack sudo[104145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:32 devstack sudo[104145]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e41245a9-2e0f-48a9-ac94-73289869fcc2 tempest-VolumesActionsTest-88700137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_t_xkcvlx" returned: 0 in 0.778s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e41245a9-2e0f-48a9-ac94-73289869fcc2 tempest-VolumesActionsTest-88700137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.507s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:33 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e41245a9-2e0f-48a9-ac94-73289869fcc2 tempest-VolumesActionsTest-88700137 None] Uploaded volume to glance image-id: 0f5ec422-70a4-48ce-94fa-cab9456685fe. {{(pid=87294) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 10 06:53:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-30f18622-652f-45a6-ae2e-61cc640ff2a9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.344s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:33 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-30f18622-652f-45a6-ae2e-61cc640ff2a9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1375112759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2f94f2e-5f8a-41fd-b800-7e0389aaf5b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f47af8e94ddb4ef68a9c4a9f3823d90b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:53:23Z,use_quota=True,user_id='d227d6e09a094806a96201d81a9b9b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:53:33 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-30f18622-652f-45a6-ae2e-61cc640ff2a9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Creating volume e2f94f2e-5f8a-41fd-b800-7e0389aaf5b3 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:53:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-30f18622-652f-45a6-ae2e-61cc640ff2a9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-30f18622-652f-45a6-ae2e-61cc640ff2a9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:33 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-30f18622-652f-45a6-ae2e-61cc640ff2a9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:53:33 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-30f18622-652f-45a6-ae2e-61cc640ff2a9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:53:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-30f18622-652f-45a6-ae2e-61cc640ff2a9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:33 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-30f18622-652f-45a6-ae2e-61cc640ff2a9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:53:33 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-30f18622-652f-45a6-ae2e-61cc640ff2a9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:53:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-30f18622-652f-45a6-ae2e-61cc640ff2a9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e2f94f2e-5f8a-41fd-b800-7e0389aaf5b3 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:33 devstack sudo[104156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e2f94f2e-5f8a-41fd-b800-7e0389aaf5b3 1073741824 Jul 10 06:53:33 devstack sudo[104156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:33 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-e41245a9-2e0f-48a9-ac94-73289869fcc2 tempest-VolumesActionsTest-88700137 None] Copy volume to image completed successfully. Jul 10 06:53:34 devstack sudo[104156]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-30f18622-652f-45a6-ae2e-61cc640ff2a9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e2f94f2e-5f8a-41fd-b800-7e0389aaf5b3 1073741824" returned: 0 in 0.867s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-30f18622-652f-45a6-ae2e-61cc640ff2a9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e2f94f2e-5f8a-41fd-b800-7e0389aaf5b3 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:34 devstack sudo[104162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e2f94f2e-5f8a-41fd-b800-7e0389aaf5b3 Jul 10 06:53:34 devstack sudo[104162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:35 devstack sudo[104162]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-30f18622-652f-45a6-ae2e-61cc640ff2a9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e2f94f2e-5f8a-41fd-b800-7e0389aaf5b3" returned: 0 in 0.676s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:35 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-30f18622-652f-45a6-ae2e-61cc640ff2a9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:53:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-30f18622-652f-45a6-ae2e-61cc640ff2a9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.587s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-95437090-c222-4734-af77-8cbd0597f7d2 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.595s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:35 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-95437090-c222-4734-af77-8cbd0597f7d2 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2078346708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48be3033-b02e-4fb1-aa11-716315610b4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f47af8e94ddb4ef68a9c4a9f3823d90b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:53:23Z,use_quota=True,user_id='d227d6e09a094806a96201d81a9b9b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:53:35 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-95437090-c222-4734-af77-8cbd0597f7d2 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Creating volume 48be3033-b02e-4fb1-aa11-716315610b4a {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:53:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-95437090-c222-4734-af77-8cbd0597f7d2 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-95437090-c222-4734-af77-8cbd0597f7d2 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:35 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-95437090-c222-4734-af77-8cbd0597f7d2 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:53:35 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-95437090-c222-4734-af77-8cbd0597f7d2 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:53:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-95437090-c222-4734-af77-8cbd0597f7d2 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:35 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-95437090-c222-4734-af77-8cbd0597f7d2 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:53:35 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-95437090-c222-4734-af77-8cbd0597f7d2 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:53:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-95437090-c222-4734-af77-8cbd0597f7d2 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-48be3033-b02e-4fb1-aa11-716315610b4a 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:35 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-952a513e-34d3-4fc5-ad66-ea0a07199f5e tempest-VolumesActionsTest-88700137 None] Acquiring lock "cinder-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:53:35 devstack sudo[104165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-48be3033-b02e-4fb1-aa11-716315610b4a 1073741824 Jul 10 06:53:35 devstack sudo[104165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-30f18622-652f-45a6-ae2e-61cc640ff2a9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e28a11a1-cc0c-4167-80cf-d0b5c6656988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2f94f2e-5f8a-41fd-b800-7e0389aaf5b3', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-30f18622-652f-45a6-ae2e-61cc640ff2a9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec857c1b-a1a4-4d46-ba2e-a3e164633f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:35 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-952a513e-34d3-4fc5-ad66-ea0a07199f5e tempest-VolumesActionsTest-88700137 None] Lock "cinder-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:53:35 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-30f18622-652f-45a6-ae2e-61cc640ff2a9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Volume volume-e2f94f2e-5f8a-41fd-b800-7e0389aaf5b3 (e2f94f2e-5f8a-41fd-b800-7e0389aaf5b3): created successfully Jul 10 06:53:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-30f18622-652f-45a6-ae2e-61cc640ff2a9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec857c1b-a1a4-4d46-ba2e-a3e164633f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-30f18622-652f-45a6-ae2e-61cc640ff2a9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Flow 'volume_create_manager' (4843cfd2-7d7f-41a9-b369-13d2b099957b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:53:35 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-30f18622-652f-45a6-ae2e-61cc640ff2a9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Created volume successfully. Jul 10 06:53:35 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-952a513e-34d3-4fc5-ad66-ea0a07199f5e tempest-VolumesActionsTest-88700137 None] Acquiring lock "cinder-quobyte-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:53:35 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-952a513e-34d3-4fc5-ad66-ea0a07199f5e tempest-VolumesActionsTest-88700137 None] Lock "cinder-quobyte-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12" acquired by "delete_volume" :: waited 0.020s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:53:35 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5900da-cff7-4637-8932-2cb44c164c0e]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-952a513e-34d3-4fc5-ad66-ea0a07199f5e tempest-VolumesActionsTest-88700137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:35 devstack sudo[104167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12 Jul 10 06:53:35 devstack sudo[104167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:35 devstack sudo[104165]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-95437090-c222-4734-af77-8cbd0597f7d2 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-48be3033-b02e-4fb1-aa11-716315610b4a 1073741824" returned: 0 in 0.907s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-95437090-c222-4734-af77-8cbd0597f7d2 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-48be3033-b02e-4fb1-aa11-716315610b4a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:36 devstack sudo[104175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-48be3033-b02e-4fb1-aa11-716315610b4a Jul 10 06:53:36 devstack sudo[104175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:36 devstack sudo[104167]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-952a513e-34d3-4fc5-ad66-ea0a07199f5e tempest-VolumesActionsTest-88700137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12" returned: 0 in 0.809s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-952a513e-34d3-4fc5-ad66-ea0a07199f5e tempest-VolumesActionsTest-88700137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:36 devstack sudo[104177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12 Jul 10 06:53:36 devstack sudo[104177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:36 devstack sudo[104177]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-952a513e-34d3-4fc5-ad66-ea0a07199f5e tempest-VolumesActionsTest-88700137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12" returned: 0 in 0.648s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:36 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-952a513e-34d3-4fc5-ad66-ea0a07199f5e tempest-VolumesActionsTest-88700137 None] Lock "cinder-quobyte-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12" released by "delete_volume" :: held 1.501s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:53:36 devstack sudo[104175]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-95437090-c222-4734-af77-8cbd0597f7d2 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-48be3033-b02e-4fb1-aa11-716315610b4a" returned: 0 in 0.756s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:36 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-95437090-c222-4734-af77-8cbd0597f7d2 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] <== create_volume: return (1711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:53:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-95437090-c222-4734-af77-8cbd0597f7d2 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.714s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b2f3e6c7-9b0f-4318-b9e6-c4177ba36a99 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.903s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:36 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b2f3e6c7-9b0f-4318-b9e6-c4177ba36a99 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2057491088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91d7c86b-cd8b-45fc-8b81-cbfc1acf0ae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f47af8e94ddb4ef68a9c4a9f3823d90b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:53:24Z,use_quota=True,user_id='d227d6e09a094806a96201d81a9b9b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:53:36 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-b2f3e6c7-9b0f-4318-b9e6-c4177ba36a99 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Creating volume 91d7c86b-cd8b-45fc-8b81-cbfc1acf0ae6 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:53:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b2f3e6c7-9b0f-4318-b9e6-c4177ba36a99 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b2f3e6c7-9b0f-4318-b9e6-c4177ba36a99 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:36 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b2f3e6c7-9b0f-4318-b9e6-c4177ba36a99 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:53:36 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b2f3e6c7-9b0f-4318-b9e6-c4177ba36a99 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:53:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b2f3e6c7-9b0f-4318-b9e6-c4177ba36a99 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:36 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b2f3e6c7-9b0f-4318-b9e6-c4177ba36a99 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:53:36 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-b2f3e6c7-9b0f-4318-b9e6-c4177ba36a99 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:53:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b2f3e6c7-9b0f-4318-b9e6-c4177ba36a99 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-91d7c86b-cd8b-45fc-8b81-cbfc1acf0ae6 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:36 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-952a513e-34d3-4fc5-ad66-ea0a07199f5e tempest-VolumesActionsTest-88700137 None] Created reservations ['ce2fdfad-0863-49df-8a73-470441e5b224', '1b58e09d-6799-45d5-b595-28349a0e4b72', 'aaa7541d-cd98-48ea-9c56-8c6ea556aba2', '77f9d47b-a4ee-4cec-8d28-45993662790b'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:53:36 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:UPDATE=47,cinder:SELECT=57,cinder:INSERT=18,cinder:DELETE=4 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:53:36 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:SELECT=47,cinder:UPDATE=54,cinder:DELETE=3,cinder:INSERT=18 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:53:36 devstack sudo[104181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-91d7c86b-cd8b-45fc-8b81-cbfc1acf0ae6 1073741824 Jul 10 06:53:36 devstack sudo[104181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:36 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-95437090-c222-4734-af77-8cbd0597f7d2 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02d868b8-30f4-48bc-8eb2-35f0ece9d793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48be3033-b02e-4fb1-aa11-716315610b4a', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:36 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-95437090-c222-4734-af77-8cbd0597f7d2 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af76e582-213d-475d-a6c4-a6746e991507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:36 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-95437090-c222-4734-af77-8cbd0597f7d2 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Volume volume-48be3033-b02e-4fb1-aa11-716315610b4a (48be3033-b02e-4fb1-aa11-716315610b4a): created successfully Jul 10 06:53:36 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-95437090-c222-4734-af77-8cbd0597f7d2 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af76e582-213d-475d-a6c4-a6746e991507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:36 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-95437090-c222-4734-af77-8cbd0597f7d2 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Flow 'volume_create_manager' (c4da2c2e-4082-4bbf-88d7-c4c77b74c663) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:53:36 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-95437090-c222-4734-af77-8cbd0597f7d2 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Created volume successfully. Jul 10 06:53:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-952a513e-34d3-4fc5-ad66-ea0a07199f5e tempest-VolumesActionsTest-88700137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-952a513e-34d3-4fc5-ad66-ea0a07199f5e tempest-VolumesActionsTest-88700137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:36 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-952a513e-34d3-4fc5-ad66-ea0a07199f5e tempest-VolumesActionsTest-88700137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:53:36 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-952a513e-34d3-4fc5-ad66-ea0a07199f5e tempest-VolumesActionsTest-88700137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:53:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-952a513e-34d3-4fc5-ad66-ea0a07199f5e tempest-VolumesActionsTest-88700137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-952a513e-34d3-4fc5-ad66-ea0a07199f5e tempest-VolumesActionsTest-88700137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:36 devstack sudo[104183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:53:36 devstack sudo[104183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:37 devstack sudo[104183]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-952a513e-34d3-4fc5-ad66-ea0a07199f5e tempest-VolumesActionsTest-88700137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.721s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:37 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-952a513e-34d3-4fc5-ad66-ea0a07199f5e tempest-VolumesActionsTest-88700137 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:53:37 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-952a513e-34d3-4fc5-ad66-ea0a07199f5e tempest-VolumesActionsTest-88700137 None] Deleted volume successfully. Jul 10 06:53:37 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-952a513e-34d3-4fc5-ad66-ea0a07199f5e tempest-VolumesActionsTest-88700137 None] Lock "cinder-d3dfdc94-ff2f-48fb-ab55-f3296c8baa12-delete_volume" released by "delete_volume" :: held 2.566s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:53:37 devstack sudo[104181]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b2f3e6c7-9b0f-4318-b9e6-c4177ba36a99 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-91d7c86b-cd8b-45fc-8b81-cbfc1acf0ae6 1073741824" returned: 0 in 0.924s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b2f3e6c7-9b0f-4318-b9e6-c4177ba36a99 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-91d7c86b-cd8b-45fc-8b81-cbfc1acf0ae6 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:37 devstack sudo[104190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-91d7c86b-cd8b-45fc-8b81-cbfc1acf0ae6 Jul 10 06:53:37 devstack sudo[104190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:38 devstack sudo[104190]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b2f3e6c7-9b0f-4318-b9e6-c4177ba36a99 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-91d7c86b-cd8b-45fc-8b81-cbfc1acf0ae6" returned: 0 in 0.673s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:38 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b2f3e6c7-9b0f-4318-b9e6-c4177ba36a99 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:53:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b2f3e6c7-9b0f-4318-b9e6-c4177ba36a99 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d0b1d54e-7c7a-4699-b6f1-d1838f90a058 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.168s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:38 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-d0b1d54e-7c7a-4699-b6f1-d1838f90a058 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-566449627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9892903-e797-4724-8266-eaea09b90ff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f47af8e94ddb4ef68a9c4a9f3823d90b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:53:24Z,use_quota=True,user_id='d227d6e09a094806a96201d81a9b9b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:53:38 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-d0b1d54e-7c7a-4699-b6f1-d1838f90a058 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Creating volume e9892903-e797-4724-8266-eaea09b90ff6 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:53:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d0b1d54e-7c7a-4699-b6f1-d1838f90a058 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d0b1d54e-7c7a-4699-b6f1-d1838f90a058 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:38 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-d0b1d54e-7c7a-4699-b6f1-d1838f90a058 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:53:38 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-d0b1d54e-7c7a-4699-b6f1-d1838f90a058 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:53:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d0b1d54e-7c7a-4699-b6f1-d1838f90a058 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:38 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-d0b1d54e-7c7a-4699-b6f1-d1838f90a058 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:53:38 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-d0b1d54e-7c7a-4699-b6f1-d1838f90a058 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:53:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d0b1d54e-7c7a-4699-b6f1-d1838f90a058 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e9892903-e797-4724-8266-eaea09b90ff6 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:38 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b2f3e6c7-9b0f-4318-b9e6-c4177ba36a99 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ffaae17-6961-4243-9b4f-6cc56def7063) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91d7c86b-cd8b-45fc-8b81-cbfc1acf0ae6', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:38 devstack sudo[104193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e9892903-e797-4724-8266-eaea09b90ff6 1073741824 Jul 10 06:53:38 devstack sudo[104193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:38 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b2f3e6c7-9b0f-4318-b9e6-c4177ba36a99 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcbe3145-496e-489d-9583-60073e93f749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:38 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-b2f3e6c7-9b0f-4318-b9e6-c4177ba36a99 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Volume volume-91d7c86b-cd8b-45fc-8b81-cbfc1acf0ae6 (91d7c86b-cd8b-45fc-8b81-cbfc1acf0ae6): created successfully Jul 10 06:53:38 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b2f3e6c7-9b0f-4318-b9e6-c4177ba36a99 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcbe3145-496e-489d-9583-60073e93f749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:38 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b2f3e6c7-9b0f-4318-b9e6-c4177ba36a99 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Flow 'volume_create_manager' (db8ee336-143f-49e7-8843-09083dbbb40b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:53:38 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-b2f3e6c7-9b0f-4318-b9e6-c4177ba36a99 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Created volume successfully. Jul 10 06:53:39 devstack sudo[104193]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d0b1d54e-7c7a-4699-b6f1-d1838f90a058 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e9892903-e797-4724-8266-eaea09b90ff6 1073741824" returned: 0 in 0.891s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d0b1d54e-7c7a-4699-b6f1-d1838f90a058 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e9892903-e797-4724-8266-eaea09b90ff6 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:39 devstack sudo[104200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e9892903-e797-4724-8266-eaea09b90ff6 Jul 10 06:53:39 devstack sudo[104200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:40 devstack sudo[104200]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d0b1d54e-7c7a-4699-b6f1-d1838f90a058 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e9892903-e797-4724-8266-eaea09b90ff6" returned: 0 in 0.708s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:40 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-d0b1d54e-7c7a-4699-b6f1-d1838f90a058 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] <== create_volume: return (1643ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:53:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d0b1d54e-7c7a-4699-b6f1-d1838f90a058 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.645s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f60fd8b3-980c-44de-8932-f812a40930ad tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.146s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:40 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f60fd8b3-980c-44de-8932-f812a40930ad tempest-CreateVolumesFromSourceVolumeTest-561332917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2056266739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9d6bea4-2459-4957-af39-f462b7c7ccf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f47af8e94ddb4ef68a9c4a9f3823d90b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:53:25Z,use_quota=True,user_id='d227d6e09a094806a96201d81a9b9b11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:53:40 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-f60fd8b3-980c-44de-8932-f812a40930ad tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Creating volume d9d6bea4-2459-4957-af39-f462b7c7ccf5 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:53:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f60fd8b3-980c-44de-8932-f812a40930ad tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f60fd8b3-980c-44de-8932-f812a40930ad tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:40 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f60fd8b3-980c-44de-8932-f812a40930ad tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:53:40 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f60fd8b3-980c-44de-8932-f812a40930ad tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:53:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f60fd8b3-980c-44de-8932-f812a40930ad tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:40 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f60fd8b3-980c-44de-8932-f812a40930ad tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:53:40 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-f60fd8b3-980c-44de-8932-f812a40930ad tempest-CreateVolumesFromSourceVolumeTest-561332917 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:53:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f60fd8b3-980c-44de-8932-f812a40930ad tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d9d6bea4-2459-4957-af39-f462b7c7ccf5 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:40 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d0b1d54e-7c7a-4699-b6f1-d1838f90a058 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a4dae39-e857-4c01-bd0e-12fcde731100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9892903-e797-4724-8266-eaea09b90ff6', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:40 devstack sudo[104204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d9d6bea4-2459-4957-af39-f462b7c7ccf5 1073741824 Jul 10 06:53:40 devstack sudo[104204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:40 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d0b1d54e-7c7a-4699-b6f1-d1838f90a058 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f08a9f7-ced8-48e4-9db4-a17ea5e6b54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:40 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-d0b1d54e-7c7a-4699-b6f1-d1838f90a058 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Volume volume-e9892903-e797-4724-8266-eaea09b90ff6 (e9892903-e797-4724-8266-eaea09b90ff6): created successfully Jul 10 06:53:40 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d0b1d54e-7c7a-4699-b6f1-d1838f90a058 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f08a9f7-ced8-48e4-9db4-a17ea5e6b54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:40 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d0b1d54e-7c7a-4699-b6f1-d1838f90a058 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Flow 'volume_create_manager' (595cc709-7ce4-4e86-8a26-41ddbb6c12af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:53:40 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-d0b1d54e-7c7a-4699-b6f1-d1838f90a058 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Created volume successfully. Jul 10 06:53:41 devstack sudo[104204]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f60fd8b3-980c-44de-8932-f812a40930ad tempest-CreateVolumesFromSourceVolumeTest-561332917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d9d6bea4-2459-4957-af39-f462b7c7ccf5 1073741824" returned: 0 in 0.911s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f60fd8b3-980c-44de-8932-f812a40930ad tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d9d6bea4-2459-4957-af39-f462b7c7ccf5 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:41 devstack sudo[104211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d9d6bea4-2459-4957-af39-f462b7c7ccf5 Jul 10 06:53:41 devstack sudo[104211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:41 devstack sudo[104211]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f60fd8b3-980c-44de-8932-f812a40930ad tempest-CreateVolumesFromSourceVolumeTest-561332917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d9d6bea4-2459-4957-af39-f462b7c7ccf5" returned: 0 in 0.681s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:41 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f60fd8b3-980c-44de-8932-f812a40930ad tempest-CreateVolumesFromSourceVolumeTest-561332917 None] <== create_volume: return (1642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:53:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f60fd8b3-980c-44de-8932-f812a40930ad tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.645s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:41 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f60fd8b3-980c-44de-8932-f812a40930ad tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9629cb03-b3e5-4c53-b8c2-53fc71d443e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9d6bea4-2459-4957-af39-f462b7c7ccf5', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:41 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f60fd8b3-980c-44de-8932-f812a40930ad tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cf2e5ba-d060-448d-be4c-0335b1ea25b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:41 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-f60fd8b3-980c-44de-8932-f812a40930ad tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Volume volume-d9d6bea4-2459-4957-af39-f462b7c7ccf5 (d9d6bea4-2459-4957-af39-f462b7c7ccf5): created successfully Jul 10 06:53:41 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f60fd8b3-980c-44de-8932-f812a40930ad tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cf2e5ba-d060-448d-be4c-0335b1ea25b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:41 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f60fd8b3-980c-44de-8932-f812a40930ad tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Flow 'volume_create_manager' (bfa3d87f-e00a-4051-9a74-0430fccb5b11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:53:41 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-f60fd8b3-980c-44de-8932-f812a40930ad tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Created volume successfully. Jul 10 06:53:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f8ea0ce2-79b6-4f07-a0ca-6d5c735d3928 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Acquiring lock "cinder-d9d6bea4-2459-4957-af39-f462b7c7ccf5-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:53:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f8ea0ce2-79b6-4f07-a0ca-6d5c735d3928 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "cinder-d9d6bea4-2459-4957-af39-f462b7c7ccf5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:53:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f8ea0ce2-79b6-4f07-a0ca-6d5c735d3928 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Acquiring lock "cinder-quobyte-d9d6bea4-2459-4957-af39-f462b7c7ccf5" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:53:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f8ea0ce2-79b6-4f07-a0ca-6d5c735d3928 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "cinder-quobyte-d9d6bea4-2459-4957-af39-f462b7c7ccf5" acquired by "delete_volume" :: waited 0.022s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:53:42 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b3d3d1-fb34-4a1a-9301-6709f58e9c6c]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f8ea0ce2-79b6-4f07-a0ca-6d5c735d3928 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d9d6bea4-2459-4957-af39-f462b7c7ccf5 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:42 devstack sudo[104214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d9d6bea4-2459-4957-af39-f462b7c7ccf5 Jul 10 06:53:42 devstack sudo[104214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:43 devstack sudo[104214]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f8ea0ce2-79b6-4f07-a0ca-6d5c735d3928 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d9d6bea4-2459-4957-af39-f462b7c7ccf5" returned: 0 in 0.798s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f8ea0ce2-79b6-4f07-a0ca-6d5c735d3928 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d9d6bea4-2459-4957-af39-f462b7c7ccf5 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:43 devstack sudo[104219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d9d6bea4-2459-4957-af39-f462b7c7ccf5 Jul 10 06:53:43 devstack sudo[104219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:43 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-98eb6038-ea40-41d4-b5fd-6fa792597d3b tempest-VolumesCloneNegativeTest-1753165583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:53:43 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-98eb6038-ea40-41d4-b5fd-6fa792597d3b tempest-VolumesCloneNegativeTest-1753165583 None] Flow 'volume_create_manager' (e3065d91-ead3-4a55-b54c-6a70223af829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:53:43 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-98eb6038-ea40-41d4-b5fd-6fa792597d3b tempest-VolumesCloneNegativeTest-1753165583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38f02707-1bcb-40d1-88f7-f3c392488e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:43 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-98eb6038-ea40-41d4-b5fd-6fa792597d3b tempest-VolumesCloneNegativeTest-1753165583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38f02707-1bcb-40d1-88f7-f3c392488e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1363690980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=503c29b0-3ec4-482b-870b-1f010874a9e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20dc6ee41654473db975fba0b1e9243b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:53:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:53:43Z,use_quota=True,user_id='8ff736524171491a960a76ffc21a97fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:43 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-98eb6038-ea40-41d4-b5fd-6fa792597d3b tempest-VolumesCloneNegativeTest-1753165583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (612e4afa-b964-4e0a-98f3-bbcacfc0d1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:43 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-98eb6038-ea40-41d4-b5fd-6fa792597d3b tempest-VolumesCloneNegativeTest-1753165583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (612e4afa-b964-4e0a-98f3-bbcacfc0d1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:43 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-98eb6038-ea40-41d4-b5fd-6fa792597d3b tempest-VolumesCloneNegativeTest-1753165583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa987223-ce9b-401e-b7a3-80cc51093949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:43 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-98eb6038-ea40-41d4-b5fd-6fa792597d3b tempest-VolumesCloneNegativeTest-1753165583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa987223-ce9b-401e-b7a3-80cc51093949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '503c29b0-3ec4-482b-870b-1f010874a9e3', 'volume_name': 'volume-503c29b0-3ec4-482b-870b-1f010874a9e3', 'volume_size': 2}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:43 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-98eb6038-ea40-41d4-b5fd-6fa792597d3b tempest-VolumesCloneNegativeTest-1753165583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcc43cac-41d9-4835-9ddc-e4155e094309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:43 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-98eb6038-ea40-41d4-b5fd-6fa792597d3b tempest-VolumesCloneNegativeTest-1753165583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcc43cac-41d9-4835-9ddc-e4155e094309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:43 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-98eb6038-ea40-41d4-b5fd-6fa792597d3b tempest-VolumesCloneNegativeTest-1753165583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c62c3e43-2250-43a2-8e93-e1916e3c2029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:43 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-98eb6038-ea40-41d4-b5fd-6fa792597d3b tempest-VolumesCloneNegativeTest-1753165583 None] Volume 503c29b0-3ec4-482b-870b-1f010874a9e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-503c29b0-3ec4-482b-870b-1f010874a9e3', 'volume_size': 2} Jul 10 06:53:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-98eb6038-ea40-41d4-b5fd-6fa792597d3b tempest-VolumesCloneNegativeTest-1753165583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-98eb6038-ea40-41d4-b5fd-6fa792597d3b tempest-VolumesCloneNegativeTest-1753165583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:43 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-98eb6038-ea40-41d4-b5fd-6fa792597d3b tempest-VolumesCloneNegativeTest-1753165583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1363690980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=503c29b0-3ec4-482b-870b-1f010874a9e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20dc6ee41654473db975fba0b1e9243b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:53:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:53:43Z,use_quota=True,user_id='8ff736524171491a960a76ffc21a97fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:53:43 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-98eb6038-ea40-41d4-b5fd-6fa792597d3b tempest-VolumesCloneNegativeTest-1753165583 None] Creating volume 503c29b0-3ec4-482b-870b-1f010874a9e3 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:53:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-98eb6038-ea40-41d4-b5fd-6fa792597d3b tempest-VolumesCloneNegativeTest-1753165583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-98eb6038-ea40-41d4-b5fd-6fa792597d3b tempest-VolumesCloneNegativeTest-1753165583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:43 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-98eb6038-ea40-41d4-b5fd-6fa792597d3b tempest-VolumesCloneNegativeTest-1753165583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:53:43 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-98eb6038-ea40-41d4-b5fd-6fa792597d3b tempest-VolumesCloneNegativeTest-1753165583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:53:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-98eb6038-ea40-41d4-b5fd-6fa792597d3b tempest-VolumesCloneNegativeTest-1753165583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:43 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-98eb6038-ea40-41d4-b5fd-6fa792597d3b tempest-VolumesCloneNegativeTest-1753165583 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:53:43 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-98eb6038-ea40-41d4-b5fd-6fa792597d3b tempest-VolumesCloneNegativeTest-1753165583 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:53:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-98eb6038-ea40-41d4-b5fd-6fa792597d3b tempest-VolumesCloneNegativeTest-1753165583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-503c29b0-3ec4-482b-870b-1f010874a9e3 2147483648 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:43 devstack sudo[104221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-503c29b0-3ec4-482b-870b-1f010874a9e3 2147483648 Jul 10 06:53:43 devstack sudo[104221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:43 devstack sudo[104219]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f8ea0ce2-79b6-4f07-a0ca-6d5c735d3928 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d9d6bea4-2459-4957-af39-f462b7c7ccf5" returned: 0 in 0.645s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:43 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f8ea0ce2-79b6-4f07-a0ca-6d5c735d3928 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "cinder-quobyte-d9d6bea4-2459-4957-af39-f462b7c7ccf5" released by "delete_volume" :: held 1.484s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:53:43 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-f8ea0ce2-79b6-4f07-a0ca-6d5c735d3928 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Created reservations ['2082fcb0-ac36-4c64-9c83-3ce4ccc8a080', '48b101f4-5909-4127-955b-477377f0ff93', 'c1a1afad-2913-4015-bffd-482edb3c6a24', '6f82b220-3074-4c09-ae0f-569c84b6b1d0'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:53:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f8ea0ce2-79b6-4f07-a0ca-6d5c735d3928 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f8ea0ce2-79b6-4f07-a0ca-6d5c735d3928 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:43 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f8ea0ce2-79b6-4f07-a0ca-6d5c735d3928 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:53:43 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f8ea0ce2-79b6-4f07-a0ca-6d5c735d3928 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:53:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f8ea0ce2-79b6-4f07-a0ca-6d5c735d3928 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f8ea0ce2-79b6-4f07-a0ca-6d5c735d3928 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:43 devstack sudo[104227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:53:43 devstack sudo[104227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:44 devstack sudo[104221]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-98eb6038-ea40-41d4-b5fd-6fa792597d3b tempest-VolumesCloneNegativeTest-1753165583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-503c29b0-3ec4-482b-870b-1f010874a9e3 2147483648" returned: 0 in 0.915s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-98eb6038-ea40-41d4-b5fd-6fa792597d3b tempest-VolumesCloneNegativeTest-1753165583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-503c29b0-3ec4-482b-870b-1f010874a9e3 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:44 devstack sudo[104230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-503c29b0-3ec4-482b-870b-1f010874a9e3 Jul 10 06:53:44 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:44 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-8abcf723-54e0-4e8a-b413-61ee7392db49 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Acquiring lock "cinder-e9892903-e797-4724-8266-eaea09b90ff6-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:53:44 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-8abcf723-54e0-4e8a-b413-61ee7392db49 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "cinder-e9892903-e797-4724-8266-eaea09b90ff6-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:53:44 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-8abcf723-54e0-4e8a-b413-61ee7392db49 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Acquiring lock "cinder-quobyte-e9892903-e797-4724-8266-eaea09b90ff6" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:53:44 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-8abcf723-54e0-4e8a-b413-61ee7392db49 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "cinder-quobyte-e9892903-e797-4724-8266-eaea09b90ff6" acquired by "delete_volume" :: waited 0.029s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:53:44 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[da66d4c6-ae79-4a5d-b998-6859f3e59839]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8abcf723-54e0-4e8a-b413-61ee7392db49 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e9892903-e797-4724-8266-eaea09b90ff6 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:44 devstack sudo[104227]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f8ea0ce2-79b6-4f07-a0ca-6d5c735d3928 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.762s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:44 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-f8ea0ce2-79b6-4f07-a0ca-6d5c735d3928 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:53:44 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-f8ea0ce2-79b6-4f07-a0ca-6d5c735d3928 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Deleted volume successfully. Jul 10 06:53:44 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f8ea0ce2-79b6-4f07-a0ca-6d5c735d3928 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "cinder-d9d6bea4-2459-4957-af39-f462b7c7ccf5-delete_volume" released by "delete_volume" :: held 2.478s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:53:44 devstack sudo[104233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e9892903-e797-4724-8266-eaea09b90ff6 Jul 10 06:53:44 devstack sudo[104233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:44 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-98eb6038-ea40-41d4-b5fd-6fa792597d3b tempest-VolumesCloneNegativeTest-1753165583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-503c29b0-3ec4-482b-870b-1f010874a9e3" returned: 0 in 0.704s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:44 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-98eb6038-ea40-41d4-b5fd-6fa792597d3b tempest-VolumesCloneNegativeTest-1753165583 None] <== create_volume: return (1662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:53:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-98eb6038-ea40-41d4-b5fd-6fa792597d3b tempest-VolumesCloneNegativeTest-1753165583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:44 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-98eb6038-ea40-41d4-b5fd-6fa792597d3b tempest-VolumesCloneNegativeTest-1753165583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c62c3e43-2250-43a2-8e93-e1916e3c2029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-503c29b0-3ec4-482b-870b-1f010874a9e3', 'volume_size': 2}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:44 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-98eb6038-ea40-41d4-b5fd-6fa792597d3b tempest-VolumesCloneNegativeTest-1753165583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7af476b2-61f1-46d0-9586-062a64a07240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:44 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-98eb6038-ea40-41d4-b5fd-6fa792597d3b tempest-VolumesCloneNegativeTest-1753165583 None] Volume volume-503c29b0-3ec4-482b-870b-1f010874a9e3 (503c29b0-3ec4-482b-870b-1f010874a9e3): created successfully Jul 10 06:53:44 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-98eb6038-ea40-41d4-b5fd-6fa792597d3b tempest-VolumesCloneNegativeTest-1753165583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7af476b2-61f1-46d0-9586-062a64a07240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:44 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-98eb6038-ea40-41d4-b5fd-6fa792597d3b tempest-VolumesCloneNegativeTest-1753165583 None] Flow 'volume_create_manager' (e3065d91-ead3-4a55-b54c-6a70223af829) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:53:45 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-98eb6038-ea40-41d4-b5fd-6fa792597d3b tempest-VolumesCloneNegativeTest-1753165583 None] Created volume successfully. Jul 10 06:53:45 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-94a9593b-86d5-4584-bbec-65c118a53105 tempest-VolumesCloneNegativeTest-1753165583 None] Acquiring lock "cinder-503c29b0-3ec4-482b-870b-1f010874a9e3-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:53:45 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-94a9593b-86d5-4584-bbec-65c118a53105 tempest-VolumesCloneNegativeTest-1753165583 None] Lock "cinder-503c29b0-3ec4-482b-870b-1f010874a9e3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:53:45 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-94a9593b-86d5-4584-bbec-65c118a53105 tempest-VolumesCloneNegativeTest-1753165583 None] Acquiring lock "cinder-quobyte-503c29b0-3ec4-482b-870b-1f010874a9e3" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:53:45 devstack sudo[104233]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:45 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-94a9593b-86d5-4584-bbec-65c118a53105 tempest-VolumesCloneNegativeTest-1753165583 None] Lock "cinder-quobyte-503c29b0-3ec4-482b-870b-1f010874a9e3" acquired by "delete_volume" :: waited 0.019s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:53:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8abcf723-54e0-4e8a-b413-61ee7392db49 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e9892903-e797-4724-8266-eaea09b90ff6" returned: 0 in 0.820s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8abcf723-54e0-4e8a-b413-61ee7392db49 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e9892903-e797-4724-8266-eaea09b90ff6 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:45 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c59119c-b088-4835-aca9-530fad758cc5]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-94a9593b-86d5-4584-bbec-65c118a53105 tempest-VolumesCloneNegativeTest-1753165583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-503c29b0-3ec4-482b-870b-1f010874a9e3 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:45 devstack sudo[104239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e9892903-e797-4724-8266-eaea09b90ff6 Jul 10 06:53:45 devstack sudo[104239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:45 devstack sudo[104240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-503c29b0-3ec4-482b-870b-1f010874a9e3 Jul 10 06:53:45 devstack sudo[104240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:46 devstack sudo[104239]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8abcf723-54e0-4e8a-b413-61ee7392db49 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e9892903-e797-4724-8266-eaea09b90ff6" returned: 0 in 0.684s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:46 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-8abcf723-54e0-4e8a-b413-61ee7392db49 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "cinder-quobyte-e9892903-e797-4724-8266-eaea09b90ff6" released by "delete_volume" :: held 1.553s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:53:46 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-8abcf723-54e0-4e8a-b413-61ee7392db49 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Created reservations ['c3171f13-5f34-4fba-966e-c8d9d0737461', '4c11b887-0d89-4daa-9c6e-61a2c1d2bbb6', '2718b6c0-5219-4e84-9b53-6e26e6d955b6', '904f12af-7c8c-49ef-a443-a04232e4eb51'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:53:46 devstack sudo[104240]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-94a9593b-86d5-4584-bbec-65c118a53105 tempest-VolumesCloneNegativeTest-1753165583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-503c29b0-3ec4-482b-870b-1f010874a9e3" returned: 0 in 0.796s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-94a9593b-86d5-4584-bbec-65c118a53105 tempest-VolumesCloneNegativeTest-1753165583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-503c29b0-3ec4-482b-870b-1f010874a9e3 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-8abcf723-54e0-4e8a-b413-61ee7392db49 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-8abcf723-54e0-4e8a-b413-61ee7392db49 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:46 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-8abcf723-54e0-4e8a-b413-61ee7392db49 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:53:46 devstack sudo[104247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-503c29b0-3ec4-482b-870b-1f010874a9e3 Jul 10 06:53:46 devstack sudo[104247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:46 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-8abcf723-54e0-4e8a-b413-61ee7392db49 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:53:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-8abcf723-54e0-4e8a-b413-61ee7392db49 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8abcf723-54e0-4e8a-b413-61ee7392db49 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:46 devstack sudo[104249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:53:46 devstack sudo[104249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:46 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-adca466b-34cc-42f5-863c-ec429999dd91 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Acquiring lock "cinder-91d7c86b-cd8b-45fc-8b81-cbfc1acf0ae6-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:53:46 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-adca466b-34cc-42f5-863c-ec429999dd91 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "cinder-91d7c86b-cd8b-45fc-8b81-cbfc1acf0ae6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:53:46 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-adca466b-34cc-42f5-863c-ec429999dd91 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Acquiring lock "cinder-quobyte-91d7c86b-cd8b-45fc-8b81-cbfc1acf0ae6" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:53:46 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-adca466b-34cc-42f5-863c-ec429999dd91 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "cinder-quobyte-91d7c86b-cd8b-45fc-8b81-cbfc1acf0ae6" acquired by "delete_volume" :: waited 0.017s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:53:46 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[de82d02e-49ef-4ad3-a8fa-c9b6b238b187]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-adca466b-34cc-42f5-863c-ec429999dd91 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-91d7c86b-cd8b-45fc-8b81-cbfc1acf0ae6 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:46 devstack sudo[104251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-91d7c86b-cd8b-45fc-8b81-cbfc1acf0ae6 Jul 10 06:53:46 devstack sudo[104251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:47 devstack sudo[104247]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-94a9593b-86d5-4584-bbec-65c118a53105 tempest-VolumesCloneNegativeTest-1753165583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-503c29b0-3ec4-482b-870b-1f010874a9e3" returned: 0 in 0.710s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:47 devstack sudo[104249]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8abcf723-54e0-4e8a-b413-61ee7392db49 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.694s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:47 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-8abcf723-54e0-4e8a-b413-61ee7392db49 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:53:47 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-8abcf723-54e0-4e8a-b413-61ee7392db49 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Deleted volume successfully. Jul 10 06:53:47 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-94a9593b-86d5-4584-bbec-65c118a53105 tempest-VolumesCloneNegativeTest-1753165583 None] Lock "cinder-quobyte-503c29b0-3ec4-482b-870b-1f010874a9e3" released by "delete_volume" :: held 1.577s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:53:47 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-8abcf723-54e0-4e8a-b413-61ee7392db49 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "cinder-e9892903-e797-4724-8266-eaea09b90ff6-delete_volume" released by "delete_volume" :: held 2.539s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:53:47 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-94a9593b-86d5-4584-bbec-65c118a53105 tempest-VolumesCloneNegativeTest-1753165583 None] Created reservations ['6d722f98-39ff-4345-881f-1ae779c21494', '344df043-47f2-487a-939d-064a0e1a04b6', '5c517c7e-2fa4-441f-90c5-7035a58897c8', '52687bf0-8e63-4b52-943c-b2beb499fd2f'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:53:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-94a9593b-86d5-4584-bbec-65c118a53105 tempest-VolumesCloneNegativeTest-1753165583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-94a9593b-86d5-4584-bbec-65c118a53105 tempest-VolumesCloneNegativeTest-1753165583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:47 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-94a9593b-86d5-4584-bbec-65c118a53105 tempest-VolumesCloneNegativeTest-1753165583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:53:47 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-94a9593b-86d5-4584-bbec-65c118a53105 tempest-VolumesCloneNegativeTest-1753165583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:53:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-94a9593b-86d5-4584-bbec-65c118a53105 tempest-VolumesCloneNegativeTest-1753165583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-94a9593b-86d5-4584-bbec-65c118a53105 tempest-VolumesCloneNegativeTest-1753165583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:47 devstack sudo[104255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:53:47 devstack sudo[104255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:47 devstack sudo[104251]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-adca466b-34cc-42f5-863c-ec429999dd91 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-91d7c86b-cd8b-45fc-8b81-cbfc1acf0ae6" returned: 0 in 0.780s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-adca466b-34cc-42f5-863c-ec429999dd91 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-91d7c86b-cd8b-45fc-8b81-cbfc1acf0ae6 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:47 devstack sudo[104260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-91d7c86b-cd8b-45fc-8b81-cbfc1acf0ae6 Jul 10 06:53:47 devstack sudo[104260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:47 devstack sudo[104255]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-94a9593b-86d5-4584-bbec-65c118a53105 tempest-VolumesCloneNegativeTest-1753165583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.673s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:47 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-94a9593b-86d5-4584-bbec-65c118a53105 tempest-VolumesCloneNegativeTest-1753165583 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:53:47 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-94a9593b-86d5-4584-bbec-65c118a53105 tempest-VolumesCloneNegativeTest-1753165583 None] Deleted volume successfully. Jul 10 06:53:47 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-94a9593b-86d5-4584-bbec-65c118a53105 tempest-VolumesCloneNegativeTest-1753165583 None] Lock "cinder-503c29b0-3ec4-482b-870b-1f010874a9e3-delete_volume" released by "delete_volume" :: held 2.480s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:53:48 devstack sudo[104260]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-adca466b-34cc-42f5-863c-ec429999dd91 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-91d7c86b-cd8b-45fc-8b81-cbfc1acf0ae6" returned: 0 in 0.713s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:48 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-adca466b-34cc-42f5-863c-ec429999dd91 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "cinder-quobyte-91d7c86b-cd8b-45fc-8b81-cbfc1acf0ae6" released by "delete_volume" :: held 1.531s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:53:48 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-adca466b-34cc-42f5-863c-ec429999dd91 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Created reservations ['1dc42755-428d-40aa-b0f4-c9db4e324ea3', '372ed7f5-cb3b-493a-a265-8c37538c78d5', '6b6edfef-b9ec-49f1-b501-b48f8e0bca03', 'ce05a0cc-8463-4774-a86f-9eefef1bb345'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:53:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-adca466b-34cc-42f5-863c-ec429999dd91 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-adca466b-34cc-42f5-863c-ec429999dd91 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:48 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-adca466b-34cc-42f5-863c-ec429999dd91 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:53:48 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-adca466b-34cc-42f5-863c-ec429999dd91 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:53:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-adca466b-34cc-42f5-863c-ec429999dd91 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-adca466b-34cc-42f5-863c-ec429999dd91 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:48 devstack sudo[104264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:53:48 devstack sudo[104264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:49 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-900b9d6a-a40d-48c1-88d0-be78cabe73b0 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Acquiring lock "cinder-48be3033-b02e-4fb1-aa11-716315610b4a-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:53:49 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-900b9d6a-a40d-48c1-88d0-be78cabe73b0 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "cinder-48be3033-b02e-4fb1-aa11-716315610b4a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:53:49 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-900b9d6a-a40d-48c1-88d0-be78cabe73b0 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Acquiring lock "cinder-quobyte-48be3033-b02e-4fb1-aa11-716315610b4a" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:53:49 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-900b9d6a-a40d-48c1-88d0-be78cabe73b0 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "cinder-quobyte-48be3033-b02e-4fb1-aa11-716315610b4a" acquired by "delete_volume" :: waited 0.017s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:53:49 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[26746ecf-257d-409b-b31d-5f955b9f15fe]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-900b9d6a-a40d-48c1-88d0-be78cabe73b0 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-48be3033-b02e-4fb1-aa11-716315610b4a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:49 devstack sudo[104264]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-adca466b-34cc-42f5-863c-ec429999dd91 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.711s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:49 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-adca466b-34cc-42f5-863c-ec429999dd91 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:53:49 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-adca466b-34cc-42f5-863c-ec429999dd91 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Deleted volume successfully. Jul 10 06:53:49 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-adca466b-34cc-42f5-863c-ec429999dd91 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "cinder-91d7c86b-cd8b-45fc-8b81-cbfc1acf0ae6-delete_volume" released by "delete_volume" :: held 2.468s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:53:49 devstack sudo[104267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-48be3033-b02e-4fb1-aa11-716315610b4a Jul 10 06:53:49 devstack sudo[104267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:49 devstack sudo[104267]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-900b9d6a-a40d-48c1-88d0-be78cabe73b0 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-48be3033-b02e-4fb1-aa11-716315610b4a" returned: 0 in 0.793s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-900b9d6a-a40d-48c1-88d0-be78cabe73b0 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-48be3033-b02e-4fb1-aa11-716315610b4a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:49 devstack sudo[104273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-48be3033-b02e-4fb1-aa11-716315610b4a Jul 10 06:53:49 devstack sudo[104273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:50 devstack sudo[104273]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-900b9d6a-a40d-48c1-88d0-be78cabe73b0 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-48be3033-b02e-4fb1-aa11-716315610b4a" returned: 0 in 0.680s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:50 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-900b9d6a-a40d-48c1-88d0-be78cabe73b0 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "cinder-quobyte-48be3033-b02e-4fb1-aa11-716315610b4a" released by "delete_volume" :: held 1.522s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:53:50 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-900b9d6a-a40d-48c1-88d0-be78cabe73b0 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Created reservations ['3fab2cad-f59b-4f10-9c40-04bf4d7319db', '3330f2fc-82ac-41db-91b4-c48a6cf49603', 'cc1170ec-69a3-471d-9490-d8230cb43fb5', 'ca76faff-d3ef-42af-9295-2c08e0a0140b'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:53:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-900b9d6a-a40d-48c1-88d0-be78cabe73b0 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-900b9d6a-a40d-48c1-88d0-be78cabe73b0 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:50 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-900b9d6a-a40d-48c1-88d0-be78cabe73b0 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:53:50 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-900b9d6a-a40d-48c1-88d0-be78cabe73b0 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:53:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-900b9d6a-a40d-48c1-88d0-be78cabe73b0 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-900b9d6a-a40d-48c1-88d0-be78cabe73b0 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:50 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-f82cc889-0abf-4739-a6c3-7004eaa57189 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:53:50 devstack sudo[104276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:53:50 devstack sudo[104276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:50 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f82cc889-0abf-4739-a6c3-7004eaa57189 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Flow 'volume_create_manager' (8a3b0d38-d679-40b0-bdb4-6441c70bdd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:53:50 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f82cc889-0abf-4739-a6c3-7004eaa57189 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6106846c-ef4b-48e9-8c96-544dd612d0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:50 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f82cc889-0abf-4739-a6c3-7004eaa57189 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6106846c-ef4b-48e9-8c96-544dd612d0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-359394142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e1df150-d197-4d38-99b2-3b044d668e0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6b48ce231a5449eb4b3030c2733fc3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:53:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:53:51Z,use_quota=True,user_id='41ab0a6eae7c4ae3ba9fd34898228e8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:50 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f82cc889-0abf-4739-a6c3-7004eaa57189 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84f191f1-ea2b-4d81-895d-947006df2308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:50 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f82cc889-0abf-4739-a6c3-7004eaa57189 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84f191f1-ea2b-4d81-895d-947006df2308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:50 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f82cc889-0abf-4739-a6c3-7004eaa57189 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (603ed2ee-5e31-4588-8777-341d9a4d87ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:50 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f82cc889-0abf-4739-a6c3-7004eaa57189 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (603ed2ee-5e31-4588-8777-341d9a4d87ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e1df150-d197-4d38-99b2-3b044d668e0f', 'volume_name': 'volume-4e1df150-d197-4d38-99b2-3b044d668e0f', 'volume_size': 2}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:50 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f82cc889-0abf-4739-a6c3-7004eaa57189 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (416de1ef-44ce-48ce-b855-a5edf3f34a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:50 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f82cc889-0abf-4739-a6c3-7004eaa57189 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (416de1ef-44ce-48ce-b855-a5edf3f34a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:50 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f82cc889-0abf-4739-a6c3-7004eaa57189 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91bb213c-2e9d-4cb0-b397-e8776e035592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:50 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-f82cc889-0abf-4739-a6c3-7004eaa57189 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Volume 4e1df150-d197-4d38-99b2-3b044d668e0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e1df150-d197-4d38-99b2-3b044d668e0f', 'volume_size': 2} Jul 10 06:53:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f82cc889-0abf-4739-a6c3-7004eaa57189 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f82cc889-0abf-4739-a6c3-7004eaa57189 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:50 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f82cc889-0abf-4739-a6c3-7004eaa57189 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-359394142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e1df150-d197-4d38-99b2-3b044d668e0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6b48ce231a5449eb4b3030c2733fc3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:53:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:53:51Z,use_quota=True,user_id='41ab0a6eae7c4ae3ba9fd34898228e8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:53:50 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-f82cc889-0abf-4739-a6c3-7004eaa57189 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Creating volume 4e1df150-d197-4d38-99b2-3b044d668e0f {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:53:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f82cc889-0abf-4739-a6c3-7004eaa57189 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f82cc889-0abf-4739-a6c3-7004eaa57189 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:50 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f82cc889-0abf-4739-a6c3-7004eaa57189 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:53:50 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f82cc889-0abf-4739-a6c3-7004eaa57189 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:53:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f82cc889-0abf-4739-a6c3-7004eaa57189 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:50 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f82cc889-0abf-4739-a6c3-7004eaa57189 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:53:50 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-f82cc889-0abf-4739-a6c3-7004eaa57189 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:53:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f82cc889-0abf-4739-a6c3-7004eaa57189 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f 2147483648 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:50 devstack sudo[104278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f 2147483648 Jul 10 06:53:50 devstack sudo[104278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:51 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1ef6933c-e296-4f0a-b12a-6e3c26ce4ef3 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Acquiring lock "cinder-e2f94f2e-5f8a-41fd-b800-7e0389aaf5b3-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:53:51 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1ef6933c-e296-4f0a-b12a-6e3c26ce4ef3 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "cinder-e2f94f2e-5f8a-41fd-b800-7e0389aaf5b3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:53:51 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1ef6933c-e296-4f0a-b12a-6e3c26ce4ef3 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Acquiring lock "cinder-quobyte-e2f94f2e-5f8a-41fd-b800-7e0389aaf5b3" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:53:51 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1ef6933c-e296-4f0a-b12a-6e3c26ce4ef3 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "cinder-quobyte-e2f94f2e-5f8a-41fd-b800-7e0389aaf5b3" acquired by "delete_volume" :: waited 0.018s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:53:51 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38635dd-a9e0-4441-b6d3-bc13c907d061]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1ef6933c-e296-4f0a-b12a-6e3c26ce4ef3 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e2f94f2e-5f8a-41fd-b800-7e0389aaf5b3 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:51 devstack sudo[104276]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-900b9d6a-a40d-48c1-88d0-be78cabe73b0 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.680s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:51 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-900b9d6a-a40d-48c1-88d0-be78cabe73b0 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:53:51 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-900b9d6a-a40d-48c1-88d0-be78cabe73b0 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Deleted volume successfully. Jul 10 06:53:51 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-900b9d6a-a40d-48c1-88d0-be78cabe73b0 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "cinder-48be3033-b02e-4fb1-aa11-716315610b4a-delete_volume" released by "delete_volume" :: held 2.418s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:53:51 devstack sudo[104281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e2f94f2e-5f8a-41fd-b800-7e0389aaf5b3 Jul 10 06:53:51 devstack sudo[104281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:51 devstack sudo[104278]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f82cc889-0abf-4739-a6c3-7004eaa57189 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f 2147483648" returned: 0 in 0.963s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f82cc889-0abf-4739-a6c3-7004eaa57189 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:51 devstack sudo[104287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f Jul 10 06:53:51 devstack sudo[104287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:52 devstack sudo[104281]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1ef6933c-e296-4f0a-b12a-6e3c26ce4ef3 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e2f94f2e-5f8a-41fd-b800-7e0389aaf5b3" returned: 0 in 0.783s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1ef6933c-e296-4f0a-b12a-6e3c26ce4ef3 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e2f94f2e-5f8a-41fd-b800-7e0389aaf5b3 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:52 devstack sudo[104292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e2f94f2e-5f8a-41fd-b800-7e0389aaf5b3 Jul 10 06:53:52 devstack sudo[104292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:52 devstack sudo[104287]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f82cc889-0abf-4739-a6c3-7004eaa57189 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f" returned: 0 in 0.664s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:52 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f82cc889-0abf-4739-a6c3-7004eaa57189 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] <== create_volume: return (1673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:53:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f82cc889-0abf-4739-a6c3-7004eaa57189 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:52 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f82cc889-0abf-4739-a6c3-7004eaa57189 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91bb213c-2e9d-4cb0-b397-e8776e035592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e1df150-d197-4d38-99b2-3b044d668e0f', 'volume_size': 2}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:52 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f82cc889-0abf-4739-a6c3-7004eaa57189 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99ec863d-bfc9-4296-ba39-71d31821f068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:52 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-f82cc889-0abf-4739-a6c3-7004eaa57189 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Volume volume-4e1df150-d197-4d38-99b2-3b044d668e0f (4e1df150-d197-4d38-99b2-3b044d668e0f): created successfully Jul 10 06:53:52 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f82cc889-0abf-4739-a6c3-7004eaa57189 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99ec863d-bfc9-4296-ba39-71d31821f068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:52 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f82cc889-0abf-4739-a6c3-7004eaa57189 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Flow 'volume_create_manager' (8a3b0d38-d679-40b0-bdb4-6441c70bdd8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:53:52 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-f82cc889-0abf-4739-a6c3-7004eaa57189 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Created volume successfully. Jul 10 06:53:52 devstack sudo[104292]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1ef6933c-e296-4f0a-b12a-6e3c26ce4ef3 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e2f94f2e-5f8a-41fd-b800-7e0389aaf5b3" returned: 0 in 0.696s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:52 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1ef6933c-e296-4f0a-b12a-6e3c26ce4ef3 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "cinder-quobyte-e2f94f2e-5f8a-41fd-b800-7e0389aaf5b3" released by "delete_volume" :: held 1.528s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:53:53 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-1ef6933c-e296-4f0a-b12a-6e3c26ce4ef3 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Created reservations ['164fb2fe-143f-42e6-aaa6-dd4d85683fab', '418d0a2e-b17e-411c-8b1b-0ca1b5098c51', '038d61f7-306e-4fa7-963c-02a70b84b0c6', 'f4dd03c9-a671-4234-889e-e6f0c8476c13'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:53:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-55f34adb-c36a-479a-b1e9-e3a299ff3612 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-55f34adb-c36a-479a-b1e9-e3a299ff3612 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:53 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-55f34adb-c36a-479a-b1e9-e3a299ff3612 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Creating offline snapshot 6a33d644-6a07-444c-a59c-6c4fa02553ed of volume 4e1df150-d197-4d38-99b2-3b044d668e0f {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:53:53 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[30080709-770d-4290-8b82-5bea771e4b55]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-55f34adb-c36a-479a-b1e9-e3a299ff3612 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-1ef6933c-e296-4f0a-b12a-6e3c26ce4ef3 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-1ef6933c-e296-4f0a-b12a-6e3c26ce4ef3 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:53 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-1ef6933c-e296-4f0a-b12a-6e3c26ce4ef3 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:53:53 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-1ef6933c-e296-4f0a-b12a-6e3c26ce4ef3 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:53:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-1ef6933c-e296-4f0a-b12a-6e3c26ce4ef3 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1ef6933c-e296-4f0a-b12a-6e3c26ce4ef3 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:53 devstack sudo[104297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:53:53 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:53 devstack sudo[104296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f Jul 10 06:53:53 devstack sudo[104296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:53 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1d2273e3-110b-4806-812e-2312675391c9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Acquiring lock "cinder-d63b84c5-8d98-4a08-b84d-66e46104dac5-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:53:53 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1d2273e3-110b-4806-812e-2312675391c9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "cinder-d63b84c5-8d98-4a08-b84d-66e46104dac5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:53:53 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1d2273e3-110b-4806-812e-2312675391c9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Acquiring lock "cinder-quobyte-d63b84c5-8d98-4a08-b84d-66e46104dac5" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:53:53 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1d2273e3-110b-4806-812e-2312675391c9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "cinder-quobyte-d63b84c5-8d98-4a08-b84d-66e46104dac5" acquired by "delete_volume" :: waited 0.022s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:53:53 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e147dd-733e-4472-96a8-f25ef9a5f101]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1d2273e3-110b-4806-812e-2312675391c9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d63b84c5-8d98-4a08-b84d-66e46104dac5 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:53 devstack sudo[104301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d63b84c5-8d98-4a08-b84d-66e46104dac5 Jul 10 06:53:53 devstack sudo[104301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:53 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1ef6933c-e296-4f0a-b12a-6e3c26ce4ef3 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.681s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:53 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-1ef6933c-e296-4f0a-b12a-6e3c26ce4ef3 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:53:53 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-1ef6933c-e296-4f0a-b12a-6e3c26ce4ef3 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Deleted volume successfully. Jul 10 06:53:53 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1ef6933c-e296-4f0a-b12a-6e3c26ce4ef3 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "cinder-e2f94f2e-5f8a-41fd-b800-7e0389aaf5b3-delete_volume" released by "delete_volume" :: held 2.511s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:53:53 devstack sudo[104296]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-55f34adb-c36a-479a-b1e9-e3a299ff3612 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f" returned: 0 in 0.841s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-55f34adb-c36a-479a-b1e9-e3a299ff3612 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f.6a33d644-6a07-444c-a59c-6c4fa02553ed 2G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:53 devstack sudo[104307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f.6a33d644-6a07-444c-a59c-6c4fa02553ed 2G Jul 10 06:53:53 devstack sudo[104307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:54 devstack sudo[104301]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1d2273e3-110b-4806-812e-2312675391c9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d63b84c5-8d98-4a08-b84d-66e46104dac5" returned: 0 in 0.747s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1d2273e3-110b-4806-812e-2312675391c9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d63b84c5-8d98-4a08-b84d-66e46104dac5 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:54 devstack sudo[104313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d63b84c5-8d98-4a08-b84d-66e46104dac5 Jul 10 06:53:54 devstack sudo[104313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:54 devstack sudo[104307]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-55f34adb-c36a-479a-b1e9-e3a299ff3612 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f.6a33d644-6a07-444c-a59c-6c4fa02553ed 2G" returned: 0 in 0.770s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-55f34adb-c36a-479a-b1e9-e3a299ff3612 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e1df150-d197-4d38-99b2-3b044d668e0f -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f.6a33d644-6a07-444c-a59c-6c4fa02553ed {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:54 devstack sudo[104318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e1df150-d197-4d38-99b2-3b044d668e0f -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f.6a33d644-6a07-444c-a59c-6c4fa02553ed Jul 10 06:53:54 devstack sudo[104318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:55 devstack sudo[104313]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1d2273e3-110b-4806-812e-2312675391c9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d63b84c5-8d98-4a08-b84d-66e46104dac5" returned: 0 in 0.618s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1d2273e3-110b-4806-812e-2312675391c9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "cinder-quobyte-d63b84c5-8d98-4a08-b84d-66e46104dac5" released by "delete_volume" :: held 1.408s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:53:55 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-1d2273e3-110b-4806-812e-2312675391c9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Created reservations ['6e35ea03-c422-415b-9abd-ac450bc80d94', '428c8e44-d331-40f0-b997-5346ba8ab3aa', 'bf67af86-d39c-4b28-8956-f4d06cb54f89', '9251762a-8391-4fa3-a3af-27ebce1514aa'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:53:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-1d2273e3-110b-4806-812e-2312675391c9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-1d2273e3-110b-4806-812e-2312675391c9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:55 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-1d2273e3-110b-4806-812e-2312675391c9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:53:55 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-1d2273e3-110b-4806-812e-2312675391c9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:53:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-1d2273e3-110b-4806-812e-2312675391c9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1d2273e3-110b-4806-812e-2312675391c9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:55 devstack sudo[104321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:53:55 devstack sudo[104321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:55 devstack sudo[104318]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-55f34adb-c36a-479a-b1e9-e3a299ff3612 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e1df150-d197-4d38-99b2-3b044d668e0f -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f.6a33d644-6a07-444c-a59c-6c4fa02553ed" returned: 0 in 0.696s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:55 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-55f34adb-c36a-479a-b1e9-e3a299ff3612 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f.6a33d644-6a07-444c-a59c-6c4fa02553ed is being set with open permissions: ugo+rw Jul 10 06:53:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-55f34adb-c36a-479a-b1e9-e3a299ff3612 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f.6a33d644-6a07-444c-a59c-6c4fa02553ed {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:55 devstack sudo[104326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f.6a33d644-6a07-444c-a59c-6c4fa02553ed Jul 10 06:53:55 devstack sudo[104326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:55 devstack sudo[104321]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1d2273e3-110b-4806-812e-2312675391c9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.672s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:55 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-1d2273e3-110b-4806-812e-2312675391c9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:53:55 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-1d2273e3-110b-4806-812e-2312675391c9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Deleted volume successfully. Jul 10 06:53:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1d2273e3-110b-4806-812e-2312675391c9 tempest-CreateVolumesFromSourceVolumeTest-561332917 None] Lock "cinder-d63b84c5-8d98-4a08-b84d-66e46104dac5-delete_volume" released by "delete_volume" :: held 2.342s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:53:56 devstack sudo[104326]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-55f34adb-c36a-479a-b1e9-e3a299ff3612 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f.6a33d644-6a07-444c-a59c-6c4fa02553ed" returned: 0 in 0.665s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-55f34adb-c36a-479a-b1e9-e3a299ff3612 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:56 devstack sudo[104330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f.info Jul 10 06:53:56 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:56 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-55f34adb-c36a-479a-b1e9-e3a299ff3612 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f.info" returned: 0 in 0.701s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:56 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-55f34adb-c36a-479a-b1e9-e3a299ff3612 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f.info is being set with open permissions: ugo+rw Jul 10 06:53:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-55f34adb-c36a-479a-b1e9-e3a299ff3612 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:56 devstack sudo[104335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f.info Jul 10 06:53:56 devstack sudo[104335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:57 devstack sudo[104335]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-55f34adb-c36a-479a-b1e9-e3a299ff3612 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f.info" returned: 0 in 0.667s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-55f34adb-c36a-479a-b1e9-e3a299ff3612 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.433s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:57 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-55f34adb-c36a-479a-b1e9-e3a299ff3612 tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Create snapshot completed successfully Jul 10 06:53:58 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6befb791-4f69-4ee4-9320-6aeab4a8b93a tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Acquiring lock "cinder-6a33d644-6a07-444c-a59c-6c4fa02553ed-delete_snapshot" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:53:58 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6befb791-4f69-4ee4-9320-6aeab4a8b93a tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Lock "cinder-6a33d644-6a07-444c-a59c-6c4fa02553ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:53:58 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6befb791-4f69-4ee4-9320-6aeab4a8b93a tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Acquiring lock "cinder-quobyte-4e1df150-d197-4d38-99b2-3b044d668e0f" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:53:58 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6befb791-4f69-4ee4-9320-6aeab4a8b93a tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Lock "cinder-quobyte-4e1df150-d197-4d38-99b2-3b044d668e0f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:53:58 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6befb791-4f69-4ee4-9320-6aeab4a8b93a tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Acquiring lock "cinder-quobyte-6a33d644-6a07-444c-a59c-6c4fa02553ed" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:53:58 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6befb791-4f69-4ee4-9320-6aeab4a8b93a tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Lock "cinder-quobyte-6a33d644-6a07-444c-a59c-6c4fa02553ed" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:53:58 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-6befb791-4f69-4ee4-9320-6aeab4a8b93a tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Deleting offline snapshot 6a33d644-6a07-444c-a59c-6c4fa02553ed of volume 4e1df150-d197-4d38-99b2-3b044d668e0f {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:53:58 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-6befb791-4f69-4ee4-9320-6aeab4a8b93a tempest-VolumesSnapshotNegativeTestJSON-776667731 None] snapshot_file for this snap is: volume-4e1df150-d197-4d38-99b2-3b044d668e0f.6a33d644-6a07-444c-a59c-6c4fa02553ed {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:53:58 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dadcc7e-f34e-4876-90d5-542db0af5c73]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6befb791-4f69-4ee4-9320-6aeab4a8b93a tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f.6a33d644-6a07-444c-a59c-6c4fa02553ed {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:58 devstack sudo[104338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f.6a33d644-6a07-444c-a59c-6c4fa02553ed Jul 10 06:53:58 devstack sudo[104338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:59 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-0874b17c-9a6e-4043-90eb-58d80e749e16 tempest-ProjectReaderTests-464505469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:53:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0874b17c-9a6e-4043-90eb-58d80e749e16 tempest-ProjectReaderTests-464505469 None] Flow 'volume_create_manager' (0fab4ce3-bf78-46b5-9207-500dc9d1649e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:53:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0874b17c-9a6e-4043-90eb-58d80e749e16 tempest-ProjectReaderTests-464505469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (601e4750-b88b-4037-be0c-8f13ce35b572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:59 devstack sudo[104338]: pam_unix(sudo:session): session closed for user root Jul 10 06:53:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6befb791-4f69-4ee4-9320-6aeab4a8b93a tempest-VolumesSnapshotNegativeTestJSON-776667731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f.6a33d644-6a07-444c-a59c-6c4fa02553ed" returned: 0 in 0.788s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:53:59 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-6befb791-4f69-4ee4-9320-6aeab4a8b93a tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e1df150-d197-4d38-99b2-3b044d668e0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:53:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0874b17c-9a6e-4043-90eb-58d80e749e16 tempest-ProjectReaderTests-464505469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (601e4750-b88b-4037-be0c-8f13ce35b572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-872398332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e7cd436-53ba-43d6-bd2d-9f0e20ae8c7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='360dc6c537484beab055c0406938f2df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:53:59Z,use_quota=True,user_id='11f431d2be3a4ec799602aaa86bc6d9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0874b17c-9a6e-4043-90eb-58d80e749e16 tempest-ProjectReaderTests-464505469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97cf6b2b-85e0-4286-95c1-75707bc9e658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0874b17c-9a6e-4043-90eb-58d80e749e16 tempest-ProjectReaderTests-464505469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97cf6b2b-85e0-4286-95c1-75707bc9e658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0874b17c-9a6e-4043-90eb-58d80e749e16 tempest-ProjectReaderTests-464505469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cae1cb2-71ee-419d-9b72-2b5d27dfe93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0874b17c-9a6e-4043-90eb-58d80e749e16 tempest-ProjectReaderTests-464505469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cae1cb2-71ee-419d-9b72-2b5d27dfe93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e7cd436-53ba-43d6-bd2d-9f0e20ae8c7b', 'volume_name': 'volume-7e7cd436-53ba-43d6-bd2d-9f0e20ae8c7b', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0874b17c-9a6e-4043-90eb-58d80e749e16 tempest-ProjectReaderTests-464505469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5521c3f-6449-48ba-b201-fd5ba477a7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0874b17c-9a6e-4043-90eb-58d80e749e16 tempest-ProjectReaderTests-464505469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5521c3f-6449-48ba-b201-fd5ba477a7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:53:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0874b17c-9a6e-4043-90eb-58d80e749e16 tempest-ProjectReaderTests-464505469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6534d8d7-40a8-483d-bc0f-9a6243f95c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:53:59 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-0874b17c-9a6e-4043-90eb-58d80e749e16 tempest-ProjectReaderTests-464505469 None] Volume 7e7cd436-53ba-43d6-bd2d-9f0e20ae8c7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e7cd436-53ba-43d6-bd2d-9f0e20ae8c7b', 'volume_size': 1} Jul 10 06:53:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-0874b17c-9a6e-4043-90eb-58d80e749e16 tempest-ProjectReaderTests-464505469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-0874b17c-9a6e-4043-90eb-58d80e749e16 tempest-ProjectReaderTests-464505469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:59 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-0874b17c-9a6e-4043-90eb-58d80e749e16 tempest-ProjectReaderTests-464505469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-872398332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e7cd436-53ba-43d6-bd2d-9f0e20ae8c7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='360dc6c537484beab055c0406938f2df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:53:59Z,use_quota=True,user_id='11f431d2be3a4ec799602aaa86bc6d9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:53:59 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-0874b17c-9a6e-4043-90eb-58d80e749e16 tempest-ProjectReaderTests-464505469 None] Creating volume 7e7cd436-53ba-43d6-bd2d-9f0e20ae8c7b {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:53:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-0874b17c-9a6e-4043-90eb-58d80e749e16 tempest-ProjectReaderTests-464505469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:53:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-0874b17c-9a6e-4043-90eb-58d80e749e16 tempest-ProjectReaderTests-464505469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:53:59 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-0874b17c-9a6e-4043-90eb-58d80e749e16 tempest-ProjectReaderTests-464505469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:53:59 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-0874b17c-9a6e-4043-90eb-58d80e749e16 tempest-ProjectReaderTests-464505469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:53:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-0874b17c-9a6e-4043-90eb-58d80e749e16 tempest-ProjectReaderTests-464505469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:53:59 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-0874b17c-9a6e-4043-90eb-58d80e749e16 tempest-ProjectReaderTests-464505469 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:53:59 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-0874b17c-9a6e-4043-90eb-58d80e749e16 tempest-ProjectReaderTests-464505469 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:53:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0874b17c-9a6e-4043-90eb-58d80e749e16 tempest-ProjectReaderTests-464505469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7e7cd436-53ba-43d6-bd2d-9f0e20ae8c7b 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:59 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6484e2-e379-496a-8035-591aab20ab3e]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:53:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6befb791-4f69-4ee4-9320-6aeab4a8b93a tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:53:59 devstack sudo[104345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7e7cd436-53ba-43d6-bd2d-9f0e20ae8c7b 1073741824 Jul 10 06:53:59 devstack sudo[104345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:53:59 devstack sudo[104346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f Jul 10 06:53:59 devstack sudo[104346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:00 devstack sudo[104346]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6befb791-4f69-4ee4-9320-6aeab4a8b93a tempest-VolumesSnapshotNegativeTestJSON-776667731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f" returned: 0 in 0.756s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6befb791-4f69-4ee4-9320-6aeab4a8b93a tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f.6a33d644-6a07-444c-a59c-6c4fa02553ed {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:00 devstack sudo[104345]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0874b17c-9a6e-4043-90eb-58d80e749e16 tempest-ProjectReaderTests-464505469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7e7cd436-53ba-43d6-bd2d-9f0e20ae8c7b 1073741824" returned: 0 in 0.791s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:00 devstack sudo[104356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f.6a33d644-6a07-444c-a59c-6c4fa02553ed Jul 10 06:54:00 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0874b17c-9a6e-4043-90eb-58d80e749e16 tempest-ProjectReaderTests-464505469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7e7cd436-53ba-43d6-bd2d-9f0e20ae8c7b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:00 devstack sudo[104358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7e7cd436-53ba-43d6-bd2d-9f0e20ae8c7b Jul 10 06:54:00 devstack sudo[104358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:00 devstack sudo[104358]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0874b17c-9a6e-4043-90eb-58d80e749e16 tempest-ProjectReaderTests-464505469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7e7cd436-53ba-43d6-bd2d-9f0e20ae8c7b" returned: 0 in 0.676s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:00 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-0874b17c-9a6e-4043-90eb-58d80e749e16 tempest-ProjectReaderTests-464505469 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:54:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-0874b17c-9a6e-4043-90eb-58d80e749e16 tempest-ProjectReaderTests-464505469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:54:00 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0874b17c-9a6e-4043-90eb-58d80e749e16 tempest-ProjectReaderTests-464505469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6534d8d7-40a8-483d-bc0f-9a6243f95c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e7cd436-53ba-43d6-bd2d-9f0e20ae8c7b', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:54:00 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:00 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0874b17c-9a6e-4043-90eb-58d80e749e16 tempest-ProjectReaderTests-464505469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54c84514-0821-493e-8c6e-f23001a58b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:54:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6befb791-4f69-4ee4-9320-6aeab4a8b93a tempest-VolumesSnapshotNegativeTestJSON-776667731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f.6a33d644-6a07-444c-a59c-6c4fa02553ed" returned: 0 in 0.777s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6befb791-4f69-4ee4-9320-6aeab4a8b93a tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f.6a33d644-6a07-444c-a59c-6c4fa02553ed {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:00 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-0874b17c-9a6e-4043-90eb-58d80e749e16 tempest-ProjectReaderTests-464505469 None] Volume volume-7e7cd436-53ba-43d6-bd2d-9f0e20ae8c7b (7e7cd436-53ba-43d6-bd2d-9f0e20ae8c7b): created successfully Jul 10 06:54:00 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0874b17c-9a6e-4043-90eb-58d80e749e16 tempest-ProjectReaderTests-464505469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54c84514-0821-493e-8c6e-f23001a58b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:54:00 devstack sudo[104364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f.6a33d644-6a07-444c-a59c-6c4fa02553ed Jul 10 06:54:00 devstack sudo[104364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:00 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0874b17c-9a6e-4043-90eb-58d80e749e16 tempest-ProjectReaderTests-464505469 None] Flow 'volume_create_manager' (0fab4ce3-bf78-46b5-9207-500dc9d1649e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:54:00 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-0874b17c-9a6e-4043-90eb-58d80e749e16 tempest-ProjectReaderTests-464505469 None] Created volume successfully. Jul 10 06:54:01 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a41484db-dee9-4f44-85a6-3387d55f33f7 tempest-ProjectReaderTests-464505469 None] Acquiring lock "cinder-7e7cd436-53ba-43d6-bd2d-9f0e20ae8c7b-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:54:01 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a41484db-dee9-4f44-85a6-3387d55f33f7 tempest-ProjectReaderTests-464505469 None] Lock "cinder-7e7cd436-53ba-43d6-bd2d-9f0e20ae8c7b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:54:01 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a41484db-dee9-4f44-85a6-3387d55f33f7 tempest-ProjectReaderTests-464505469 None] Acquiring lock "cinder-quobyte-7e7cd436-53ba-43d6-bd2d-9f0e20ae8c7b" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:54:01 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a41484db-dee9-4f44-85a6-3387d55f33f7 tempest-ProjectReaderTests-464505469 None] Lock "cinder-quobyte-7e7cd436-53ba-43d6-bd2d-9f0e20ae8c7b" acquired by "delete_volume" :: waited 0.017s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:54:01 devstack sudo[104364]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6befb791-4f69-4ee4-9320-6aeab4a8b93a tempest-VolumesSnapshotNegativeTestJSON-776667731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f.6a33d644-6a07-444c-a59c-6c4fa02553ed" returned: 0 in 0.677s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:01 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[90724fcf-53a5-4e1e-b9a8-a5c5d6015117]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:54:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a41484db-dee9-4f44-85a6-3387d55f33f7 tempest-ProjectReaderTests-464505469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7e7cd436-53ba-43d6-bd2d-9f0e20ae8c7b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:01 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6befb791-4f69-4ee4-9320-6aeab4a8b93a tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Lock "cinder-quobyte-6a33d644-6a07-444c-a59c-6c4fa02553ed" released by "_delete_snapshot" :: held 3.166s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:54:01 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6befb791-4f69-4ee4-9320-6aeab4a8b93a tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Lock "cinder-quobyte-4e1df150-d197-4d38-99b2-3b044d668e0f" released by "delete_snapshot" :: held 3.197s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:54:01 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-6befb791-4f69-4ee4-9320-6aeab4a8b93a tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Created reservations ['c87ccfe6-694a-49cb-8212-016178361639', '7173fb58-fe1c-460f-8f89-8e9ad1f1df8d', 'b14a9963-7348-46fe-ae8d-8348109e665e', '5f175ffe-8698-4568-bc82-46d70ff139aa'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:54:01 devstack sudo[104367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7e7cd436-53ba-43d6-bd2d-9f0e20ae8c7b Jul 10 06:54:01 devstack sudo[104367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:01 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-6befb791-4f69-4ee4-9320-6aeab4a8b93a tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Delete snapshot completed successfully. Jul 10 06:54:01 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6befb791-4f69-4ee4-9320-6aeab4a8b93a tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Lock "cinder-6a33d644-6a07-444c-a59c-6c4fa02553ed-delete_snapshot" released by "delete_snapshot" :: held 3.334s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:54:02 devstack sudo[104367]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a41484db-dee9-4f44-85a6-3387d55f33f7 tempest-ProjectReaderTests-464505469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7e7cd436-53ba-43d6-bd2d-9f0e20ae8c7b" returned: 0 in 0.739s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a41484db-dee9-4f44-85a6-3387d55f33f7 tempest-ProjectReaderTests-464505469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7e7cd436-53ba-43d6-bd2d-9f0e20ae8c7b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:02 devstack sudo[104372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7e7cd436-53ba-43d6-bd2d-9f0e20ae8c7b Jul 10 06:54:02 devstack sudo[104372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:02 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f7fab2f1-0c0c-4096-919d-10ee8e0e0ada tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Acquiring lock "cinder-4e1df150-d197-4d38-99b2-3b044d668e0f-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:54:02 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f7fab2f1-0c0c-4096-919d-10ee8e0e0ada tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Lock "cinder-4e1df150-d197-4d38-99b2-3b044d668e0f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:54:02 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f7fab2f1-0c0c-4096-919d-10ee8e0e0ada tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Acquiring lock "cinder-quobyte-4e1df150-d197-4d38-99b2-3b044d668e0f" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:54:02 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f7fab2f1-0c0c-4096-919d-10ee8e0e0ada tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Lock "cinder-quobyte-4e1df150-d197-4d38-99b2-3b044d668e0f" acquired by "delete_volume" :: waited 0.015s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:54:02 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8beac5-26aa-4263-a594-71f11eacb106]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:54:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f7fab2f1-0c0c-4096-919d-10ee8e0e0ada tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:02 devstack sudo[104374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f Jul 10 06:54:02 devstack sudo[104374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:02 devstack sudo[104372]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a41484db-dee9-4f44-85a6-3387d55f33f7 tempest-ProjectReaderTests-464505469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7e7cd436-53ba-43d6-bd2d-9f0e20ae8c7b" returned: 0 in 0.633s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:02 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a41484db-dee9-4f44-85a6-3387d55f33f7 tempest-ProjectReaderTests-464505469 None] Lock "cinder-quobyte-7e7cd436-53ba-43d6-bd2d-9f0e20ae8c7b" released by "delete_volume" :: held 1.432s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:54:03 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-a41484db-dee9-4f44-85a6-3387d55f33f7 tempest-ProjectReaderTests-464505469 None] Created reservations ['fd6520b7-37d2-42c9-874f-cf2ca4591f73', '2f49d7b0-1773-4e83-9f9d-6e2ce3ed1867', 'efca8181-6701-4eef-89c4-aac122955597', '447bbc0d-e15d-4793-90f2-cb4afaca00df'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:54:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a41484db-dee9-4f44-85a6-3387d55f33f7 tempest-ProjectReaderTests-464505469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:54:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a41484db-dee9-4f44-85a6-3387d55f33f7 tempest-ProjectReaderTests-464505469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:54:03 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-a41484db-dee9-4f44-85a6-3387d55f33f7 tempest-ProjectReaderTests-464505469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:54:03 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-a41484db-dee9-4f44-85a6-3387d55f33f7 tempest-ProjectReaderTests-464505469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:54:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a41484db-dee9-4f44-85a6-3387d55f33f7 tempest-ProjectReaderTests-464505469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:54:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a41484db-dee9-4f44-85a6-3387d55f33f7 tempest-ProjectReaderTests-464505469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:03 devstack sudo[104377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:54:03 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:03 devstack sudo[104374]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f7fab2f1-0c0c-4096-919d-10ee8e0e0ada tempest-VolumesSnapshotNegativeTestJSON-776667731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f" returned: 0 in 0.748s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f7fab2f1-0c0c-4096-919d-10ee8e0e0ada tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:03 devstack sudo[104382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f Jul 10 06:54:03 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:03 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a41484db-dee9-4f44-85a6-3387d55f33f7 tempest-ProjectReaderTests-464505469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.652s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:03 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-a41484db-dee9-4f44-85a6-3387d55f33f7 tempest-ProjectReaderTests-464505469 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:54:03 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-a41484db-dee9-4f44-85a6-3387d55f33f7 tempest-ProjectReaderTests-464505469 None] Deleted volume successfully. Jul 10 06:54:03 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a41484db-dee9-4f44-85a6-3387d55f33f7 tempest-ProjectReaderTests-464505469 None] Lock "cinder-7e7cd436-53ba-43d6-bd2d-9f0e20ae8c7b-delete_volume" released by "delete_volume" :: held 2.312s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:54:04 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-823d4d59-2ba7-4fcf-b8ed-0a1e3079ba70 tempest-ProjectReaderTests-464505469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:54:04 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-823d4d59-2ba7-4fcf-b8ed-0a1e3079ba70 tempest-ProjectReaderTests-464505469 None] Flow 'volume_create_manager' (2dc0ddcc-9304-48e9-9193-850ca70b1399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:54:04 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-823d4d59-2ba7-4fcf-b8ed-0a1e3079ba70 tempest-ProjectReaderTests-464505469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc15e730-f08a-47d8-8c57-7464754c819a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:54:04 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-823d4d59-2ba7-4fcf-b8ed-0a1e3079ba70 tempest-ProjectReaderTests-464505469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc15e730-f08a-47d8-8c57-7464754c819a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-964336381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1c57cb7-6755-4208-8692-2d313c1d6c54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='360dc6c537484beab055c0406938f2df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:54:04Z,use_quota=True,user_id='11f431d2be3a4ec799602aaa86bc6d9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:54:04 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-823d4d59-2ba7-4fcf-b8ed-0a1e3079ba70 tempest-ProjectReaderTests-464505469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (247b0730-5431-4139-80ac-4ccfe45ab016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:54:04 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-823d4d59-2ba7-4fcf-b8ed-0a1e3079ba70 tempest-ProjectReaderTests-464505469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (247b0730-5431-4139-80ac-4ccfe45ab016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:54:04 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-823d4d59-2ba7-4fcf-b8ed-0a1e3079ba70 tempest-ProjectReaderTests-464505469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76bcc03f-4fff-44e2-a466-c55ec97b74cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:54:04 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-823d4d59-2ba7-4fcf-b8ed-0a1e3079ba70 tempest-ProjectReaderTests-464505469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76bcc03f-4fff-44e2-a466-c55ec97b74cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1c57cb7-6755-4208-8692-2d313c1d6c54', 'volume_name': 'volume-c1c57cb7-6755-4208-8692-2d313c1d6c54', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:54:04 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:04 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-823d4d59-2ba7-4fcf-b8ed-0a1e3079ba70 tempest-ProjectReaderTests-464505469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcf3fc45-dfff-4bbe-879c-f6771650c8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:54:04 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-823d4d59-2ba7-4fcf-b8ed-0a1e3079ba70 tempest-ProjectReaderTests-464505469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcf3fc45-dfff-4bbe-879c-f6771650c8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:54:04 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-823d4d59-2ba7-4fcf-b8ed-0a1e3079ba70 tempest-ProjectReaderTests-464505469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28d45f51-b87a-4c95-8c86-b5c0b9a60433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:54:04 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-823d4d59-2ba7-4fcf-b8ed-0a1e3079ba70 tempest-ProjectReaderTests-464505469 None] Volume c1c57cb7-6755-4208-8692-2d313c1d6c54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1c57cb7-6755-4208-8692-2d313c1d6c54', 'volume_size': 1} Jul 10 06:54:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-823d4d59-2ba7-4fcf-b8ed-0a1e3079ba70 tempest-ProjectReaderTests-464505469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:54:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-823d4d59-2ba7-4fcf-b8ed-0a1e3079ba70 tempest-ProjectReaderTests-464505469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:54:04 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-823d4d59-2ba7-4fcf-b8ed-0a1e3079ba70 tempest-ProjectReaderTests-464505469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-964336381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1c57cb7-6755-4208-8692-2d313c1d6c54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='360dc6c537484beab055c0406938f2df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:54:04Z,use_quota=True,user_id='11f431d2be3a4ec799602aaa86bc6d9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:54:04 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-823d4d59-2ba7-4fcf-b8ed-0a1e3079ba70 tempest-ProjectReaderTests-464505469 None] Creating volume c1c57cb7-6755-4208-8692-2d313c1d6c54 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:54:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-823d4d59-2ba7-4fcf-b8ed-0a1e3079ba70 tempest-ProjectReaderTests-464505469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:54:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-823d4d59-2ba7-4fcf-b8ed-0a1e3079ba70 tempest-ProjectReaderTests-464505469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:54:04 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-823d4d59-2ba7-4fcf-b8ed-0a1e3079ba70 tempest-ProjectReaderTests-464505469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:54:04 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-823d4d59-2ba7-4fcf-b8ed-0a1e3079ba70 tempest-ProjectReaderTests-464505469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:54:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-823d4d59-2ba7-4fcf-b8ed-0a1e3079ba70 tempest-ProjectReaderTests-464505469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:54:04 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-823d4d59-2ba7-4fcf-b8ed-0a1e3079ba70 tempest-ProjectReaderTests-464505469 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:54:04 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-823d4d59-2ba7-4fcf-b8ed-0a1e3079ba70 tempest-ProjectReaderTests-464505469 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:54:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-823d4d59-2ba7-4fcf-b8ed-0a1e3079ba70 tempest-ProjectReaderTests-464505469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c1c57cb7-6755-4208-8692-2d313c1d6c54 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f7fab2f1-0c0c-4096-919d-10ee8e0e0ada tempest-VolumesSnapshotNegativeTestJSON-776667731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4e1df150-d197-4d38-99b2-3b044d668e0f" returned: 0 in 0.731s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:04 devstack sudo[104386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c1c57cb7-6755-4208-8692-2d313c1d6c54 1073741824 Jul 10 06:54:04 devstack sudo[104386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:04 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f7fab2f1-0c0c-4096-919d-10ee8e0e0ada tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Lock "cinder-quobyte-4e1df150-d197-4d38-99b2-3b044d668e0f" released by "delete_volume" :: held 1.553s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:54:04 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-f7fab2f1-0c0c-4096-919d-10ee8e0e0ada tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Created reservations ['8dc6d730-9289-428f-8b58-2219cbcb5370', '3c780844-86ac-4f53-a69d-764c626c59ed', '5cd5c50c-51a4-4781-9033-a74d5d2eb761', '7b6fc7bb-5fc8-412e-a9bd-6b0c829431bf'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:54:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f7fab2f1-0c0c-4096-919d-10ee8e0e0ada tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:54:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f7fab2f1-0c0c-4096-919d-10ee8e0e0ada tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:54:04 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f7fab2f1-0c0c-4096-919d-10ee8e0e0ada tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:54:04 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f7fab2f1-0c0c-4096-919d-10ee8e0e0ada tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:54:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f7fab2f1-0c0c-4096-919d-10ee8e0e0ada tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:54:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f7fab2f1-0c0c-4096-919d-10ee8e0e0ada tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:04 devstack sudo[104388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:54:04 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:05 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f7fab2f1-0c0c-4096-919d-10ee8e0e0ada tempest-VolumesSnapshotNegativeTestJSON-776667731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.673s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:05 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-f7fab2f1-0c0c-4096-919d-10ee8e0e0ada tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:54:05 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-f7fab2f1-0c0c-4096-919d-10ee8e0e0ada tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Deleted volume successfully. Jul 10 06:54:05 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f7fab2f1-0c0c-4096-919d-10ee8e0e0ada tempest-VolumesSnapshotNegativeTestJSON-776667731 None] Lock "cinder-4e1df150-d197-4d38-99b2-3b044d668e0f-delete_volume" released by "delete_volume" :: held 2.447s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:54:05 devstack sudo[104386]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-823d4d59-2ba7-4fcf-b8ed-0a1e3079ba70 tempest-ProjectReaderTests-464505469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c1c57cb7-6755-4208-8692-2d313c1d6c54 1073741824" returned: 0 in 0.887s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-823d4d59-2ba7-4fcf-b8ed-0a1e3079ba70 tempest-ProjectReaderTests-464505469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c1c57cb7-6755-4208-8692-2d313c1d6c54 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:05 devstack sudo[104394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c1c57cb7-6755-4208-8692-2d313c1d6c54 Jul 10 06:54:05 devstack sudo[104394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:05 devstack sudo[104394]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-823d4d59-2ba7-4fcf-b8ed-0a1e3079ba70 tempest-ProjectReaderTests-464505469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c1c57cb7-6755-4208-8692-2d313c1d6c54" returned: 0 in 0.658s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:05 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-823d4d59-2ba7-4fcf-b8ed-0a1e3079ba70 tempest-ProjectReaderTests-464505469 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:54:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-823d4d59-2ba7-4fcf-b8ed-0a1e3079ba70 tempest-ProjectReaderTests-464505469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:54:05 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-823d4d59-2ba7-4fcf-b8ed-0a1e3079ba70 tempest-ProjectReaderTests-464505469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28d45f51-b87a-4c95-8c86-b5c0b9a60433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1c57cb7-6755-4208-8692-2d313c1d6c54', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:54:05 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-823d4d59-2ba7-4fcf-b8ed-0a1e3079ba70 tempest-ProjectReaderTests-464505469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cdf8e07-1080-484b-af28-65aed2ad3749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:54:05 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-823d4d59-2ba7-4fcf-b8ed-0a1e3079ba70 tempest-ProjectReaderTests-464505469 None] Volume volume-c1c57cb7-6755-4208-8692-2d313c1d6c54 (c1c57cb7-6755-4208-8692-2d313c1d6c54): created successfully Jul 10 06:54:05 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-823d4d59-2ba7-4fcf-b8ed-0a1e3079ba70 tempest-ProjectReaderTests-464505469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cdf8e07-1080-484b-af28-65aed2ad3749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:54:05 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-823d4d59-2ba7-4fcf-b8ed-0a1e3079ba70 tempest-ProjectReaderTests-464505469 None] Flow 'volume_create_manager' (2dc0ddcc-9304-48e9-9193-850ca70b1399) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:54:05 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-823d4d59-2ba7-4fcf-b8ed-0a1e3079ba70 tempest-ProjectReaderTests-464505469 None] Created volume successfully. Jul 10 06:54:06 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7bf315e6-fbda-44fc-8a70-6bd55b44b9b3 tempest-ProjectReaderTests-464505469 None] Acquiring lock "cinder-c1c57cb7-6755-4208-8692-2d313c1d6c54-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:54:06 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7bf315e6-fbda-44fc-8a70-6bd55b44b9b3 tempest-ProjectReaderTests-464505469 None] Lock "cinder-c1c57cb7-6755-4208-8692-2d313c1d6c54-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:54:06 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7bf315e6-fbda-44fc-8a70-6bd55b44b9b3 tempest-ProjectReaderTests-464505469 None] Acquiring lock "cinder-quobyte-c1c57cb7-6755-4208-8692-2d313c1d6c54" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:54:06 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7bf315e6-fbda-44fc-8a70-6bd55b44b9b3 tempest-ProjectReaderTests-464505469 None] Lock "cinder-quobyte-c1c57cb7-6755-4208-8692-2d313c1d6c54" acquired by "delete_volume" :: waited 0.015s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:54:06 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c67b31f-be11-4707-b3b0-dd877ed38a79]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:54:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7bf315e6-fbda-44fc-8a70-6bd55b44b9b3 tempest-ProjectReaderTests-464505469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c1c57cb7-6755-4208-8692-2d313c1d6c54 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:06 devstack sudo[104398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c1c57cb7-6755-4208-8692-2d313c1d6c54 Jul 10 06:54:06 devstack sudo[104398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:07 devstack sudo[104398]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7bf315e6-fbda-44fc-8a70-6bd55b44b9b3 tempest-ProjectReaderTests-464505469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c1c57cb7-6755-4208-8692-2d313c1d6c54" returned: 0 in 0.772s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7bf315e6-fbda-44fc-8a70-6bd55b44b9b3 tempest-ProjectReaderTests-464505469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c1c57cb7-6755-4208-8692-2d313c1d6c54 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:07 devstack sudo[104403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c1c57cb7-6755-4208-8692-2d313c1d6c54 Jul 10 06:54:07 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:07 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7bf315e6-fbda-44fc-8a70-6bd55b44b9b3 tempest-ProjectReaderTests-464505469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c1c57cb7-6755-4208-8692-2d313c1d6c54" returned: 0 in 0.693s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:07 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7bf315e6-fbda-44fc-8a70-6bd55b44b9b3 tempest-ProjectReaderTests-464505469 None] Lock "cinder-quobyte-c1c57cb7-6755-4208-8692-2d313c1d6c54" released by "delete_volume" :: held 1.507s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:54:07 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-7bf315e6-fbda-44fc-8a70-6bd55b44b9b3 tempest-ProjectReaderTests-464505469 None] Created reservations ['579c61a0-86e5-45cb-8023-7504fd496c5d', 'fb91659a-1da7-4a49-8a7e-8c0467f8bbcb', '275077e7-bbcc-4ee7-9a73-863e53a4eb1b', '11df3dca-9c74-403a-be46-82798b483d90'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:54:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7bf315e6-fbda-44fc-8a70-6bd55b44b9b3 tempest-ProjectReaderTests-464505469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:54:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7bf315e6-fbda-44fc-8a70-6bd55b44b9b3 tempest-ProjectReaderTests-464505469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:54:08 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-7bf315e6-fbda-44fc-8a70-6bd55b44b9b3 tempest-ProjectReaderTests-464505469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:54:08 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-7bf315e6-fbda-44fc-8a70-6bd55b44b9b3 tempest-ProjectReaderTests-464505469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:54:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7bf315e6-fbda-44fc-8a70-6bd55b44b9b3 tempest-ProjectReaderTests-464505469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:54:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7bf315e6-fbda-44fc-8a70-6bd55b44b9b3 tempest-ProjectReaderTests-464505469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:08 devstack sudo[104408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:54:08 devstack sudo[104408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:08 devstack sudo[104408]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7bf315e6-fbda-44fc-8a70-6bd55b44b9b3 tempest-ProjectReaderTests-464505469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.706s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:08 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-7bf315e6-fbda-44fc-8a70-6bd55b44b9b3 tempest-ProjectReaderTests-464505469 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:54:08 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-7bf315e6-fbda-44fc-8a70-6bd55b44b9b3 tempest-ProjectReaderTests-464505469 None] Deleted volume successfully. Jul 10 06:54:08 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7bf315e6-fbda-44fc-8a70-6bd55b44b9b3 tempest-ProjectReaderTests-464505469 None] Lock "cinder-c1c57cb7-6755-4208-8692-2d313c1d6c54-delete_volume" released by "delete_volume" :: held 2.424s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:54:21 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:54:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:54:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:54:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:54:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:54:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:54:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:21 devstack sudo[104413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:54:21 devstack sudo[104413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:22 devstack sudo[104413]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.699s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:22 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:54:22 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager._thread_info {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:54:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread count: 28 {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:54:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread info: [<_MainThread(MainThread, started 139245706264704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:54:26 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:UPDATE=107,cinder:DELETE=14,cinder:INSERT=28,cinder:SELECT=71 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:54:26 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:UPDATE=122,cinder:SELECT=73,cinder:DELETE=6,cinder:INSERT=24 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:54:46 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-12569e6d-23d6-46fd-aea1-be86a03ddf14 tempest-TestMinimumBasicScenario-1104420283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:54:46 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-12569e6d-23d6-46fd-aea1-be86a03ddf14 tempest-TestMinimumBasicScenario-1104420283 None] Flow 'volume_create_manager' (8a440872-ccf7-4b25-b824-95183fa0267b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:54:46 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-12569e6d-23d6-46fd-aea1-be86a03ddf14 tempest-TestMinimumBasicScenario-1104420283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81062a5a-863f-48de-9761-78314cb0eb50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:54:46 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-12569e6d-23d6-46fd-aea1-be86a03ddf14 tempest-TestMinimumBasicScenario-1104420283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81062a5a-863f-48de-9761-78314cb0eb50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-916181307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ca93998-f467-4c75-8c84-ce982801938d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd82073b565649689130281b4f78060e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:54:46Z,use_quota=True,user_id='a3778fe70621487ca2c7b630c126084a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:54:46 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-12569e6d-23d6-46fd-aea1-be86a03ddf14 tempest-TestMinimumBasicScenario-1104420283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eba89c14-282c-47f5-9a29-cad59e2da0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:54:46 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-12569e6d-23d6-46fd-aea1-be86a03ddf14 tempest-TestMinimumBasicScenario-1104420283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eba89c14-282c-47f5-9a29-cad59e2da0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:54:46 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-12569e6d-23d6-46fd-aea1-be86a03ddf14 tempest-TestMinimumBasicScenario-1104420283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e894ac4-3f8d-452e-b68d-7899e40eb4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:54:46 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-12569e6d-23d6-46fd-aea1-be86a03ddf14 tempest-TestMinimumBasicScenario-1104420283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e894ac4-3f8d-452e-b68d-7899e40eb4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ca93998-f467-4c75-8c84-ce982801938d', 'volume_name': 'volume-7ca93998-f467-4c75-8c84-ce982801938d', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:54:46 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-12569e6d-23d6-46fd-aea1-be86a03ddf14 tempest-TestMinimumBasicScenario-1104420283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1edf46a-e079-462c-a9f3-8f40c9093086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:54:46 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-12569e6d-23d6-46fd-aea1-be86a03ddf14 tempest-TestMinimumBasicScenario-1104420283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1edf46a-e079-462c-a9f3-8f40c9093086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:54:46 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-12569e6d-23d6-46fd-aea1-be86a03ddf14 tempest-TestMinimumBasicScenario-1104420283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4bc1691-6c6f-429a-aa6e-18672e7163f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:54:46 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-12569e6d-23d6-46fd-aea1-be86a03ddf14 tempest-TestMinimumBasicScenario-1104420283 None] Volume 7ca93998-f467-4c75-8c84-ce982801938d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ca93998-f467-4c75-8c84-ce982801938d', 'volume_size': 1} Jul 10 06:54:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-12569e6d-23d6-46fd-aea1-be86a03ddf14 tempest-TestMinimumBasicScenario-1104420283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:54:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-12569e6d-23d6-46fd-aea1-be86a03ddf14 tempest-TestMinimumBasicScenario-1104420283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:54:46 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-12569e6d-23d6-46fd-aea1-be86a03ddf14 tempest-TestMinimumBasicScenario-1104420283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-916181307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ca93998-f467-4c75-8c84-ce982801938d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd82073b565649689130281b4f78060e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:54:46Z,use_quota=True,user_id='a3778fe70621487ca2c7b630c126084a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:54:46 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-12569e6d-23d6-46fd-aea1-be86a03ddf14 tempest-TestMinimumBasicScenario-1104420283 None] Creating volume 7ca93998-f467-4c75-8c84-ce982801938d {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:54:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-12569e6d-23d6-46fd-aea1-be86a03ddf14 tempest-TestMinimumBasicScenario-1104420283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:54:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-12569e6d-23d6-46fd-aea1-be86a03ddf14 tempest-TestMinimumBasicScenario-1104420283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:54:46 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-12569e6d-23d6-46fd-aea1-be86a03ddf14 tempest-TestMinimumBasicScenario-1104420283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:54:46 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-12569e6d-23d6-46fd-aea1-be86a03ddf14 tempest-TestMinimumBasicScenario-1104420283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:54:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-12569e6d-23d6-46fd-aea1-be86a03ddf14 tempest-TestMinimumBasicScenario-1104420283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:54:46 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-12569e6d-23d6-46fd-aea1-be86a03ddf14 tempest-TestMinimumBasicScenario-1104420283 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:54:46 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-12569e6d-23d6-46fd-aea1-be86a03ddf14 tempest-TestMinimumBasicScenario-1104420283 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:54:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-12569e6d-23d6-46fd-aea1-be86a03ddf14 tempest-TestMinimumBasicScenario-1104420283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ca93998-f467-4c75-8c84-ce982801938d 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:46 devstack sudo[104572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ca93998-f467-4c75-8c84-ce982801938d 1073741824 Jul 10 06:54:46 devstack sudo[104572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:47 devstack sudo[104572]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-12569e6d-23d6-46fd-aea1-be86a03ddf14 tempest-TestMinimumBasicScenario-1104420283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ca93998-f467-4c75-8c84-ce982801938d 1073741824" returned: 0 in 0.816s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-12569e6d-23d6-46fd-aea1-be86a03ddf14 tempest-TestMinimumBasicScenario-1104420283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ca93998-f467-4c75-8c84-ce982801938d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:47 devstack sudo[104577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ca93998-f467-4c75-8c84-ce982801938d Jul 10 06:54:47 devstack sudo[104577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:47 devstack sudo[104577]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-12569e6d-23d6-46fd-aea1-be86a03ddf14 tempest-TestMinimumBasicScenario-1104420283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ca93998-f467-4c75-8c84-ce982801938d" returned: 0 in 0.619s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:47 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-12569e6d-23d6-46fd-aea1-be86a03ddf14 tempest-TestMinimumBasicScenario-1104420283 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:54:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-12569e6d-23d6-46fd-aea1-be86a03ddf14 tempest-TestMinimumBasicScenario-1104420283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:54:47 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-12569e6d-23d6-46fd-aea1-be86a03ddf14 tempest-TestMinimumBasicScenario-1104420283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4bc1691-6c6f-429a-aa6e-18672e7163f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ca93998-f467-4c75-8c84-ce982801938d', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:54:47 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-12569e6d-23d6-46fd-aea1-be86a03ddf14 tempest-TestMinimumBasicScenario-1104420283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31dd8662-d7d7-49dd-a828-10d7784c496c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:54:47 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-12569e6d-23d6-46fd-aea1-be86a03ddf14 tempest-TestMinimumBasicScenario-1104420283 None] Volume volume-7ca93998-f467-4c75-8c84-ce982801938d (7ca93998-f467-4c75-8c84-ce982801938d): created successfully Jul 10 06:54:47 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-12569e6d-23d6-46fd-aea1-be86a03ddf14 tempest-TestMinimumBasicScenario-1104420283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31dd8662-d7d7-49dd-a828-10d7784c496c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:54:47 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-12569e6d-23d6-46fd-aea1-be86a03ddf14 tempest-TestMinimumBasicScenario-1104420283 None] Flow 'volume_create_manager' (8a440872-ccf7-4b25-b824-95183fa0267b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:54:47 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-12569e6d-23d6-46fd-aea1-be86a03ddf14 tempest-TestMinimumBasicScenario-1104420283 None] Created volume successfully. Jul 10 06:54:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-3c57ed59-0aff-4994-8ced-b58c48516e52 req-ea1035ad-6a2e-4a8a-be8e-f4b265c6295e tempest-TestMinimumBasicScenario-1104420283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:54:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-3c57ed59-0aff-4994-8ced-b58c48516e52 req-ea1035ad-6a2e-4a8a-be8e-f4b265c6295e tempest-TestMinimumBasicScenario-1104420283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:54:51 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfdbd495-d8c8-40a4-b1a4-648afe186ce3]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:54:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-3c57ed59-0aff-4994-8ced-b58c48516e52 req-ea1035ad-6a2e-4a8a-be8e-f4b265c6295e tempest-TestMinimumBasicScenario-1104420283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ca93998-f467-4c75-8c84-ce982801938d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:54:51 devstack sudo[104592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ca93998-f467-4c75-8c84-ce982801938d Jul 10 06:54:51 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:54:52 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root Jul 10 06:54:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [req-3c57ed59-0aff-4994-8ced-b58c48516e52 req-ea1035ad-6a2e-4a8a-be8e-f4b265c6295e tempest-TestMinimumBasicScenario-1104420283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ca93998-f467-4c75-8c84-ce982801938d" returned: 0 in 0.761s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:54:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [req-3c57ed59-0aff-4994-8ced-b58c48516e52 req-ea1035ad-6a2e-4a8a-be8e-f4b265c6295e tempest-TestMinimumBasicScenario-1104420283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.780s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:54:52 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-3c57ed59-0aff-4994-8ced-b58c48516e52 req-ea1035ad-6a2e-4a8a-be8e-f4b265c6295e tempest-TestMinimumBasicScenario-1104420283 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804', 'name': 'volume-7ca93998-f467-4c75-8c84-ce982801938d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0ade8471-7ad8-418e-bf00-03c8044cc9cd', 'enforce_multipath': True} {{(pid=87294) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 06:54:52 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-3c57ed59-0aff-4994-8ced-b58c48516e52 req-ea1035ad-6a2e-4a8a-be8e-f4b265c6295e tempest-TestMinimumBasicScenario-1104420283 None] attachment_update completed successfully. Jul 10 06:55:02 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:SELECT=6,cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:55:02 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:SELECT=9,cinder:UPDATE=5 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:55:21 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:55:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:55:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:55:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:55:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:55:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:55:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:21 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:55:21 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:22 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.625s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:22 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:55:22 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager._thread_info {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:55:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread count: 28 {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:55:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread info: [<_MainThread(MainThread, started 139245706264704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:55:38 devstack cinder-volume[87294]: INFO cinder.volume.manager [req-5bd701fa-1815-4d12-9885-372656ad367d req-e76880eb-03ca-4f9b-9e87-d1c545309947 tempest-TestMinimumBasicScenario-1104420283 None] Terminate volume connection completed successfully. Jul 10 06:55:38 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [req-5bd701fa-1815-4d12-9885-372656ad367d req-e76880eb-03ca-4f9b-9e87-d1c545309947 tempest-TestMinimumBasicScenario-1104420283 None] Deleting attachment 0ade8471-7ad8-418e-bf00-03c8044cc9cd. {{(pid=87294) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 06:55:40 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6b5cdacd-d256-483f-9e82-91e71eb131b8 tempest-TestMinimumBasicScenario-1104420283 None] Acquiring lock "cinder-7ca93998-f467-4c75-8c84-ce982801938d-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:55:40 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6b5cdacd-d256-483f-9e82-91e71eb131b8 tempest-TestMinimumBasicScenario-1104420283 None] Lock "cinder-7ca93998-f467-4c75-8c84-ce982801938d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:55:40 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6b5cdacd-d256-483f-9e82-91e71eb131b8 tempest-TestMinimumBasicScenario-1104420283 None] Acquiring lock "cinder-quobyte-7ca93998-f467-4c75-8c84-ce982801938d" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:55:40 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6b5cdacd-d256-483f-9e82-91e71eb131b8 tempest-TestMinimumBasicScenario-1104420283 None] Lock "cinder-quobyte-7ca93998-f467-4c75-8c84-ce982801938d" acquired by "delete_volume" :: waited 0.015s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:55:40 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1d4ac7-63a1-4171-aeb8-c11479601413]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:55:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6b5cdacd-d256-483f-9e82-91e71eb131b8 tempest-TestMinimumBasicScenario-1104420283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ca93998-f467-4c75-8c84-ce982801938d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:40 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ca93998-f467-4c75-8c84-ce982801938d Jul 10 06:55:40 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:41 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6b5cdacd-d256-483f-9e82-91e71eb131b8 tempest-TestMinimumBasicScenario-1104420283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ca93998-f467-4c75-8c84-ce982801938d" returned: 0 in 0.772s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6b5cdacd-d256-483f-9e82-91e71eb131b8 tempest-TestMinimumBasicScenario-1104420283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ca93998-f467-4c75-8c84-ce982801938d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:41 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ca93998-f467-4c75-8c84-ce982801938d Jul 10 06:55:41 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:42 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6b5cdacd-d256-483f-9e82-91e71eb131b8 tempest-TestMinimumBasicScenario-1104420283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7ca93998-f467-4c75-8c84-ce982801938d" returned: 0 in 0.644s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6b5cdacd-d256-483f-9e82-91e71eb131b8 tempest-TestMinimumBasicScenario-1104420283 None] Lock "cinder-quobyte-7ca93998-f467-4c75-8c84-ce982801938d" released by "delete_volume" :: held 1.453s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:55:42 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-6b5cdacd-d256-483f-9e82-91e71eb131b8 tempest-TestMinimumBasicScenario-1104420283 None] Created reservations ['bb3ba0be-da73-45bb-a4f2-6d19d69a7453', '0230bbab-0fdd-4f62-b401-bd2c53d543fc', 'b2331be9-2859-4c18-9e78-0e878f2fd936', 'ce4d9045-90e7-4e75-bc81-07061e7b97e8'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:55:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-6b5cdacd-d256-483f-9e82-91e71eb131b8 tempest-TestMinimumBasicScenario-1104420283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:55:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-6b5cdacd-d256-483f-9e82-91e71eb131b8 tempest-TestMinimumBasicScenario-1104420283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:55:42 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-6b5cdacd-d256-483f-9e82-91e71eb131b8 tempest-TestMinimumBasicScenario-1104420283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:55:42 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-6b5cdacd-d256-483f-9e82-91e71eb131b8 tempest-TestMinimumBasicScenario-1104420283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:55:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-6b5cdacd-d256-483f-9e82-91e71eb131b8 tempest-TestMinimumBasicScenario-1104420283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:55:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6b5cdacd-d256-483f-9e82-91e71eb131b8 tempest-TestMinimumBasicScenario-1104420283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:42 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:55:42 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:55:42 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Jul 10 06:55:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6b5cdacd-d256-483f-9e82-91e71eb131b8 tempest-TestMinimumBasicScenario-1104420283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.659s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:55:42 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-6b5cdacd-d256-483f-9e82-91e71eb131b8 tempest-TestMinimumBasicScenario-1104420283 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:55:42 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-6b5cdacd-d256-483f-9e82-91e71eb131b8 tempest-TestMinimumBasicScenario-1104420283 None] Deleted volume successfully. Jul 10 06:55:43 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6b5cdacd-d256-483f-9e82-91e71eb131b8 tempest-TestMinimumBasicScenario-1104420283 None] Lock "cinder-7ca93998-f467-4c75-8c84-ce982801938d-delete_volume" released by "delete_volume" :: held 2.314s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:55:52 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=6 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:55:52 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:SELECT=6,cinder:UPDATE=10,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:55:59 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-88b3f39a-1441-43ed-a4ab-dc00719607a0 tempest-CinderUnicodeTest-267222635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:55:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-88b3f39a-1441-43ed-a4ab-dc00719607a0 tempest-CinderUnicodeTest-267222635 None] Flow 'volume_create_manager' (2b8ac3f7-e620-4d7a-a114-37b4e639ab92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:55:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-88b3f39a-1441-43ed-a4ab-dc00719607a0 tempest-CinderUnicodeTest-267222635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12646ffb-e32a-4aa0-ba39-3a670b0e15ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:55:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-88b3f39a-1441-43ed-a4ab-dc00719607a0 tempest-CinderUnicodeTest-267222635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12646ffb-e32a-4aa0-ba39-3a670b0e15ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:56:00Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f968ef5-563c-4f55-9dbe-e3ac0078e231,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb00fce408b14e13aa042800f773d942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:56:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:56:00Z,use_quota=True,user_id='5ac599d18702447bb39a68f71af3bf4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:55:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-88b3f39a-1441-43ed-a4ab-dc00719607a0 tempest-CinderUnicodeTest-267222635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1520b4e1-db51-46b5-bf4d-62dbd3f4fbde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:55:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-88b3f39a-1441-43ed-a4ab-dc00719607a0 tempest-CinderUnicodeTest-267222635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1520b4e1-db51-46b5-bf4d-62dbd3f4fbde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:55:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-88b3f39a-1441-43ed-a4ab-dc00719607a0 tempest-CinderUnicodeTest-267222635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b079f294-0146-4f78-8ab9-7347c12dd4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:55:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-88b3f39a-1441-43ed-a4ab-dc00719607a0 tempest-CinderUnicodeTest-267222635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b079f294-0146-4f78-8ab9-7347c12dd4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f968ef5-563c-4f55-9dbe-e3ac0078e231', 'volume_name': 'volume-5f968ef5-563c-4f55-9dbe-e3ac0078e231', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:55:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-88b3f39a-1441-43ed-a4ab-dc00719607a0 tempest-CinderUnicodeTest-267222635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4ff397f-782a-4f9e-bfbd-b5319e6a8388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:55:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-88b3f39a-1441-43ed-a4ab-dc00719607a0 tempest-CinderUnicodeTest-267222635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4ff397f-782a-4f9e-bfbd-b5319e6a8388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:55:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-88b3f39a-1441-43ed-a4ab-dc00719607a0 tempest-CinderUnicodeTest-267222635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60ad2b06-b37d-4c34-8ec4-e70ca264d374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:55:59 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-88b3f39a-1441-43ed-a4ab-dc00719607a0 tempest-CinderUnicodeTest-267222635 None] Volume 5f968ef5-563c-4f55-9dbe-e3ac0078e231: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f968ef5-563c-4f55-9dbe-e3ac0078e231', 'volume_size': 1} Jul 10 06:55:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-88b3f39a-1441-43ed-a4ab-dc00719607a0 tempest-CinderUnicodeTest-267222635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:55:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-88b3f39a-1441-43ed-a4ab-dc00719607a0 tempest-CinderUnicodeTest-267222635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:55:59 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-88b3f39a-1441-43ed-a4ab-dc00719607a0 tempest-CinderUnicodeTest-267222635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:56:00Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f968ef5-563c-4f55-9dbe-e3ac0078e231,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb00fce408b14e13aa042800f773d942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:56:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:56:00Z,use_quota=True,user_id='5ac599d18702447bb39a68f71af3bf4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:55:59 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-88b3f39a-1441-43ed-a4ab-dc00719607a0 tempest-CinderUnicodeTest-267222635 None] Creating volume 5f968ef5-563c-4f55-9dbe-e3ac0078e231 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:55:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-88b3f39a-1441-43ed-a4ab-dc00719607a0 tempest-CinderUnicodeTest-267222635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:55:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-88b3f39a-1441-43ed-a4ab-dc00719607a0 tempest-CinderUnicodeTest-267222635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:55:59 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-88b3f39a-1441-43ed-a4ab-dc00719607a0 tempest-CinderUnicodeTest-267222635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:55:59 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-88b3f39a-1441-43ed-a4ab-dc00719607a0 tempest-CinderUnicodeTest-267222635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:55:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-88b3f39a-1441-43ed-a4ab-dc00719607a0 tempest-CinderUnicodeTest-267222635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:55:59 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-88b3f39a-1441-43ed-a4ab-dc00719607a0 tempest-CinderUnicodeTest-267222635 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:55:59 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-88b3f39a-1441-43ed-a4ab-dc00719607a0 tempest-CinderUnicodeTest-267222635 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:55:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-88b3f39a-1441-43ed-a4ab-dc00719607a0 tempest-CinderUnicodeTest-267222635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-5f968ef5-563c-4f55-9dbe-e3ac0078e231 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:55:59 devstack sudo[105611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-5f968ef5-563c-4f55-9dbe-e3ac0078e231 1073741824 Jul 10 06:55:59 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:00 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-88b3f39a-1441-43ed-a4ab-dc00719607a0 tempest-CinderUnicodeTest-267222635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-5f968ef5-563c-4f55-9dbe-e3ac0078e231 1073741824" returned: 0 in 0.789s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-88b3f39a-1441-43ed-a4ab-dc00719607a0 tempest-CinderUnicodeTest-267222635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-5f968ef5-563c-4f55-9dbe-e3ac0078e231 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:00 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-5f968ef5-563c-4f55-9dbe-e3ac0078e231 Jul 10 06:56:00 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:01 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-88b3f39a-1441-43ed-a4ab-dc00719607a0 tempest-CinderUnicodeTest-267222635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-5f968ef5-563c-4f55-9dbe-e3ac0078e231" returned: 0 in 0.642s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:01 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-88b3f39a-1441-43ed-a4ab-dc00719607a0 tempest-CinderUnicodeTest-267222635 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:56:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-88b3f39a-1441-43ed-a4ab-dc00719607a0 tempest-CinderUnicodeTest-267222635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:56:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-88b3f39a-1441-43ed-a4ab-dc00719607a0 tempest-CinderUnicodeTest-267222635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60ad2b06-b37d-4c34-8ec4-e70ca264d374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f968ef5-563c-4f55-9dbe-e3ac0078e231', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-88b3f39a-1441-43ed-a4ab-dc00719607a0 tempest-CinderUnicodeTest-267222635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d28eb97f-4113-4627-8711-4e89fc4aaa61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:01 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-88b3f39a-1441-43ed-a4ab-dc00719607a0 tempest-CinderUnicodeTest-267222635 None] Volume volume-5f968ef5-563c-4f55-9dbe-e3ac0078e231 (5f968ef5-563c-4f55-9dbe-e3ac0078e231): created successfully Jul 10 06:56:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-88b3f39a-1441-43ed-a4ab-dc00719607a0 tempest-CinderUnicodeTest-267222635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d28eb97f-4113-4627-8711-4e89fc4aaa61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-88b3f39a-1441-43ed-a4ab-dc00719607a0 tempest-CinderUnicodeTest-267222635 None] Flow 'volume_create_manager' (2b8ac3f7-e620-4d7a-a114-37b4e639ab92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:56:01 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-88b3f39a-1441-43ed-a4ab-dc00719607a0 tempest-CinderUnicodeTest-267222635 None] Created volume successfully. Jul 10 06:56:02 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5b4b2b2-fa02-4b86-8d8d-d4e84dd22c36 tempest-CinderUnicodeTest-267222635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:56:02 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d5b4b2b2-fa02-4b86-8d8d-d4e84dd22c36 tempest-CinderUnicodeTest-267222635 None] Flow 'volume_create_manager' (7df0f07c-ba0c-4082-bf92-cfad59364f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:56:02 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d5b4b2b2-fa02-4b86-8d8d-d4e84dd22c36 tempest-CinderUnicodeTest-267222635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adac9a85-59ed-4676-aad4-7057e14a76cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:02 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d5b4b2b2-fa02-4b86-8d8d-d4e84dd22c36 tempest-CinderUnicodeTest-267222635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adac9a85-59ed-4676-aad4-7057e14a76cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:56:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-462009654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61c69cb0-c82e-463d-a27b-8971d3cb9875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb00fce408b14e13aa042800f773d942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:56:02Z,use_quota=True,user_id='5ac599d18702447bb39a68f71af3bf4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:02 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d5b4b2b2-fa02-4b86-8d8d-d4e84dd22c36 tempest-CinderUnicodeTest-267222635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff075b94-d56a-4a25-abd0-424adcd3954b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:02 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d5b4b2b2-fa02-4b86-8d8d-d4e84dd22c36 tempest-CinderUnicodeTest-267222635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff075b94-d56a-4a25-abd0-424adcd3954b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:02 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d5b4b2b2-fa02-4b86-8d8d-d4e84dd22c36 tempest-CinderUnicodeTest-267222635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (621b53aa-1ab3-4750-bf2f-466c078185ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:02 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d5b4b2b2-fa02-4b86-8d8d-d4e84dd22c36 tempest-CinderUnicodeTest-267222635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (621b53aa-1ab3-4750-bf2f-466c078185ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61c69cb0-c82e-463d-a27b-8971d3cb9875', 'volume_name': 'volume-61c69cb0-c82e-463d-a27b-8971d3cb9875', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:02 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d5b4b2b2-fa02-4b86-8d8d-d4e84dd22c36 tempest-CinderUnicodeTest-267222635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f77692a5-b95d-4fcb-8a68-bac489f76e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:02 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d5b4b2b2-fa02-4b86-8d8d-d4e84dd22c36 tempest-CinderUnicodeTest-267222635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f77692a5-b95d-4fcb-8a68-bac489f76e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:02 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d5b4b2b2-fa02-4b86-8d8d-d4e84dd22c36 tempest-CinderUnicodeTest-267222635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f29bc61-acd4-4f77-9618-c82560310091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:02 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-d5b4b2b2-fa02-4b86-8d8d-d4e84dd22c36 tempest-CinderUnicodeTest-267222635 None] Volume 61c69cb0-c82e-463d-a27b-8971d3cb9875: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61c69cb0-c82e-463d-a27b-8971d3cb9875', 'volume_size': 1} Jul 10 06:56:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d5b4b2b2-fa02-4b86-8d8d-d4e84dd22c36 tempest-CinderUnicodeTest-267222635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:56:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d5b4b2b2-fa02-4b86-8d8d-d4e84dd22c36 tempest-CinderUnicodeTest-267222635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:56:02 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-d5b4b2b2-fa02-4b86-8d8d-d4e84dd22c36 tempest-CinderUnicodeTest-267222635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:56:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-462009654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61c69cb0-c82e-463d-a27b-8971d3cb9875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb00fce408b14e13aa042800f773d942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:56:02Z,use_quota=True,user_id='5ac599d18702447bb39a68f71af3bf4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:56:02 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-d5b4b2b2-fa02-4b86-8d8d-d4e84dd22c36 tempest-CinderUnicodeTest-267222635 None] Creating volume 61c69cb0-c82e-463d-a27b-8971d3cb9875 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:56:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d5b4b2b2-fa02-4b86-8d8d-d4e84dd22c36 tempest-CinderUnicodeTest-267222635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:56:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d5b4b2b2-fa02-4b86-8d8d-d4e84dd22c36 tempest-CinderUnicodeTest-267222635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:56:02 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-d5b4b2b2-fa02-4b86-8d8d-d4e84dd22c36 tempest-CinderUnicodeTest-267222635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:56:02 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-d5b4b2b2-fa02-4b86-8d8d-d4e84dd22c36 tempest-CinderUnicodeTest-267222635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:56:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d5b4b2b2-fa02-4b86-8d8d-d4e84dd22c36 tempest-CinderUnicodeTest-267222635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:56:02 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-d5b4b2b2-fa02-4b86-8d8d-d4e84dd22c36 tempest-CinderUnicodeTest-267222635 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:56:02 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-d5b4b2b2-fa02-4b86-8d8d-d4e84dd22c36 tempest-CinderUnicodeTest-267222635 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:56:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d5b4b2b2-fa02-4b86-8d8d-d4e84dd22c36 tempest-CinderUnicodeTest-267222635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:02 devstack sudo[105621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875 1073741824 Jul 10 06:56:02 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:03 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d5b4b2b2-fa02-4b86-8d8d-d4e84dd22c36 tempest-CinderUnicodeTest-267222635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875 1073741824" returned: 0 in 0.784s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d5b4b2b2-fa02-4b86-8d8d-d4e84dd22c36 tempest-CinderUnicodeTest-267222635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:03 devstack sudo[105627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875 Jul 10 06:56:03 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:03 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d5b4b2b2-fa02-4b86-8d8d-d4e84dd22c36 tempest-CinderUnicodeTest-267222635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875" returned: 0 in 0.609s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:03 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-d5b4b2b2-fa02-4b86-8d8d-d4e84dd22c36 tempest-CinderUnicodeTest-267222635 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:56:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d5b4b2b2-fa02-4b86-8d8d-d4e84dd22c36 tempest-CinderUnicodeTest-267222635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.433s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:56:03 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d5b4b2b2-fa02-4b86-8d8d-d4e84dd22c36 tempest-CinderUnicodeTest-267222635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f29bc61-acd4-4f77-9618-c82560310091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61c69cb0-c82e-463d-a27b-8971d3cb9875', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:03 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d5b4b2b2-fa02-4b86-8d8d-d4e84dd22c36 tempest-CinderUnicodeTest-267222635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c083a1a6-500d-430c-b3cd-bb60f9b39b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:03 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-d5b4b2b2-fa02-4b86-8d8d-d4e84dd22c36 tempest-CinderUnicodeTest-267222635 None] Volume volume-61c69cb0-c82e-463d-a27b-8971d3cb9875 (61c69cb0-c82e-463d-a27b-8971d3cb9875): created successfully Jul 10 06:56:03 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d5b4b2b2-fa02-4b86-8d8d-d4e84dd22c36 tempest-CinderUnicodeTest-267222635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c083a1a6-500d-430c-b3cd-bb60f9b39b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:03 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d5b4b2b2-fa02-4b86-8d8d-d4e84dd22c36 tempest-CinderUnicodeTest-267222635 None] Flow 'volume_create_manager' (7df0f07c-ba0c-4082-bf92-cfad59364f42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:56:03 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-d5b4b2b2-fa02-4b86-8d8d-d4e84dd22c36 tempest-CinderUnicodeTest-267222635 None] Created volume successfully. Jul 10 06:56:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d0b0ecf4-f079-498f-a669-f8cd7b2093dd tempest-CinderUnicodeTest-267222635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:56:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d0b0ecf4-f079-498f-a669-f8cd7b2093dd tempest-CinderUnicodeTest-267222635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:56:04 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-d0b0ecf4-f079-498f-a669-f8cd7b2093dd tempest-CinderUnicodeTest-267222635 None] Creating offline snapshot 73209470-b62d-4d4a-901d-ed7a7a9208e6 of volume 61c69cb0-c82e-463d-a27b-8971d3cb9875 {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:56:04 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c3f743-f1ae-40be-addf-6bb3c3820e8f]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:56:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d0b0ecf4-f079-498f-a669-f8cd7b2093dd tempest-CinderUnicodeTest-267222635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:04 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875 Jul 10 06:56:04 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:05 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d0b0ecf4-f079-498f-a669-f8cd7b2093dd tempest-CinderUnicodeTest-267222635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875" returned: 0 in 0.806s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d0b0ecf4-f079-498f-a669-f8cd7b2093dd tempest-CinderUnicodeTest-267222635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875.73209470-b62d-4d4a-901d-ed7a7a9208e6 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:05 devstack sudo[105635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875.73209470-b62d-4d4a-901d-ed7a7a9208e6 1G Jul 10 06:56:05 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:06 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d0b0ecf4-f079-498f-a669-f8cd7b2093dd tempest-CinderUnicodeTest-267222635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875.73209470-b62d-4d4a-901d-ed7a7a9208e6 1G" returned: 0 in 0.754s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d0b0ecf4-f079-498f-a669-f8cd7b2093dd tempest-CinderUnicodeTest-267222635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61c69cb0-c82e-463d-a27b-8971d3cb9875 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875.73209470-b62d-4d4a-901d-ed7a7a9208e6 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:06 devstack sudo[105640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61c69cb0-c82e-463d-a27b-8971d3cb9875 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875.73209470-b62d-4d4a-901d-ed7a7a9208e6 Jul 10 06:56:06 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:06 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d0b0ecf4-f079-498f-a669-f8cd7b2093dd tempest-CinderUnicodeTest-267222635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61c69cb0-c82e-463d-a27b-8971d3cb9875 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875.73209470-b62d-4d4a-901d-ed7a7a9208e6" returned: 0 in 0.665s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:06 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-d0b0ecf4-f079-498f-a669-f8cd7b2093dd tempest-CinderUnicodeTest-267222635 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875.73209470-b62d-4d4a-901d-ed7a7a9208e6 is being set with open permissions: ugo+rw Jul 10 06:56:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d0b0ecf4-f079-498f-a669-f8cd7b2093dd tempest-CinderUnicodeTest-267222635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875.73209470-b62d-4d4a-901d-ed7a7a9208e6 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:06 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875.73209470-b62d-4d4a-901d-ed7a7a9208e6 Jul 10 06:56:06 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:07 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d0b0ecf4-f079-498f-a669-f8cd7b2093dd tempest-CinderUnicodeTest-267222635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875.73209470-b62d-4d4a-901d-ed7a7a9208e6" returned: 0 in 0.609s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d0b0ecf4-f079-498f-a669-f8cd7b2093dd tempest-CinderUnicodeTest-267222635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:07 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875.info Jul 10 06:56:07 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:08 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d0b0ecf4-f079-498f-a669-f8cd7b2093dd tempest-CinderUnicodeTest-267222635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875.info" returned: 0 in 0.622s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:08 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-d0b0ecf4-f079-498f-a669-f8cd7b2093dd tempest-CinderUnicodeTest-267222635 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875.info is being set with open permissions: ugo+rw Jul 10 06:56:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d0b0ecf4-f079-498f-a669-f8cd7b2093dd tempest-CinderUnicodeTest-267222635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:08 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875.info Jul 10 06:56:08 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:08 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d0b0ecf4-f079-498f-a669-f8cd7b2093dd tempest-CinderUnicodeTest-267222635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875.info" returned: 0 in 0.623s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d0b0ecf4-f079-498f-a669-f8cd7b2093dd tempest-CinderUnicodeTest-267222635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.161s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:56:08 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-d0b0ecf4-f079-498f-a669-f8cd7b2093dd tempest-CinderUnicodeTest-267222635 None] Create snapshot completed successfully Jul 10 06:56:09 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f6f7828d-4fd0-4df9-8392-3d8294375312 tempest-CinderUnicodeTest-267222635 None] Acquiring lock "cinder-73209470-b62d-4d4a-901d-ed7a7a9208e6-delete_snapshot" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:56:09 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f6f7828d-4fd0-4df9-8392-3d8294375312 tempest-CinderUnicodeTest-267222635 None] Lock "cinder-73209470-b62d-4d4a-901d-ed7a7a9208e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:56:09 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f6f7828d-4fd0-4df9-8392-3d8294375312 tempest-CinderUnicodeTest-267222635 None] Acquiring lock "cinder-quobyte-61c69cb0-c82e-463d-a27b-8971d3cb9875" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:56:09 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f6f7828d-4fd0-4df9-8392-3d8294375312 tempest-CinderUnicodeTest-267222635 None] Lock "cinder-quobyte-61c69cb0-c82e-463d-a27b-8971d3cb9875" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:56:09 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f6f7828d-4fd0-4df9-8392-3d8294375312 tempest-CinderUnicodeTest-267222635 None] Acquiring lock "cinder-quobyte-73209470-b62d-4d4a-901d-ed7a7a9208e6" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:56:09 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f6f7828d-4fd0-4df9-8392-3d8294375312 tempest-CinderUnicodeTest-267222635 None] Lock "cinder-quobyte-73209470-b62d-4d4a-901d-ed7a7a9208e6" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:56:09 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-f6f7828d-4fd0-4df9-8392-3d8294375312 tempest-CinderUnicodeTest-267222635 None] Deleting offline snapshot 73209470-b62d-4d4a-901d-ed7a7a9208e6 of volume 61c69cb0-c82e-463d-a27b-8971d3cb9875 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:56:09 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-f6f7828d-4fd0-4df9-8392-3d8294375312 tempest-CinderUnicodeTest-267222635 None] snapshot_file for this snap is: volume-61c69cb0-c82e-463d-a27b-8971d3cb9875.73209470-b62d-4d4a-901d-ed7a7a9208e6 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:56:09 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0cc1c7-b5d6-4a64-96c3-a0877be0e0a3]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:56:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f6f7828d-4fd0-4df9-8392-3d8294375312 tempest-CinderUnicodeTest-267222635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875.73209470-b62d-4d4a-901d-ed7a7a9208e6 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:10 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875.73209470-b62d-4d4a-901d-ed7a7a9208e6 Jul 10 06:56:10 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:10 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f6f7828d-4fd0-4df9-8392-3d8294375312 tempest-CinderUnicodeTest-267222635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875.73209470-b62d-4d4a-901d-ed7a7a9208e6" returned: 0 in 0.711s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:10 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-f6f7828d-4fd0-4df9-8392-3d8294375312 tempest-CinderUnicodeTest-267222635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61c69cb0-c82e-463d-a27b-8971d3cb9875(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:56:10 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[67491fa1-158f-480e-a7d1-2a902486f8c3]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:56:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f6f7828d-4fd0-4df9-8392-3d8294375312 tempest-CinderUnicodeTest-267222635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:10 devstack sudo[105660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875 Jul 10 06:56:10 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:11 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f6f7828d-4fd0-4df9-8392-3d8294375312 tempest-CinderUnicodeTest-267222635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875" returned: 0 in 0.701s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f6f7828d-4fd0-4df9-8392-3d8294375312 tempest-CinderUnicodeTest-267222635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875.73209470-b62d-4d4a-901d-ed7a7a9208e6 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:11 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875.73209470-b62d-4d4a-901d-ed7a7a9208e6 Jul 10 06:56:11 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:12 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f6f7828d-4fd0-4df9-8392-3d8294375312 tempest-CinderUnicodeTest-267222635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875.73209470-b62d-4d4a-901d-ed7a7a9208e6" returned: 0 in 0.710s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f6f7828d-4fd0-4df9-8392-3d8294375312 tempest-CinderUnicodeTest-267222635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875.73209470-b62d-4d4a-901d-ed7a7a9208e6 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:12 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875.73209470-b62d-4d4a-901d-ed7a7a9208e6 Jul 10 06:56:12 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:12 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f6f7828d-4fd0-4df9-8392-3d8294375312 tempest-CinderUnicodeTest-267222635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875.73209470-b62d-4d4a-901d-ed7a7a9208e6" returned: 0 in 0.645s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:12 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f6f7828d-4fd0-4df9-8392-3d8294375312 tempest-CinderUnicodeTest-267222635 None] Lock "cinder-quobyte-73209470-b62d-4d4a-901d-ed7a7a9208e6" released by "_delete_snapshot" :: held 2.856s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:56:12 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f6f7828d-4fd0-4df9-8392-3d8294375312 tempest-CinderUnicodeTest-267222635 None] Lock "cinder-quobyte-61c69cb0-c82e-463d-a27b-8971d3cb9875" released by "delete_snapshot" :: held 2.878s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:56:12 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-f6f7828d-4fd0-4df9-8392-3d8294375312 tempest-CinderUnicodeTest-267222635 None] Created reservations ['f8dd1bcd-bbf6-414c-b8e4-cbdd29163650', '7e8d6ee7-12f6-4586-b52e-9decfd26a911', 'f7c60334-7497-43b9-b6ce-e274252a4888', 'cfb66cbf-2538-4cc2-88d0-919804d7a806'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:56:12 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-f6f7828d-4fd0-4df9-8392-3d8294375312 tempest-CinderUnicodeTest-267222635 None] Delete snapshot completed successfully. Jul 10 06:56:12 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f6f7828d-4fd0-4df9-8392-3d8294375312 tempest-CinderUnicodeTest-267222635 None] Lock "cinder-73209470-b62d-4d4a-901d-ed7a7a9208e6-delete_snapshot" released by "delete_snapshot" :: held 2.994s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:56:13 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-76fe2878-80f6-42d5-9bb1-5d56023367bc tempest-CinderUnicodeTest-267222635 None] Acquiring lock "cinder-61c69cb0-c82e-463d-a27b-8971d3cb9875-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:56:13 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-76fe2878-80f6-42d5-9bb1-5d56023367bc tempest-CinderUnicodeTest-267222635 None] Lock "cinder-61c69cb0-c82e-463d-a27b-8971d3cb9875-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:56:13 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-76fe2878-80f6-42d5-9bb1-5d56023367bc tempest-CinderUnicodeTest-267222635 None] Acquiring lock "cinder-quobyte-61c69cb0-c82e-463d-a27b-8971d3cb9875" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:56:13 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-76fe2878-80f6-42d5-9bb1-5d56023367bc tempest-CinderUnicodeTest-267222635 None] Lock "cinder-quobyte-61c69cb0-c82e-463d-a27b-8971d3cb9875" acquired by "delete_volume" :: waited 0.015s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:56:13 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f5be75-7d90-4aeb-a31b-849b65136bca]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:56:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-76fe2878-80f6-42d5-9bb1-5d56023367bc tempest-CinderUnicodeTest-267222635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:13 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875 Jul 10 06:56:13 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:13 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-76fe2878-80f6-42d5-9bb1-5d56023367bc tempest-CinderUnicodeTest-267222635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875" returned: 0 in 0.714s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-76fe2878-80f6-42d5-9bb1-5d56023367bc tempest-CinderUnicodeTest-267222635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:13 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875 Jul 10 06:56:13 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:14 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-76fe2878-80f6-42d5-9bb1-5d56023367bc tempest-CinderUnicodeTest-267222635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-61c69cb0-c82e-463d-a27b-8971d3cb9875" returned: 0 in 0.619s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:14 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-76fe2878-80f6-42d5-9bb1-5d56023367bc tempest-CinderUnicodeTest-267222635 None] Lock "cinder-quobyte-61c69cb0-c82e-463d-a27b-8971d3cb9875" released by "delete_volume" :: held 1.396s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:56:14 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-76fe2878-80f6-42d5-9bb1-5d56023367bc tempest-CinderUnicodeTest-267222635 None] Created reservations ['511a1dcb-ccac-4df3-abf7-fc13dd08b8fa', '7fd8516e-3472-41e6-aaae-a85dc4e8529a', '5d3c171c-707c-4269-ba97-9e7143a03b71', '2666166a-a3a4-4270-9de3-8add558f5522'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:56:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-76fe2878-80f6-42d5-9bb1-5d56023367bc tempest-CinderUnicodeTest-267222635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:56:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-76fe2878-80f6-42d5-9bb1-5d56023367bc tempest-CinderUnicodeTest-267222635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:56:14 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-76fe2878-80f6-42d5-9bb1-5d56023367bc tempest-CinderUnicodeTest-267222635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:56:14 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-76fe2878-80f6-42d5-9bb1-5d56023367bc tempest-CinderUnicodeTest-267222635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:56:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-76fe2878-80f6-42d5-9bb1-5d56023367bc tempest-CinderUnicodeTest-267222635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:56:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-76fe2878-80f6-42d5-9bb1-5d56023367bc tempest-CinderUnicodeTest-267222635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:14 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:56:14 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:15 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-76fe2878-80f6-42d5-9bb1-5d56023367bc tempest-CinderUnicodeTest-267222635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.626s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:15 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-76fe2878-80f6-42d5-9bb1-5d56023367bc tempest-CinderUnicodeTest-267222635 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:56:15 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-76fe2878-80f6-42d5-9bb1-5d56023367bc tempest-CinderUnicodeTest-267222635 None] Deleted volume successfully. Jul 10 06:56:15 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-76fe2878-80f6-42d5-9bb1-5d56023367bc tempest-CinderUnicodeTest-267222635 None] Lock "cinder-61c69cb0-c82e-463d-a27b-8971d3cb9875-delete_volume" released by "delete_volume" :: held 2.208s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:56:15 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-bf6d62f3-393b-44de-8e60-fef79fd671c0 tempest-CinderUnicodeTest-267222635 None] Acquiring lock "cinder-5f968ef5-563c-4f55-9dbe-e3ac0078e231-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:56:15 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-bf6d62f3-393b-44de-8e60-fef79fd671c0 tempest-CinderUnicodeTest-267222635 None] Lock "cinder-5f968ef5-563c-4f55-9dbe-e3ac0078e231-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:56:15 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-bf6d62f3-393b-44de-8e60-fef79fd671c0 tempest-CinderUnicodeTest-267222635 None] Acquiring lock "cinder-quobyte-5f968ef5-563c-4f55-9dbe-e3ac0078e231" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:56:15 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-bf6d62f3-393b-44de-8e60-fef79fd671c0 tempest-CinderUnicodeTest-267222635 None] Lock "cinder-quobyte-5f968ef5-563c-4f55-9dbe-e3ac0078e231" acquired by "delete_volume" :: waited 0.014s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:56:15 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7ab353-48d1-44e9-a9b5-e36667a92535]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:56:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bf6d62f3-393b-44de-8e60-fef79fd671c0 tempest-CinderUnicodeTest-267222635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-5f968ef5-563c-4f55-9dbe-e3ac0078e231 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:15 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-5f968ef5-563c-4f55-9dbe-e3ac0078e231 Jul 10 06:56:15 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:16 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bf6d62f3-393b-44de-8e60-fef79fd671c0 tempest-CinderUnicodeTest-267222635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-5f968ef5-563c-4f55-9dbe-e3ac0078e231" returned: 0 in 0.719s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bf6d62f3-393b-44de-8e60-fef79fd671c0 tempest-CinderUnicodeTest-267222635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-5f968ef5-563c-4f55-9dbe-e3ac0078e231 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:16 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-5f968ef5-563c-4f55-9dbe-e3ac0078e231 Jul 10 06:56:16 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:16 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bf6d62f3-393b-44de-8e60-fef79fd671c0 tempest-CinderUnicodeTest-267222635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-5f968ef5-563c-4f55-9dbe-e3ac0078e231" returned: 0 in 0.612s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:16 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-bf6d62f3-393b-44de-8e60-fef79fd671c0 tempest-CinderUnicodeTest-267222635 None] Lock "cinder-quobyte-5f968ef5-563c-4f55-9dbe-e3ac0078e231" released by "delete_volume" :: held 1.365s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:56:16 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-bf6d62f3-393b-44de-8e60-fef79fd671c0 tempest-CinderUnicodeTest-267222635 None] Created reservations ['de7df84e-c1cf-4028-8724-a2bd3396e05f', '378dcdf7-e19a-44c1-8ecc-2c7b9a688122', '93289116-c25b-4b19-8320-2cd7b8b92a14', 'b98c4897-a615-424c-aa1a-0850e4bce11d'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:56:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-bf6d62f3-393b-44de-8e60-fef79fd671c0 tempest-CinderUnicodeTest-267222635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:56:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-bf6d62f3-393b-44de-8e60-fef79fd671c0 tempest-CinderUnicodeTest-267222635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:56:16 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-bf6d62f3-393b-44de-8e60-fef79fd671c0 tempest-CinderUnicodeTest-267222635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:56:16 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-bf6d62f3-393b-44de-8e60-fef79fd671c0 tempest-CinderUnicodeTest-267222635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:56:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-bf6d62f3-393b-44de-8e60-fef79fd671c0 tempest-CinderUnicodeTest-267222635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:56:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bf6d62f3-393b-44de-8e60-fef79fd671c0 tempest-CinderUnicodeTest-267222635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:16 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:56:16 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:17 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bf6d62f3-393b-44de-8e60-fef79fd671c0 tempest-CinderUnicodeTest-267222635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.612s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:17 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-bf6d62f3-393b-44de-8e60-fef79fd671c0 tempest-CinderUnicodeTest-267222635 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:56:17 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-bf6d62f3-393b-44de-8e60-fef79fd671c0 tempest-CinderUnicodeTest-267222635 None] Deleted volume successfully. Jul 10 06:56:17 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-bf6d62f3-393b-44de-8e60-fef79fd671c0 tempest-CinderUnicodeTest-267222635 None] Lock "cinder-5f968ef5-563c-4f55-9dbe-e3ac0078e231-delete_volume" released by "delete_volume" :: held 2.157s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:56:21 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:56:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:56:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:56:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:56:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:56:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:56:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:21 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:56:21 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:22 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.635s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:22 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:56:22 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager._thread_info {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:56:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread count: 28 {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:56:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread info: [<_MainThread(MainThread, started 139245706264704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:56:24 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-a25edd80-379d-4968-9dbd-558ce2b3c10f tempest-ProjectReaderTests-1213029343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:56:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a25edd80-379d-4968-9dbd-558ce2b3c10f tempest-ProjectReaderTests-1213029343 None] Flow 'volume_create_manager' (c2e248c0-ad54-4469-803f-897c1cf0d15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:56:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a25edd80-379d-4968-9dbd-558ce2b3c10f tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3a19daa-74d1-470f-b90c-bbfe90dca62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a25edd80-379d-4968-9dbd-558ce2b3c10f tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3a19daa-74d1-470f-b90c-bbfe90dca62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-890696426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c5bbdf9-b2c1-45e6-80ea-2fbb3686607b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72fbb2c353d946c3b05a1fabf6c653ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:56:25Z,use_quota=True,user_id='c1b64e53413b46da89382ac2050685a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a25edd80-379d-4968-9dbd-558ce2b3c10f tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fcc10a6-0fc3-4cb5-8548-cb621ba4976e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a25edd80-379d-4968-9dbd-558ce2b3c10f tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fcc10a6-0fc3-4cb5-8548-cb621ba4976e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a25edd80-379d-4968-9dbd-558ce2b3c10f tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f65ca53-c0b5-4431-92cb-f47f7b652868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a25edd80-379d-4968-9dbd-558ce2b3c10f tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f65ca53-c0b5-4431-92cb-f47f7b652868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c5bbdf9-b2c1-45e6-80ea-2fbb3686607b', 'volume_name': 'volume-4c5bbdf9-b2c1-45e6-80ea-2fbb3686607b', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a25edd80-379d-4968-9dbd-558ce2b3c10f tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99bdeaf2-ff72-482f-a6cc-6adf2c06fd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a25edd80-379d-4968-9dbd-558ce2b3c10f tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99bdeaf2-ff72-482f-a6cc-6adf2c06fd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a25edd80-379d-4968-9dbd-558ce2b3c10f tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49bc9ae8-f482-4147-b245-0664273d2918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:24 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-a25edd80-379d-4968-9dbd-558ce2b3c10f tempest-ProjectReaderTests-1213029343 None] Volume 4c5bbdf9-b2c1-45e6-80ea-2fbb3686607b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c5bbdf9-b2c1-45e6-80ea-2fbb3686607b', 'volume_size': 1} Jul 10 06:56:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a25edd80-379d-4968-9dbd-558ce2b3c10f tempest-ProjectReaderTests-1213029343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:56:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a25edd80-379d-4968-9dbd-558ce2b3c10f tempest-ProjectReaderTests-1213029343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:56:24 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-a25edd80-379d-4968-9dbd-558ce2b3c10f tempest-ProjectReaderTests-1213029343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-890696426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c5bbdf9-b2c1-45e6-80ea-2fbb3686607b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72fbb2c353d946c3b05a1fabf6c653ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:56:25Z,use_quota=True,user_id='c1b64e53413b46da89382ac2050685a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:56:24 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-a25edd80-379d-4968-9dbd-558ce2b3c10f tempest-ProjectReaderTests-1213029343 None] Creating volume 4c5bbdf9-b2c1-45e6-80ea-2fbb3686607b {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:56:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a25edd80-379d-4968-9dbd-558ce2b3c10f tempest-ProjectReaderTests-1213029343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:56:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a25edd80-379d-4968-9dbd-558ce2b3c10f tempest-ProjectReaderTests-1213029343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:56:24 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-a25edd80-379d-4968-9dbd-558ce2b3c10f tempest-ProjectReaderTests-1213029343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:56:25 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-a25edd80-379d-4968-9dbd-558ce2b3c10f tempest-ProjectReaderTests-1213029343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:56:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a25edd80-379d-4968-9dbd-558ce2b3c10f tempest-ProjectReaderTests-1213029343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:56:25 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-a25edd80-379d-4968-9dbd-558ce2b3c10f tempest-ProjectReaderTests-1213029343 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:56:25 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-a25edd80-379d-4968-9dbd-558ce2b3c10f tempest-ProjectReaderTests-1213029343 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:56:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a25edd80-379d-4968-9dbd-558ce2b3c10f tempest-ProjectReaderTests-1213029343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4c5bbdf9-b2c1-45e6-80ea-2fbb3686607b 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:25 devstack sudo[105736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4c5bbdf9-b2c1-45e6-80ea-2fbb3686607b 1073741824 Jul 10 06:56:25 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:25 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a25edd80-379d-4968-9dbd-558ce2b3c10f tempest-ProjectReaderTests-1213029343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4c5bbdf9-b2c1-45e6-80ea-2fbb3686607b 1073741824" returned: 0 in 0.806s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a25edd80-379d-4968-9dbd-558ce2b3c10f tempest-ProjectReaderTests-1213029343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4c5bbdf9-b2c1-45e6-80ea-2fbb3686607b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:25 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4c5bbdf9-b2c1-45e6-80ea-2fbb3686607b Jul 10 06:56:25 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:26 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a25edd80-379d-4968-9dbd-558ce2b3c10f tempest-ProjectReaderTests-1213029343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4c5bbdf9-b2c1-45e6-80ea-2fbb3686607b" returned: 0 in 0.663s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:26 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-a25edd80-379d-4968-9dbd-558ce2b3c10f tempest-ProjectReaderTests-1213029343 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:56:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a25edd80-379d-4968-9dbd-558ce2b3c10f tempest-ProjectReaderTests-1213029343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:56:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a25edd80-379d-4968-9dbd-558ce2b3c10f tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49bc9ae8-f482-4147-b245-0664273d2918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c5bbdf9-b2c1-45e6-80ea-2fbb3686607b', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a25edd80-379d-4968-9dbd-558ce2b3c10f tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28f7dff9-f133-4743-baa6-66186f773dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:26 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-a25edd80-379d-4968-9dbd-558ce2b3c10f tempest-ProjectReaderTests-1213029343 None] Volume volume-4c5bbdf9-b2c1-45e6-80ea-2fbb3686607b (4c5bbdf9-b2c1-45e6-80ea-2fbb3686607b): created successfully Jul 10 06:56:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a25edd80-379d-4968-9dbd-558ce2b3c10f tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28f7dff9-f133-4743-baa6-66186f773dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a25edd80-379d-4968-9dbd-558ce2b3c10f tempest-ProjectReaderTests-1213029343 None] Flow 'volume_create_manager' (c2e248c0-ad54-4469-803f-897c1cf0d15c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:56:26 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-a25edd80-379d-4968-9dbd-558ce2b3c10f tempest-ProjectReaderTests-1213029343 None] Created volume successfully. Jul 10 06:56:27 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-63a270c8-4dfb-4320-9487-62399bd6a37a tempest-ProjectReaderTests-1213029343 None] Acquiring lock "cinder-4c5bbdf9-b2c1-45e6-80ea-2fbb3686607b-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:56:27 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-63a270c8-4dfb-4320-9487-62399bd6a37a tempest-ProjectReaderTests-1213029343 None] Lock "cinder-4c5bbdf9-b2c1-45e6-80ea-2fbb3686607b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:56:27 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-63a270c8-4dfb-4320-9487-62399bd6a37a tempest-ProjectReaderTests-1213029343 None] Acquiring lock "cinder-quobyte-4c5bbdf9-b2c1-45e6-80ea-2fbb3686607b" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:56:27 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-63a270c8-4dfb-4320-9487-62399bd6a37a tempest-ProjectReaderTests-1213029343 None] Lock "cinder-quobyte-4c5bbdf9-b2c1-45e6-80ea-2fbb3686607b" acquired by "delete_volume" :: waited 0.014s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:56:27 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce6e23a-99d2-4884-a0f8-814a89691f4a]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:56:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-63a270c8-4dfb-4320-9487-62399bd6a37a tempest-ProjectReaderTests-1213029343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4c5bbdf9-b2c1-45e6-80ea-2fbb3686607b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:27 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4c5bbdf9-b2c1-45e6-80ea-2fbb3686607b Jul 10 06:56:27 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:27 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-63a270c8-4dfb-4320-9487-62399bd6a37a tempest-ProjectReaderTests-1213029343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4c5bbdf9-b2c1-45e6-80ea-2fbb3686607b" returned: 0 in 0.739s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-63a270c8-4dfb-4320-9487-62399bd6a37a tempest-ProjectReaderTests-1213029343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4c5bbdf9-b2c1-45e6-80ea-2fbb3686607b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:27 devstack sudo[105750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4c5bbdf9-b2c1-45e6-80ea-2fbb3686607b Jul 10 06:56:27 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:28 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-63a270c8-4dfb-4320-9487-62399bd6a37a tempest-ProjectReaderTests-1213029343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-4c5bbdf9-b2c1-45e6-80ea-2fbb3686607b" returned: 0 in 0.615s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:28 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-63a270c8-4dfb-4320-9487-62399bd6a37a tempest-ProjectReaderTests-1213029343 None] Lock "cinder-quobyte-4c5bbdf9-b2c1-45e6-80ea-2fbb3686607b" released by "delete_volume" :: held 1.392s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:56:28 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-63a270c8-4dfb-4320-9487-62399bd6a37a tempest-ProjectReaderTests-1213029343 None] Created reservations ['e1309a1f-aef5-4bda-8bf1-795b361d6504', '7cbd41b0-3071-4644-93e9-5297605663e9', '918d83f9-5ecd-420d-b381-852107a710d8', '1b773894-ac1e-44de-bf48-697587aa8c73'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:56:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-63a270c8-4dfb-4320-9487-62399bd6a37a tempest-ProjectReaderTests-1213029343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:56:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-63a270c8-4dfb-4320-9487-62399bd6a37a tempest-ProjectReaderTests-1213029343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:56:28 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-63a270c8-4dfb-4320-9487-62399bd6a37a tempest-ProjectReaderTests-1213029343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:56:28 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-63a270c8-4dfb-4320-9487-62399bd6a37a tempest-ProjectReaderTests-1213029343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:56:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-63a270c8-4dfb-4320-9487-62399bd6a37a tempest-ProjectReaderTests-1213029343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:56:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-63a270c8-4dfb-4320-9487-62399bd6a37a tempest-ProjectReaderTests-1213029343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:28 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:56:28 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:29 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-63a270c8-4dfb-4320-9487-62399bd6a37a tempest-ProjectReaderTests-1213029343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.609s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:29 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-63a270c8-4dfb-4320-9487-62399bd6a37a tempest-ProjectReaderTests-1213029343 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:56:29 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-63a270c8-4dfb-4320-9487-62399bd6a37a tempest-ProjectReaderTests-1213029343 None] Deleted volume successfully. Jul 10 06:56:29 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-63a270c8-4dfb-4320-9487-62399bd6a37a tempest-ProjectReaderTests-1213029343 None] Lock "cinder-4c5bbdf9-b2c1-45e6-80ea-2fbb3686607b-delete_volume" released by "delete_volume" :: held 2.184s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:56:29 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2db44ac-aef6-424a-b01b-4d60da3f85ea tempest-ProjectReaderTests-1213029343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:56:29 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e2db44ac-aef6-424a-b01b-4d60da3f85ea tempest-ProjectReaderTests-1213029343 None] Flow 'volume_create_manager' (341dd826-e579-412e-9186-1cc2d0efdacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:56:29 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e2db44ac-aef6-424a-b01b-4d60da3f85ea tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2be8ea8e-cbdf-4bf5-831d-85903ec019fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:29 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e2db44ac-aef6-424a-b01b-4d60da3f85ea tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2be8ea8e-cbdf-4bf5-831d-85903ec019fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-882929255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13531254-a869-48a2-a32a-562de975a69a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72fbb2c353d946c3b05a1fabf6c653ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:56:30Z,use_quota=True,user_id='c1b64e53413b46da89382ac2050685a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:29 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e2db44ac-aef6-424a-b01b-4d60da3f85ea tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (481f38e7-b235-408f-ac3e-1d2931f50ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:29 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e2db44ac-aef6-424a-b01b-4d60da3f85ea tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (481f38e7-b235-408f-ac3e-1d2931f50ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:29 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e2db44ac-aef6-424a-b01b-4d60da3f85ea tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1fdf2a2-74b9-4380-b537-4ea38f68a4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:29 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e2db44ac-aef6-424a-b01b-4d60da3f85ea tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1fdf2a2-74b9-4380-b537-4ea38f68a4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13531254-a869-48a2-a32a-562de975a69a', 'volume_name': 'volume-13531254-a869-48a2-a32a-562de975a69a', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:29 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e2db44ac-aef6-424a-b01b-4d60da3f85ea tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10550230-bd1f-42e8-a524-db12131e0a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:29 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e2db44ac-aef6-424a-b01b-4d60da3f85ea tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10550230-bd1f-42e8-a524-db12131e0a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:29 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e2db44ac-aef6-424a-b01b-4d60da3f85ea tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cdea74c-8f6d-435b-953b-29afda2e0b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:29 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-e2db44ac-aef6-424a-b01b-4d60da3f85ea tempest-ProjectReaderTests-1213029343 None] Volume 13531254-a869-48a2-a32a-562de975a69a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13531254-a869-48a2-a32a-562de975a69a', 'volume_size': 1} Jul 10 06:56:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e2db44ac-aef6-424a-b01b-4d60da3f85ea tempest-ProjectReaderTests-1213029343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:56:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e2db44ac-aef6-424a-b01b-4d60da3f85ea tempest-ProjectReaderTests-1213029343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:56:29 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-e2db44ac-aef6-424a-b01b-4d60da3f85ea tempest-ProjectReaderTests-1213029343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-882929255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13531254-a869-48a2-a32a-562de975a69a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72fbb2c353d946c3b05a1fabf6c653ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:56:30Z,use_quota=True,user_id='c1b64e53413b46da89382ac2050685a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:56:29 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-e2db44ac-aef6-424a-b01b-4d60da3f85ea tempest-ProjectReaderTests-1213029343 None] Creating volume 13531254-a869-48a2-a32a-562de975a69a {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:56:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e2db44ac-aef6-424a-b01b-4d60da3f85ea tempest-ProjectReaderTests-1213029343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:56:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e2db44ac-aef6-424a-b01b-4d60da3f85ea tempest-ProjectReaderTests-1213029343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:56:29 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-e2db44ac-aef6-424a-b01b-4d60da3f85ea tempest-ProjectReaderTests-1213029343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:56:29 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-e2db44ac-aef6-424a-b01b-4d60da3f85ea tempest-ProjectReaderTests-1213029343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:56:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e2db44ac-aef6-424a-b01b-4d60da3f85ea tempest-ProjectReaderTests-1213029343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:56:29 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-e2db44ac-aef6-424a-b01b-4d60da3f85ea tempest-ProjectReaderTests-1213029343 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:56:29 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-e2db44ac-aef6-424a-b01b-4d60da3f85ea tempest-ProjectReaderTests-1213029343 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:56:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e2db44ac-aef6-424a-b01b-4d60da3f85ea tempest-ProjectReaderTests-1213029343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-13531254-a869-48a2-a32a-562de975a69a 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:29 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-13531254-a869-48a2-a32a-562de975a69a 1073741824 Jul 10 06:56:29 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:30 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e2db44ac-aef6-424a-b01b-4d60da3f85ea tempest-ProjectReaderTests-1213029343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-13531254-a869-48a2-a32a-562de975a69a 1073741824" returned: 0 in 0.800s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e2db44ac-aef6-424a-b01b-4d60da3f85ea tempest-ProjectReaderTests-1213029343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-13531254-a869-48a2-a32a-562de975a69a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:30 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-13531254-a869-48a2-a32a-562de975a69a Jul 10 06:56:30 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:31 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e2db44ac-aef6-424a-b01b-4d60da3f85ea tempest-ProjectReaderTests-1213029343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-13531254-a869-48a2-a32a-562de975a69a" returned: 0 in 0.613s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:31 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-e2db44ac-aef6-424a-b01b-4d60da3f85ea tempest-ProjectReaderTests-1213029343 None] <== create_volume: return (1451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:56:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e2db44ac-aef6-424a-b01b-4d60da3f85ea tempest-ProjectReaderTests-1213029343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.453s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:56:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e2db44ac-aef6-424a-b01b-4d60da3f85ea tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cdea74c-8f6d-435b-953b-29afda2e0b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13531254-a869-48a2-a32a-562de975a69a', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e2db44ac-aef6-424a-b01b-4d60da3f85ea tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffadf5c8-a95c-40b2-bb17-fa083bdd1c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:31 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-e2db44ac-aef6-424a-b01b-4d60da3f85ea tempest-ProjectReaderTests-1213029343 None] Volume volume-13531254-a869-48a2-a32a-562de975a69a (13531254-a869-48a2-a32a-562de975a69a): created successfully Jul 10 06:56:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e2db44ac-aef6-424a-b01b-4d60da3f85ea tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffadf5c8-a95c-40b2-bb17-fa083bdd1c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e2db44ac-aef6-424a-b01b-4d60da3f85ea tempest-ProjectReaderTests-1213029343 None] Flow 'volume_create_manager' (341dd826-e579-412e-9186-1cc2d0efdacb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:56:31 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-e2db44ac-aef6-424a-b01b-4d60da3f85ea tempest-ProjectReaderTests-1213029343 None] Created volume successfully. Jul 10 06:56:31 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-ff4ccf45-3c41-4a48-9daf-5fc8c37daa24 tempest-ProjectReaderTests-1213029343 None] Acquiring lock "cinder-13531254-a869-48a2-a32a-562de975a69a-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:56:31 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-ff4ccf45-3c41-4a48-9daf-5fc8c37daa24 tempest-ProjectReaderTests-1213029343 None] Lock "cinder-13531254-a869-48a2-a32a-562de975a69a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:56:31 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-ff4ccf45-3c41-4a48-9daf-5fc8c37daa24 tempest-ProjectReaderTests-1213029343 None] Acquiring lock "cinder-quobyte-13531254-a869-48a2-a32a-562de975a69a" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:56:31 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-ff4ccf45-3c41-4a48-9daf-5fc8c37daa24 tempest-ProjectReaderTests-1213029343 None] Lock "cinder-quobyte-13531254-a869-48a2-a32a-562de975a69a" acquired by "delete_volume" :: waited 0.014s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:56:31 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[682cd4cf-432b-4673-9c68-ee4e70f6ae50]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:56:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ff4ccf45-3c41-4a48-9daf-5fc8c37daa24 tempest-ProjectReaderTests-1213029343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-13531254-a869-48a2-a32a-562de975a69a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:32 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-13531254-a869-48a2-a32a-562de975a69a Jul 10 06:56:32 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:32 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ff4ccf45-3c41-4a48-9daf-5fc8c37daa24 tempest-ProjectReaderTests-1213029343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-13531254-a869-48a2-a32a-562de975a69a" returned: 0 in 0.712s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ff4ccf45-3c41-4a48-9daf-5fc8c37daa24 tempest-ProjectReaderTests-1213029343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-13531254-a869-48a2-a32a-562de975a69a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:32 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-13531254-a869-48a2-a32a-562de975a69a Jul 10 06:56:32 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:33 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ff4ccf45-3c41-4a48-9daf-5fc8c37daa24 tempest-ProjectReaderTests-1213029343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-13531254-a869-48a2-a32a-562de975a69a" returned: 0 in 0.599s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:33 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-ff4ccf45-3c41-4a48-9daf-5fc8c37daa24 tempest-ProjectReaderTests-1213029343 None] Lock "cinder-quobyte-13531254-a869-48a2-a32a-562de975a69a" released by "delete_volume" :: held 1.348s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:56:33 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-ff4ccf45-3c41-4a48-9daf-5fc8c37daa24 tempest-ProjectReaderTests-1213029343 None] Created reservations ['f5e4136d-e0a9-4edc-9db0-7f134475d745', '07314bfa-fb73-4eb7-8563-56aee43990c2', 'd942c8c4-ad1d-485b-9496-c5076e90dfcc', '9a6f0a19-b00c-4157-8cd5-4cc22ccba8a8'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:56:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ff4ccf45-3c41-4a48-9daf-5fc8c37daa24 tempest-ProjectReaderTests-1213029343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:56:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ff4ccf45-3c41-4a48-9daf-5fc8c37daa24 tempest-ProjectReaderTests-1213029343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:56:33 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-ff4ccf45-3c41-4a48-9daf-5fc8c37daa24 tempest-ProjectReaderTests-1213029343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:56:33 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-ff4ccf45-3c41-4a48-9daf-5fc8c37daa24 tempest-ProjectReaderTests-1213029343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:56:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ff4ccf45-3c41-4a48-9daf-5fc8c37daa24 tempest-ProjectReaderTests-1213029343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:56:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ff4ccf45-3c41-4a48-9daf-5fc8c37daa24 tempest-ProjectReaderTests-1213029343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:33 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:56:33 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:34 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ff4ccf45-3c41-4a48-9daf-5fc8c37daa24 tempest-ProjectReaderTests-1213029343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.624s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:34 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-ff4ccf45-3c41-4a48-9daf-5fc8c37daa24 tempest-ProjectReaderTests-1213029343 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:56:34 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-ff4ccf45-3c41-4a48-9daf-5fc8c37daa24 tempest-ProjectReaderTests-1213029343 None] Deleted volume successfully. Jul 10 06:56:34 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-ff4ccf45-3c41-4a48-9daf-5fc8c37daa24 tempest-ProjectReaderTests-1213029343 None] Lock "cinder-13531254-a869-48a2-a32a-562de975a69a-delete_volume" released by "delete_volume" :: held 2.159s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:56:34 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c14ba89-95bd-420e-b7b3-a1aa1825f1e3 tempest-ProjectReaderTests-1213029343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:56:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0c14ba89-95bd-420e-b7b3-a1aa1825f1e3 tempest-ProjectReaderTests-1213029343 None] Flow 'volume_create_manager' (a3c11dc8-5b04-429a-97ba-934094a9ea21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:56:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0c14ba89-95bd-420e-b7b3-a1aa1825f1e3 tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae30cc68-f45d-4101-9594-a32f6ddfb60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0c14ba89-95bd-420e-b7b3-a1aa1825f1e3 tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae30cc68-f45d-4101-9594-a32f6ddfb60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1789352382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2ae791d-5505-4f62-8588-64f970f0e4a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72fbb2c353d946c3b05a1fabf6c653ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:56:34Z,use_quota=True,user_id='c1b64e53413b46da89382ac2050685a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0c14ba89-95bd-420e-b7b3-a1aa1825f1e3 tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91690be5-109d-4ece-b096-59a9d883b357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0c14ba89-95bd-420e-b7b3-a1aa1825f1e3 tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91690be5-109d-4ece-b096-59a9d883b357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0c14ba89-95bd-420e-b7b3-a1aa1825f1e3 tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7dac147-50f1-438e-88e6-9d8947e7de42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0c14ba89-95bd-420e-b7b3-a1aa1825f1e3 tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7dac147-50f1-438e-88e6-9d8947e7de42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2ae791d-5505-4f62-8588-64f970f0e4a4', 'volume_name': 'volume-c2ae791d-5505-4f62-8588-64f970f0e4a4', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0c14ba89-95bd-420e-b7b3-a1aa1825f1e3 tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f274901-b1b0-4e99-8c43-538cdc47e8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0c14ba89-95bd-420e-b7b3-a1aa1825f1e3 tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f274901-b1b0-4e99-8c43-538cdc47e8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0c14ba89-95bd-420e-b7b3-a1aa1825f1e3 tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98628f06-1b56-4925-81ef-93b8f962643a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:34 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-0c14ba89-95bd-420e-b7b3-a1aa1825f1e3 tempest-ProjectReaderTests-1213029343 None] Volume c2ae791d-5505-4f62-8588-64f970f0e4a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2ae791d-5505-4f62-8588-64f970f0e4a4', 'volume_size': 1} Jul 10 06:56:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-0c14ba89-95bd-420e-b7b3-a1aa1825f1e3 tempest-ProjectReaderTests-1213029343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:56:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-0c14ba89-95bd-420e-b7b3-a1aa1825f1e3 tempest-ProjectReaderTests-1213029343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:56:34 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-0c14ba89-95bd-420e-b7b3-a1aa1825f1e3 tempest-ProjectReaderTests-1213029343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:56:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1789352382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2ae791d-5505-4f62-8588-64f970f0e4a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72fbb2c353d946c3b05a1fabf6c653ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:56:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:56:34Z,use_quota=True,user_id='c1b64e53413b46da89382ac2050685a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:56:34 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-0c14ba89-95bd-420e-b7b3-a1aa1825f1e3 tempest-ProjectReaderTests-1213029343 None] Creating volume c2ae791d-5505-4f62-8588-64f970f0e4a4 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:56:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-0c14ba89-95bd-420e-b7b3-a1aa1825f1e3 tempest-ProjectReaderTests-1213029343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:56:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-0c14ba89-95bd-420e-b7b3-a1aa1825f1e3 tempest-ProjectReaderTests-1213029343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:56:34 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-0c14ba89-95bd-420e-b7b3-a1aa1825f1e3 tempest-ProjectReaderTests-1213029343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:56:34 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-0c14ba89-95bd-420e-b7b3-a1aa1825f1e3 tempest-ProjectReaderTests-1213029343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:56:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-0c14ba89-95bd-420e-b7b3-a1aa1825f1e3 tempest-ProjectReaderTests-1213029343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:56:34 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-0c14ba89-95bd-420e-b7b3-a1aa1825f1e3 tempest-ProjectReaderTests-1213029343 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:56:34 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-0c14ba89-95bd-420e-b7b3-a1aa1825f1e3 tempest-ProjectReaderTests-1213029343 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:56:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0c14ba89-95bd-420e-b7b3-a1aa1825f1e3 tempest-ProjectReaderTests-1213029343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c2ae791d-5505-4f62-8588-64f970f0e4a4 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:34 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c2ae791d-5505-4f62-8588-64f970f0e4a4 1073741824 Jul 10 06:56:34 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:35 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0c14ba89-95bd-420e-b7b3-a1aa1825f1e3 tempest-ProjectReaderTests-1213029343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c2ae791d-5505-4f62-8588-64f970f0e4a4 1073741824" returned: 0 in 0.783s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0c14ba89-95bd-420e-b7b3-a1aa1825f1e3 tempest-ProjectReaderTests-1213029343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c2ae791d-5505-4f62-8588-64f970f0e4a4 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:35 devstack sudo[105790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c2ae791d-5505-4f62-8588-64f970f0e4a4 Jul 10 06:56:35 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:35 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0c14ba89-95bd-420e-b7b3-a1aa1825f1e3 tempest-ProjectReaderTests-1213029343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c2ae791d-5505-4f62-8588-64f970f0e4a4" returned: 0 in 0.605s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:35 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-0c14ba89-95bd-420e-b7b3-a1aa1825f1e3 tempest-ProjectReaderTests-1213029343 None] <== create_volume: return (1424ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:56:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-0c14ba89-95bd-420e-b7b3-a1aa1825f1e3 tempest-ProjectReaderTests-1213029343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.427s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:56:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0c14ba89-95bd-420e-b7b3-a1aa1825f1e3 tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98628f06-1b56-4925-81ef-93b8f962643a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2ae791d-5505-4f62-8588-64f970f0e4a4', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:35 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0c14ba89-95bd-420e-b7b3-a1aa1825f1e3 tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aabc06e1-275f-4ab7-90c4-cb7706873373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:36 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-0c14ba89-95bd-420e-b7b3-a1aa1825f1e3 tempest-ProjectReaderTests-1213029343 None] Volume volume-c2ae791d-5505-4f62-8588-64f970f0e4a4 (c2ae791d-5505-4f62-8588-64f970f0e4a4): created successfully Jul 10 06:56:36 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0c14ba89-95bd-420e-b7b3-a1aa1825f1e3 tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aabc06e1-275f-4ab7-90c4-cb7706873373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:36 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0c14ba89-95bd-420e-b7b3-a1aa1825f1e3 tempest-ProjectReaderTests-1213029343 None] Flow 'volume_create_manager' (a3c11dc8-5b04-429a-97ba-934094a9ea21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:56:36 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-0c14ba89-95bd-420e-b7b3-a1aa1825f1e3 tempest-ProjectReaderTests-1213029343 None] Created volume successfully. Jul 10 06:56:36 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-ff8346ee-6775-407b-b580-00d995a544be tempest-ProjectReaderTests-1213029343 None] Acquiring lock "cinder-c2ae791d-5505-4f62-8588-64f970f0e4a4-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:56:36 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-ff8346ee-6775-407b-b580-00d995a544be tempest-ProjectReaderTests-1213029343 None] Lock "cinder-c2ae791d-5505-4f62-8588-64f970f0e4a4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:56:36 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-ff8346ee-6775-407b-b580-00d995a544be tempest-ProjectReaderTests-1213029343 None] Acquiring lock "cinder-quobyte-c2ae791d-5505-4f62-8588-64f970f0e4a4" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:56:36 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-ff8346ee-6775-407b-b580-00d995a544be tempest-ProjectReaderTests-1213029343 None] Lock "cinder-quobyte-c2ae791d-5505-4f62-8588-64f970f0e4a4" acquired by "delete_volume" :: waited 0.014s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:56:36 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ed98fc-5578-475b-9c93-261b6b440263]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:56:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ff8346ee-6775-407b-b580-00d995a544be tempest-ProjectReaderTests-1213029343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c2ae791d-5505-4f62-8588-64f970f0e4a4 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:36 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c2ae791d-5505-4f62-8588-64f970f0e4a4 Jul 10 06:56:36 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:37 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ff8346ee-6775-407b-b580-00d995a544be tempest-ProjectReaderTests-1213029343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c2ae791d-5505-4f62-8588-64f970f0e4a4" returned: 0 in 0.719s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ff8346ee-6775-407b-b580-00d995a544be tempest-ProjectReaderTests-1213029343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c2ae791d-5505-4f62-8588-64f970f0e4a4 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:37 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c2ae791d-5505-4f62-8588-64f970f0e4a4 Jul 10 06:56:37 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:38 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ff8346ee-6775-407b-b580-00d995a544be tempest-ProjectReaderTests-1213029343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c2ae791d-5505-4f62-8588-64f970f0e4a4" returned: 0 in 0.613s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:38 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-ff8346ee-6775-407b-b580-00d995a544be tempest-ProjectReaderTests-1213029343 None] Lock "cinder-quobyte-c2ae791d-5505-4f62-8588-64f970f0e4a4" released by "delete_volume" :: held 1.367s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:56:38 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-ff8346ee-6775-407b-b580-00d995a544be tempest-ProjectReaderTests-1213029343 None] Created reservations ['fd642064-cb23-4c63-b35b-2ebd2eea4ca5', 'dcee0996-c1ee-4cb6-ab5b-7d0313c79220', '78526237-244f-4bcd-9e14-c947f62d6e9c', '0def1466-5bad-49cf-b397-e4348a2ba88b'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:56:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ff8346ee-6775-407b-b580-00d995a544be tempest-ProjectReaderTests-1213029343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:56:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ff8346ee-6775-407b-b580-00d995a544be tempest-ProjectReaderTests-1213029343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:56:38 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-ff8346ee-6775-407b-b580-00d995a544be tempest-ProjectReaderTests-1213029343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:56:38 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-ff8346ee-6775-407b-b580-00d995a544be tempest-ProjectReaderTests-1213029343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:56:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ff8346ee-6775-407b-b580-00d995a544be tempest-ProjectReaderTests-1213029343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:56:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ff8346ee-6775-407b-b580-00d995a544be tempest-ProjectReaderTests-1213029343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:38 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:56:38 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:38 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ff8346ee-6775-407b-b580-00d995a544be tempest-ProjectReaderTests-1213029343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.608s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:38 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-ff8346ee-6775-407b-b580-00d995a544be tempest-ProjectReaderTests-1213029343 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:56:38 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-ff8346ee-6775-407b-b580-00d995a544be tempest-ProjectReaderTests-1213029343 None] Deleted volume successfully. Jul 10 06:56:38 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-ff8346ee-6775-407b-b580-00d995a544be tempest-ProjectReaderTests-1213029343 None] Lock "cinder-c2ae791d-5505-4f62-8588-64f970f0e4a4-delete_volume" released by "delete_volume" :: held 2.154s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:56:39 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fde3af4-0de5-403e-8c5c-571b447d001c tempest-ProjectReaderTests-1213029343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:56:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9fde3af4-0de5-403e-8c5c-571b447d001c tempest-ProjectReaderTests-1213029343 None] Flow 'volume_create_manager' (17d9469e-7a12-4223-bd40-8be5e50e5d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:56:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9fde3af4-0de5-403e-8c5c-571b447d001c tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a5f1e90-5c3e-4a9d-83ac-6245dcf8d3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9fde3af4-0de5-403e-8c5c-571b447d001c tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a5f1e90-5c3e-4a9d-83ac-6245dcf8d3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2131458040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4a3b0f6-0010-43cd-8876-79a9b7b5ae3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72fbb2c353d946c3b05a1fabf6c653ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:56:39Z,use_quota=True,user_id='c1b64e53413b46da89382ac2050685a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9fde3af4-0de5-403e-8c5c-571b447d001c tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3eccaa0-6d3f-4d43-9546-9d5d544a3528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9fde3af4-0de5-403e-8c5c-571b447d001c tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3eccaa0-6d3f-4d43-9546-9d5d544a3528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9fde3af4-0de5-403e-8c5c-571b447d001c tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fb4f977-3884-444f-8364-98590f98ac8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9fde3af4-0de5-403e-8c5c-571b447d001c tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fb4f977-3884-444f-8364-98590f98ac8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4a3b0f6-0010-43cd-8876-79a9b7b5ae3a', 'volume_name': 'volume-a4a3b0f6-0010-43cd-8876-79a9b7b5ae3a', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9fde3af4-0de5-403e-8c5c-571b447d001c tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e7272a3-3ba0-4d35-8064-5ec429c36952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9fde3af4-0de5-403e-8c5c-571b447d001c tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e7272a3-3ba0-4d35-8064-5ec429c36952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9fde3af4-0de5-403e-8c5c-571b447d001c tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f70e1a6-1d08-443d-be8d-8ac3a67ec652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:39 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-9fde3af4-0de5-403e-8c5c-571b447d001c tempest-ProjectReaderTests-1213029343 None] Volume a4a3b0f6-0010-43cd-8876-79a9b7b5ae3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4a3b0f6-0010-43cd-8876-79a9b7b5ae3a', 'volume_size': 1} Jul 10 06:56:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9fde3af4-0de5-403e-8c5c-571b447d001c tempest-ProjectReaderTests-1213029343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:56:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9fde3af4-0de5-403e-8c5c-571b447d001c tempest-ProjectReaderTests-1213029343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:56:39 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9fde3af4-0de5-403e-8c5c-571b447d001c tempest-ProjectReaderTests-1213029343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2131458040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4a3b0f6-0010-43cd-8876-79a9b7b5ae3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72fbb2c353d946c3b05a1fabf6c653ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:56:39Z,use_quota=True,user_id='c1b64e53413b46da89382ac2050685a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:56:39 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-9fde3af4-0de5-403e-8c5c-571b447d001c tempest-ProjectReaderTests-1213029343 None] Creating volume a4a3b0f6-0010-43cd-8876-79a9b7b5ae3a {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:56:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9fde3af4-0de5-403e-8c5c-571b447d001c tempest-ProjectReaderTests-1213029343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:56:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9fde3af4-0de5-403e-8c5c-571b447d001c tempest-ProjectReaderTests-1213029343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:56:39 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9fde3af4-0de5-403e-8c5c-571b447d001c tempest-ProjectReaderTests-1213029343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:56:39 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9fde3af4-0de5-403e-8c5c-571b447d001c tempest-ProjectReaderTests-1213029343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:56:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9fde3af4-0de5-403e-8c5c-571b447d001c tempest-ProjectReaderTests-1213029343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:56:39 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9fde3af4-0de5-403e-8c5c-571b447d001c tempest-ProjectReaderTests-1213029343 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:56:39 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-9fde3af4-0de5-403e-8c5c-571b447d001c tempest-ProjectReaderTests-1213029343 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:56:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9fde3af4-0de5-403e-8c5c-571b447d001c tempest-ProjectReaderTests-1213029343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4a3b0f6-0010-43cd-8876-79a9b7b5ae3a 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:39 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4a3b0f6-0010-43cd-8876-79a9b7b5ae3a 1073741824 Jul 10 06:56:39 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:40 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9fde3af4-0de5-403e-8c5c-571b447d001c tempest-ProjectReaderTests-1213029343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4a3b0f6-0010-43cd-8876-79a9b7b5ae3a 1073741824" returned: 0 in 0.778s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9fde3af4-0de5-403e-8c5c-571b447d001c tempest-ProjectReaderTests-1213029343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4a3b0f6-0010-43cd-8876-79a9b7b5ae3a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:40 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4a3b0f6-0010-43cd-8876-79a9b7b5ae3a Jul 10 06:56:40 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:40 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9fde3af4-0de5-403e-8c5c-571b447d001c tempest-ProjectReaderTests-1213029343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4a3b0f6-0010-43cd-8876-79a9b7b5ae3a" returned: 0 in 0.658s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:40 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9fde3af4-0de5-403e-8c5c-571b447d001c tempest-ProjectReaderTests-1213029343 None] <== create_volume: return (1473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:56:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9fde3af4-0de5-403e-8c5c-571b447d001c tempest-ProjectReaderTests-1213029343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:56:40 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9fde3af4-0de5-403e-8c5c-571b447d001c tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f70e1a6-1d08-443d-be8d-8ac3a67ec652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4a3b0f6-0010-43cd-8876-79a9b7b5ae3a', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:40 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9fde3af4-0de5-403e-8c5c-571b447d001c tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a62a31da-d2a9-40b0-abc2-dfd201bb5a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:40 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-9fde3af4-0de5-403e-8c5c-571b447d001c tempest-ProjectReaderTests-1213029343 None] Volume volume-a4a3b0f6-0010-43cd-8876-79a9b7b5ae3a (a4a3b0f6-0010-43cd-8876-79a9b7b5ae3a): created successfully Jul 10 06:56:40 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9fde3af4-0de5-403e-8c5c-571b447d001c tempest-ProjectReaderTests-1213029343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a62a31da-d2a9-40b0-abc2-dfd201bb5a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:40 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9fde3af4-0de5-403e-8c5c-571b447d001c tempest-ProjectReaderTests-1213029343 None] Flow 'volume_create_manager' (17d9469e-7a12-4223-bd40-8be5e50e5d27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:56:40 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-9fde3af4-0de5-403e-8c5c-571b447d001c tempest-ProjectReaderTests-1213029343 None] Created volume successfully. Jul 10 06:56:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-736a0d31-63f0-453a-a5c9-5d8422858d52 tempest-ProjectReaderTests-1213029343 None] Acquiring lock "cinder-a4a3b0f6-0010-43cd-8876-79a9b7b5ae3a-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:56:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-736a0d31-63f0-453a-a5c9-5d8422858d52 tempest-ProjectReaderTests-1213029343 None] Lock "cinder-a4a3b0f6-0010-43cd-8876-79a9b7b5ae3a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:56:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-736a0d31-63f0-453a-a5c9-5d8422858d52 tempest-ProjectReaderTests-1213029343 None] Acquiring lock "cinder-quobyte-a4a3b0f6-0010-43cd-8876-79a9b7b5ae3a" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:56:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-736a0d31-63f0-453a-a5c9-5d8422858d52 tempest-ProjectReaderTests-1213029343 None] Lock "cinder-quobyte-a4a3b0f6-0010-43cd-8876-79a9b7b5ae3a" acquired by "delete_volume" :: waited 0.015s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:56:41 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[05442f42-8ca0-4507-8c41-153537f39e70]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:56:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-736a0d31-63f0-453a-a5c9-5d8422858d52 tempest-ProjectReaderTests-1213029343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4a3b0f6-0010-43cd-8876-79a9b7b5ae3a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:41 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4a3b0f6-0010-43cd-8876-79a9b7b5ae3a Jul 10 06:56:41 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:42 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-736a0d31-63f0-453a-a5c9-5d8422858d52 tempest-ProjectReaderTests-1213029343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4a3b0f6-0010-43cd-8876-79a9b7b5ae3a" returned: 0 in 0.742s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-736a0d31-63f0-453a-a5c9-5d8422858d52 tempest-ProjectReaderTests-1213029343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4a3b0f6-0010-43cd-8876-79a9b7b5ae3a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:42 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4a3b0f6-0010-43cd-8876-79a9b7b5ae3a Jul 10 06:56:42 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:42 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-736a0d31-63f0-453a-a5c9-5d8422858d52 tempest-ProjectReaderTests-1213029343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a4a3b0f6-0010-43cd-8876-79a9b7b5ae3a" returned: 0 in 0.619s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-736a0d31-63f0-453a-a5c9-5d8422858d52 tempest-ProjectReaderTests-1213029343 None] Lock "cinder-quobyte-a4a3b0f6-0010-43cd-8876-79a9b7b5ae3a" released by "delete_volume" :: held 1.400s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:56:42 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-736a0d31-63f0-453a-a5c9-5d8422858d52 tempest-ProjectReaderTests-1213029343 None] Created reservations ['65768298-597a-4291-bba6-51de74ae6c4f', '84fb01cd-d78b-4184-9eb8-57031855ea15', '69042b55-8251-4105-8e89-c41794fd8b24', '7535a948-18a9-4107-abf7-9a2da5d33add'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:56:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-736a0d31-63f0-453a-a5c9-5d8422858d52 tempest-ProjectReaderTests-1213029343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:56:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-736a0d31-63f0-453a-a5c9-5d8422858d52 tempest-ProjectReaderTests-1213029343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:56:42 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-736a0d31-63f0-453a-a5c9-5d8422858d52 tempest-ProjectReaderTests-1213029343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:56:42 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-736a0d31-63f0-453a-a5c9-5d8422858d52 tempest-ProjectReaderTests-1213029343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:56:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-736a0d31-63f0-453a-a5c9-5d8422858d52 tempest-ProjectReaderTests-1213029343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:56:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-736a0d31-63f0-453a-a5c9-5d8422858d52 tempest-ProjectReaderTests-1213029343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:42 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:56:42 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:43 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-736a0d31-63f0-453a-a5c9-5d8422858d52 tempest-ProjectReaderTests-1213029343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.623s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:43 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-736a0d31-63f0-453a-a5c9-5d8422858d52 tempest-ProjectReaderTests-1213029343 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:56:43 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-736a0d31-63f0-453a-a5c9-5d8422858d52 tempest-ProjectReaderTests-1213029343 None] Deleted volume successfully. Jul 10 06:56:43 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-736a0d31-63f0-453a-a5c9-5d8422858d52 tempest-ProjectReaderTests-1213029343 None] Lock "cinder-a4a3b0f6-0010-43cd-8876-79a9b7b5ae3a-delete_volume" released by "delete_volume" :: held 2.220s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:56:52 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:SELECT=52,cinder:UPDATE=75,cinder:INSERT=16,cinder:DELETE=6 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:56:53 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:UPDATE=72,cinder:SELECT=51,cinder:DELETE=7,cinder:INSERT=19 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:56:55 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-147ea4d9-66c1-49ad-8480-0b70874fc358 tempest-VolumeDependencyTests-2007432391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:56:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-147ea4d9-66c1-49ad-8480-0b70874fc358 tempest-VolumeDependencyTests-2007432391 None] Flow 'volume_create_manager' (deae78f4-d65a-4b93-9b82-3dbfde63d2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:56:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-147ea4d9-66c1-49ad-8480-0b70874fc358 tempest-VolumeDependencyTests-2007432391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd5b7b06-6d7e-448f-8b3b-e5c2efb6c3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-147ea4d9-66c1-49ad-8480-0b70874fc358 tempest-VolumeDependencyTests-2007432391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd5b7b06-6d7e-448f-8b3b-e5c2efb6c3fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1745601739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dc3c309-8559-4e78-acdb-319f2b220bc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b392bfbf150d4e06b44f0960da1d6a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:56:55Z,use_quota=True,user_id='7666ea9c638b481497289faadae77afd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-147ea4d9-66c1-49ad-8480-0b70874fc358 tempest-VolumeDependencyTests-2007432391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eb2d516-7404-424e-827b-4a333a5744ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-147ea4d9-66c1-49ad-8480-0b70874fc358 tempest-VolumeDependencyTests-2007432391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eb2d516-7404-424e-827b-4a333a5744ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-147ea4d9-66c1-49ad-8480-0b70874fc358 tempest-VolumeDependencyTests-2007432391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85d55215-28a5-4331-9fb9-fd6d022efae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-147ea4d9-66c1-49ad-8480-0b70874fc358 tempest-VolumeDependencyTests-2007432391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85d55215-28a5-4331-9fb9-fd6d022efae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dc3c309-8559-4e78-acdb-319f2b220bc8', 'volume_name': 'volume-6dc3c309-8559-4e78-acdb-319f2b220bc8', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-147ea4d9-66c1-49ad-8480-0b70874fc358 tempest-VolumeDependencyTests-2007432391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55fe8a56-bbfd-4f66-a24d-0d056198fa84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-147ea4d9-66c1-49ad-8480-0b70874fc358 tempest-VolumeDependencyTests-2007432391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55fe8a56-bbfd-4f66-a24d-0d056198fa84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-147ea4d9-66c1-49ad-8480-0b70874fc358 tempest-VolumeDependencyTests-2007432391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c4f7940-93fe-463d-b247-de4e83d56464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:55 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-147ea4d9-66c1-49ad-8480-0b70874fc358 tempest-VolumeDependencyTests-2007432391 None] Volume 6dc3c309-8559-4e78-acdb-319f2b220bc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dc3c309-8559-4e78-acdb-319f2b220bc8', 'volume_size': 1} Jul 10 06:56:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-147ea4d9-66c1-49ad-8480-0b70874fc358 tempest-VolumeDependencyTests-2007432391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:56:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-147ea4d9-66c1-49ad-8480-0b70874fc358 tempest-VolumeDependencyTests-2007432391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:56:55 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-147ea4d9-66c1-49ad-8480-0b70874fc358 tempest-VolumeDependencyTests-2007432391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1745601739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dc3c309-8559-4e78-acdb-319f2b220bc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b392bfbf150d4e06b44f0960da1d6a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:56:55Z,use_quota=True,user_id='7666ea9c638b481497289faadae77afd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:56:55 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-147ea4d9-66c1-49ad-8480-0b70874fc358 tempest-VolumeDependencyTests-2007432391 None] Creating volume 6dc3c309-8559-4e78-acdb-319f2b220bc8 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:56:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-147ea4d9-66c1-49ad-8480-0b70874fc358 tempest-VolumeDependencyTests-2007432391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:56:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-147ea4d9-66c1-49ad-8480-0b70874fc358 tempest-VolumeDependencyTests-2007432391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:56:55 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-147ea4d9-66c1-49ad-8480-0b70874fc358 tempest-VolumeDependencyTests-2007432391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:56:55 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-147ea4d9-66c1-49ad-8480-0b70874fc358 tempest-VolumeDependencyTests-2007432391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:56:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-147ea4d9-66c1-49ad-8480-0b70874fc358 tempest-VolumeDependencyTests-2007432391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:56:55 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-147ea4d9-66c1-49ad-8480-0b70874fc358 tempest-VolumeDependencyTests-2007432391 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:56:55 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-147ea4d9-66c1-49ad-8480-0b70874fc358 tempest-VolumeDependencyTests-2007432391 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:56:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-147ea4d9-66c1-49ad-8480-0b70874fc358 tempest-VolumeDependencyTests-2007432391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:55 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8 1073741824 Jul 10 06:56:55 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:55 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9885af5-222c-41bd-9362-8cb89a0e4485 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:56:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e9885af5-222c-41bd-9362-8cb89a0e4485 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Flow 'volume_create_manager' (ea87a9b5-b44b-48e3-9204-810a0feab4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:56:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e9885af5-222c-41bd-9362-8cb89a0e4485 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88a7d0f3-af7c-48e1-b06c-fab5a6bbb939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e9885af5-222c-41bd-9362-8cb89a0e4485 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88a7d0f3-af7c-48e1-b06c-fab5a6bbb939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1027518533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=090a5e06-3c74-4824-90cb-006cc53a55bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f646c4fdb4d74c3c99368db448a41505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:56:55Z,use_quota=True,user_id='d12f423193ad41cb9a4d7c7156fa97a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e9885af5-222c-41bd-9362-8cb89a0e4485 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0b309c1-7c63-4a73-ae17-51ef078bbd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e9885af5-222c-41bd-9362-8cb89a0e4485 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0b309c1-7c63-4a73-ae17-51ef078bbd38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e9885af5-222c-41bd-9362-8cb89a0e4485 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de8870a6-e30c-4a7e-9cd6-34935f66b6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e9885af5-222c-41bd-9362-8cb89a0e4485 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de8870a6-e30c-4a7e-9cd6-34935f66b6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '090a5e06-3c74-4824-90cb-006cc53a55bd', 'volume_name': 'volume-090a5e06-3c74-4824-90cb-006cc53a55bd', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e9885af5-222c-41bd-9362-8cb89a0e4485 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f4de01b-5c49-48ca-90ec-673a9d781bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e9885af5-222c-41bd-9362-8cb89a0e4485 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f4de01b-5c49-48ca-90ec-673a9d781bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e9885af5-222c-41bd-9362-8cb89a0e4485 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ad9f530-f4b6-4785-a04c-94ee205da79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:55 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-e9885af5-222c-41bd-9362-8cb89a0e4485 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Volume 090a5e06-3c74-4824-90cb-006cc53a55bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-090a5e06-3c74-4824-90cb-006cc53a55bd', 'volume_size': 1} Jul 10 06:56:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e9885af5-222c-41bd-9362-8cb89a0e4485 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:56:55 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-74b537c2-8c3e-4e2b-9e0b-4ff8785b1400 tempest-CreateVolumesFromImageTest-1630141042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:56:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-74b537c2-8c3e-4e2b-9e0b-4ff8785b1400 tempest-CreateVolumesFromImageTest-1630141042 None] Flow 'volume_create_manager' (86ca2067-fb0b-46d5-a1fb-66e310644b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:56:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-74b537c2-8c3e-4e2b-9e0b-4ff8785b1400 tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3b97fa8-ccbc-4489-939b-4b75b7725d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-74b537c2-8c3e-4e2b-9e0b-4ff8785b1400 tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3b97fa8-ccbc-4489-939b-4b75b7725d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-843798726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53bb2923-0160-4718-b7d6-d6e7b0474d80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39ea8db51af24b4884e02266d0f086d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:56:56Z,use_quota=True,user_id='b805ec2a40144001ab202051c278c2eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-74b537c2-8c3e-4e2b-9e0b-4ff8785b1400 tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b02f6449-081f-4225-8044-640e4b949745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-74b537c2-8c3e-4e2b-9e0b-4ff8785b1400 tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b02f6449-081f-4225-8044-640e4b949745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-74b537c2-8c3e-4e2b-9e0b-4ff8785b1400 tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (081268d7-1381-4c74-869c-93c8f32521ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-74b537c2-8c3e-4e2b-9e0b-4ff8785b1400 tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (081268d7-1381-4c74-869c-93c8f32521ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53bb2923-0160-4718-b7d6-d6e7b0474d80', 'volume_name': 'volume-53bb2923-0160-4718-b7d6-d6e7b0474d80', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-74b537c2-8c3e-4e2b-9e0b-4ff8785b1400 tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff007441-e4f9-4304-ac4b-abf4bb4e6240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-74b537c2-8c3e-4e2b-9e0b-4ff8785b1400 tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff007441-e4f9-4304-ac4b-abf4bb4e6240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-74b537c2-8c3e-4e2b-9e0b-4ff8785b1400 tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96e2ee30-3e6d-4d84-b75a-d146e877c54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:55 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-74b537c2-8c3e-4e2b-9e0b-4ff8785b1400 tempest-CreateVolumesFromImageTest-1630141042 None] Volume 53bb2923-0160-4718-b7d6-d6e7b0474d80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53bb2923-0160-4718-b7d6-d6e7b0474d80', 'volume_size': 1} Jul 10 06:56:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-74b537c2-8c3e-4e2b-9e0b-4ff8785b1400 tempest-CreateVolumesFromImageTest-1630141042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:56:56 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-147ea4d9-66c1-49ad-8480-0b70874fc358 tempest-VolumeDependencyTests-2007432391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8 1073741824" returned: 0 in 1.047s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:56 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-18f402f7-b18a-4d3d-831b-72b2d12b94f1 tempest-CreateVolumesFromImageTest-1630141042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:56:56 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-18f402f7-b18a-4d3d-831b-72b2d12b94f1 tempest-CreateVolumesFromImageTest-1630141042 None] Flow 'volume_create_manager' (9b4a5bb8-52a7-4eb5-8768-c374da330434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:56:56 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-18f402f7-b18a-4d3d-831b-72b2d12b94f1 tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7758ef54-7e7f-4805-9427-918a49aaa81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-147ea4d9-66c1-49ad-8480-0b70874fc358 tempest-VolumeDependencyTests-2007432391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:56 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-18f402f7-b18a-4d3d-831b-72b2d12b94f1 tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7758ef54-7e7f-4805-9427-918a49aaa81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2070222745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=761b9567-b311-4c77-8626-02d744715fe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39ea8db51af24b4884e02266d0f086d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:56:56Z,use_quota=True,user_id='b805ec2a40144001ab202051c278c2eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:56 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-18f402f7-b18a-4d3d-831b-72b2d12b94f1 tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (873bee93-fab0-4c8f-b6bf-ec35bb5e5b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:56 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-18f402f7-b18a-4d3d-831b-72b2d12b94f1 tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (873bee93-fab0-4c8f-b6bf-ec35bb5e5b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:56 devstack sudo[105869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8 Jul 10 06:56:56 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:56 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-18f402f7-b18a-4d3d-831b-72b2d12b94f1 tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (035d11fc-8826-42f7-8639-1c12bccf6fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:56 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-18f402f7-b18a-4d3d-831b-72b2d12b94f1 tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (035d11fc-8826-42f7-8639-1c12bccf6fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '761b9567-b311-4c77-8626-02d744715fe0', 'volume_name': 'volume-761b9567-b311-4c77-8626-02d744715fe0', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:56 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-18f402f7-b18a-4d3d-831b-72b2d12b94f1 tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72c1bc1c-de10-4879-986b-49fd4478d973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:56 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-18f402f7-b18a-4d3d-831b-72b2d12b94f1 tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72c1bc1c-de10-4879-986b-49fd4478d973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:56 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-18f402f7-b18a-4d3d-831b-72b2d12b94f1 tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfb6c701-231d-45e6-a25b-77da187609ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:56 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-18f402f7-b18a-4d3d-831b-72b2d12b94f1 tempest-CreateVolumesFromImageTest-1630141042 None] Volume 761b9567-b311-4c77-8626-02d744715fe0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-761b9567-b311-4c77-8626-02d744715fe0', 'volume_size': 1} Jul 10 06:56:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-18f402f7-b18a-4d3d-831b-72b2d12b94f1 tempest-CreateVolumesFromImageTest-1630141042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:56:56 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcaf46cb-c7bb-4532-bc61-86f7d28da35f tempest-CreateVolumesFromImageTest-1630141042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:56:56 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dcaf46cb-c7bb-4532-bc61-86f7d28da35f tempest-CreateVolumesFromImageTest-1630141042 None] Flow 'volume_create_manager' (5dc4d661-5537-4470-a0c1-2696351f8445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:56:56 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dcaf46cb-c7bb-4532-bc61-86f7d28da35f tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af18ef84-7fab-4060-88ff-e490a1e9f378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:56 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dcaf46cb-c7bb-4532-bc61-86f7d28da35f tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af18ef84-7fab-4060-88ff-e490a1e9f378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-22549694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81c5ec98-9a29-4339-8994-4b9cda98e824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39ea8db51af24b4884e02266d0f086d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:56:57Z,use_quota=True,user_id='b805ec2a40144001ab202051c278c2eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:56 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dcaf46cb-c7bb-4532-bc61-86f7d28da35f tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6de4098c-5fdc-4c91-8e75-a31d3d7fbdc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:56 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dcaf46cb-c7bb-4532-bc61-86f7d28da35f tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6de4098c-5fdc-4c91-8e75-a31d3d7fbdc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:56 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dcaf46cb-c7bb-4532-bc61-86f7d28da35f tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (631b7f6f-b244-4666-b0bb-68b055cd882b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:56 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dcaf46cb-c7bb-4532-bc61-86f7d28da35f tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (631b7f6f-b244-4666-b0bb-68b055cd882b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81c5ec98-9a29-4339-8994-4b9cda98e824', 'volume_name': 'volume-81c5ec98-9a29-4339-8994-4b9cda98e824', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:56 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dcaf46cb-c7bb-4532-bc61-86f7d28da35f tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3df76f4b-0425-4624-ac0e-b67a062b9591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:56 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dcaf46cb-c7bb-4532-bc61-86f7d28da35f tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3df76f4b-0425-4624-ac0e-b67a062b9591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:56 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dcaf46cb-c7bb-4532-bc61-86f7d28da35f tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b492f17-a31a-41cf-9a1a-58637247c7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:56 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-dcaf46cb-c7bb-4532-bc61-86f7d28da35f tempest-CreateVolumesFromImageTest-1630141042 None] Volume 81c5ec98-9a29-4339-8994-4b9cda98e824: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81c5ec98-9a29-4339-8994-4b9cda98e824', 'volume_size': 1} Jul 10 06:56:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-dcaf46cb-c7bb-4532-bc61-86f7d28da35f tempest-CreateVolumesFromImageTest-1630141042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:56:57 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-39ba6fed-378a-4803-8d8e-dde995584b9c tempest-CreateVolumesFromImageTest-1630141042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:56:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-39ba6fed-378a-4803-8d8e-dde995584b9c tempest-CreateVolumesFromImageTest-1630141042 None] Flow 'volume_create_manager' (df845c2c-22ec-4388-8853-48fb8e25c6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:56:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-39ba6fed-378a-4803-8d8e-dde995584b9c tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d344b5e-9036-441a-a74d-9491eb12dd9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-39ba6fed-378a-4803-8d8e-dde995584b9c tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d344b5e-9036-441a-a74d-9491eb12dd9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1037043478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29f97347-416b-45f7-b773-4fd797eeb78d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39ea8db51af24b4884e02266d0f086d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:56:57Z,use_quota=True,user_id='b805ec2a40144001ab202051c278c2eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-39ba6fed-378a-4803-8d8e-dde995584b9c tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d60516-f6f2-43d7-ac90-389902a2e590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-39ba6fed-378a-4803-8d8e-dde995584b9c tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d60516-f6f2-43d7-ac90-389902a2e590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-39ba6fed-378a-4803-8d8e-dde995584b9c tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bbe0bda-b805-4de7-8a77-8b4262f05ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-39ba6fed-378a-4803-8d8e-dde995584b9c tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bbe0bda-b805-4de7-8a77-8b4262f05ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29f97347-416b-45f7-b773-4fd797eeb78d', 'volume_name': 'volume-29f97347-416b-45f7-b773-4fd797eeb78d', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-39ba6fed-378a-4803-8d8e-dde995584b9c tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9e4fadb-c8d5-4617-b76a-10976ce72dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:57 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-39ba6fed-378a-4803-8d8e-dde995584b9c tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9e4fadb-c8d5-4617-b76a-10976ce72dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-39ba6fed-378a-4803-8d8e-dde995584b9c tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5029c3d-f7a9-4de5-8d79-57a689b87500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:57 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-39ba6fed-378a-4803-8d8e-dde995584b9c tempest-CreateVolumesFromImageTest-1630141042 None] Volume 29f97347-416b-45f7-b773-4fd797eeb78d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29f97347-416b-45f7-b773-4fd797eeb78d', 'volume_size': 1} Jul 10 06:56:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-39ba6fed-378a-4803-8d8e-dde995584b9c tempest-CreateVolumesFromImageTest-1630141042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:56:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-147ea4d9-66c1-49ad-8480-0b70874fc358 tempest-VolumeDependencyTests-2007432391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8" returned: 0 in 0.886s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:57 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-147ea4d9-66c1-49ad-8480-0b70874fc358 tempest-VolumeDependencyTests-2007432391 None] <== create_volume: return (2029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:56:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-147ea4d9-66c1-49ad-8480-0b70874fc358 tempest-VolumeDependencyTests-2007432391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.031s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:56:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e9885af5-222c-41bd-9362-8cb89a0e4485 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.822s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:56:57 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-e9885af5-222c-41bd-9362-8cb89a0e4485 tempest-CreateVolumesFromSnapshotTest-2117965649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1027518533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=090a5e06-3c74-4824-90cb-006cc53a55bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f646c4fdb4d74c3c99368db448a41505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:56:55Z,use_quota=True,user_id='d12f423193ad41cb9a4d7c7156fa97a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:56:57 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-e9885af5-222c-41bd-9362-8cb89a0e4485 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Creating volume 090a5e06-3c74-4824-90cb-006cc53a55bd {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:56:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e9885af5-222c-41bd-9362-8cb89a0e4485 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:56:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e9885af5-222c-41bd-9362-8cb89a0e4485 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:56:57 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-e9885af5-222c-41bd-9362-8cb89a0e4485 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:56:57 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-e9885af5-222c-41bd-9362-8cb89a0e4485 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:56:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e9885af5-222c-41bd-9362-8cb89a0e4485 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:56:57 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-e9885af5-222c-41bd-9362-8cb89a0e4485 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:56:57 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-e9885af5-222c-41bd-9362-8cb89a0e4485 tempest-CreateVolumesFromSnapshotTest-2117965649 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:56:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e9885af5-222c-41bd-9362-8cb89a0e4485 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-147ea4d9-66c1-49ad-8480-0b70874fc358 tempest-VolumeDependencyTests-2007432391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c4f7940-93fe-463d-b247-de4e83d56464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dc3c309-8559-4e78-acdb-319f2b220bc8', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:57 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd 1073741824 Jul 10 06:56:57 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-147ea4d9-66c1-49ad-8480-0b70874fc358 tempest-VolumeDependencyTests-2007432391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c8fdfa-4cf0-40d9-9e76-2632c6f9146a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:57 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-147ea4d9-66c1-49ad-8480-0b70874fc358 tempest-VolumeDependencyTests-2007432391 None] Volume volume-6dc3c309-8559-4e78-acdb-319f2b220bc8 (6dc3c309-8559-4e78-acdb-319f2b220bc8): created successfully Jul 10 06:56:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-147ea4d9-66c1-49ad-8480-0b70874fc358 tempest-VolumeDependencyTests-2007432391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c8fdfa-4cf0-40d9-9e76-2632c6f9146a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-147ea4d9-66c1-49ad-8480-0b70874fc358 tempest-VolumeDependencyTests-2007432391 None] Flow 'volume_create_manager' (deae78f4-d65a-4b93-9b82-3dbfde63d2f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:56:57 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-147ea4d9-66c1-49ad-8480-0b70874fc358 tempest-VolumeDependencyTests-2007432391 None] Created volume successfully. Jul 10 06:56:57 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-09700e55-53ea-4ba1-b3a1-ac4021c75b91 tempest-CreateVolumesFromImageTest-1630141042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:56:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-09700e55-53ea-4ba1-b3a1-ac4021c75b91 tempest-CreateVolumesFromImageTest-1630141042 None] Flow 'volume_create_manager' (1d6c6755-a3c8-4356-a03d-32e1de233b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:56:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-09700e55-53ea-4ba1-b3a1-ac4021c75b91 tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edead6a0-9d73-482b-9301-1a05b0083519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-09700e55-53ea-4ba1-b3a1-ac4021c75b91 tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edead6a0-9d73-482b-9301-1a05b0083519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-627497946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=571b5f99-7333-4bb3-aceb-657e01109729,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39ea8db51af24b4884e02266d0f086d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:56:57Z,use_quota=True,user_id='b805ec2a40144001ab202051c278c2eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-09700e55-53ea-4ba1-b3a1-ac4021c75b91 tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c292adcd-6fb2-4ee6-9f34-6a6152679e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-09700e55-53ea-4ba1-b3a1-ac4021c75b91 tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c292adcd-6fb2-4ee6-9f34-6a6152679e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-09700e55-53ea-4ba1-b3a1-ac4021c75b91 tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f53b0f4e-54f6-4b2c-a168-e5245a2fab57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-09700e55-53ea-4ba1-b3a1-ac4021c75b91 tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f53b0f4e-54f6-4b2c-a168-e5245a2fab57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '571b5f99-7333-4bb3-aceb-657e01109729', 'volume_name': 'volume-571b5f99-7333-4bb3-aceb-657e01109729', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-09700e55-53ea-4ba1-b3a1-ac4021c75b91 tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc95268d-8d5a-4d5a-800b-e6af4c519ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-09700e55-53ea-4ba1-b3a1-ac4021c75b91 tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc95268d-8d5a-4d5a-800b-e6af4c519ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-09700e55-53ea-4ba1-b3a1-ac4021c75b91 tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7787c1c-c6df-4b05-ac89-770cce2e7f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:57 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-09700e55-53ea-4ba1-b3a1-ac4021c75b91 tempest-CreateVolumesFromImageTest-1630141042 None] Volume 571b5f99-7333-4bb3-aceb-657e01109729: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-571b5f99-7333-4bb3-aceb-657e01109729', 'volume_size': 1} Jul 10 06:56:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-09700e55-53ea-4ba1-b3a1-ac4021c75b91 tempest-CreateVolumesFromImageTest-1630141042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:56:58 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e9885af5-222c-41bd-9362-8cb89a0e4485 tempest-CreateVolumesFromSnapshotTest-2117965649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd 1073741824" returned: 0 in 0.920s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e9885af5-222c-41bd-9362-8cb89a0e4485 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:58 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd Jul 10 06:56:58 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2840d409-231c-48d9-a13b-c81ed7b5b616 tempest-VolumeDependencyTests-2007432391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:56:58 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e9885af5-222c-41bd-9362-8cb89a0e4485 tempest-CreateVolumesFromSnapshotTest-2117965649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd" returned: 0 in 0.769s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:58 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-e9885af5-222c-41bd-9362-8cb89a0e4485 tempest-CreateVolumesFromSnapshotTest-2117965649 None] <== create_volume: return (1738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:56:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e9885af5-222c-41bd-9362-8cb89a0e4485 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.742s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:56:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-74b537c2-8c3e-4e2b-9e0b-4ff8785b1400 tempest-CreateVolumesFromImageTest-1630141042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.991s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:56:58 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-74b537c2-8c3e-4e2b-9e0b-4ff8785b1400 tempest-CreateVolumesFromImageTest-1630141042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-843798726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53bb2923-0160-4718-b7d6-d6e7b0474d80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39ea8db51af24b4884e02266d0f086d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:56:56Z,use_quota=True,user_id='b805ec2a40144001ab202051c278c2eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:56:58 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-74b537c2-8c3e-4e2b-9e0b-4ff8785b1400 tempest-CreateVolumesFromImageTest-1630141042 None] Creating volume 53bb2923-0160-4718-b7d6-d6e7b0474d80 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:56:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-74b537c2-8c3e-4e2b-9e0b-4ff8785b1400 tempest-CreateVolumesFromImageTest-1630141042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:56:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-74b537c2-8c3e-4e2b-9e0b-4ff8785b1400 tempest-CreateVolumesFromImageTest-1630141042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:56:58 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-74b537c2-8c3e-4e2b-9e0b-4ff8785b1400 tempest-CreateVolumesFromImageTest-1630141042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:56:58 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-74b537c2-8c3e-4e2b-9e0b-4ff8785b1400 tempest-CreateVolumesFromImageTest-1630141042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:56:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-74b537c2-8c3e-4e2b-9e0b-4ff8785b1400 tempest-CreateVolumesFromImageTest-1630141042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:56:58 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-74b537c2-8c3e-4e2b-9e0b-4ff8785b1400 tempest-CreateVolumesFromImageTest-1630141042 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:56:58 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-74b537c2-8c3e-4e2b-9e0b-4ff8785b1400 tempest-CreateVolumesFromImageTest-1630141042 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:56:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-74b537c2-8c3e-4e2b-9e0b-4ff8785b1400 tempest-CreateVolumesFromImageTest-1630141042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-53bb2923-0160-4718-b7d6-d6e7b0474d80 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:58 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-53bb2923-0160-4718-b7d6-d6e7b0474d80 1073741824 Jul 10 06:56:58 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:58 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e9885af5-222c-41bd-9362-8cb89a0e4485 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ad9f530-f4b6-4785-a04c-94ee205da79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-090a5e06-3c74-4824-90cb-006cc53a55bd', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:58 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e9885af5-222c-41bd-9362-8cb89a0e4485 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eb019d6-d025-4cdf-bbc8-967ca4356454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:58 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-e9885af5-222c-41bd-9362-8cb89a0e4485 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Volume volume-090a5e06-3c74-4824-90cb-006cc53a55bd (090a5e06-3c74-4824-90cb-006cc53a55bd): created successfully Jul 10 06:56:58 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e9885af5-222c-41bd-9362-8cb89a0e4485 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eb019d6-d025-4cdf-bbc8-967ca4356454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:58 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-e9885af5-222c-41bd-9362-8cb89a0e4485 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Flow 'volume_create_manager' (ea87a9b5-b44b-48e3-9204-810a0feab4a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:56:58 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-e9885af5-222c-41bd-9362-8cb89a0e4485 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Created volume successfully. Jul 10 06:56:59 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:56:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Flow 'volume_create_manager' (406ba652-388a-4e05-8a8a-18aaea771366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:56:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75360a8e-48f4-4c74-8533-8baf11dc9a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75360a8e-48f4-4c74-8533-8baf11dc9a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=433528f5-09d7-47b6-b929-0245291bf28a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eeda33d434244d59e5c6875c0cb0fa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:56:59Z,use_quota=True,user_id='98f85848aa5c4889b58fb61d02c62d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(424349b9-d3ea-43b8-bf40-3a61827805f8),volume_type_id=424349b9-d3ea-43b8-bf40-3a61827805f8)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77feee48-496d-459e-acb8-38e5cdc624c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77feee48-496d-459e-acb8-38e5cdc624c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3646aea7-242f-4e20-a6b5-0ad1878cc78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:59 devstack cinder-volume[87294]: DEBUG cinder.image.glance [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Creating Keystone auth plugin from conf {{(pid=87294) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 06:56:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3646aea7-242f-4e20-a6b5-0ad1878cc78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '433528f5-09d7-47b6-b929-0245291bf28a', 'volume_name': 'volume-433528f5-09d7-47b6-b929-0245291bf28a', 'volume_size': 1, 'image_id': '6cff4975-1365-4848-b503-a78b9b3a92c5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6cff4975-1365-4848-b503-a78b9b3a92c5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '757a46f868fb5e5bfd0d54aead2b71df', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2eeda33d434244d59e5c6875c0cb0fa8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fc42db8407b153291ac6109309838faaeb439562e83413998a246730dab70810cc6ab2fd46ed3b3c0e45a4a94286a36153028b83da66f564a41fd98eb2e0dc1a', 'id': '6cff4975-1365-4848-b503-a78b9b3a92c5', 'created_at': datetime.datetime(2026, 7, 10, 4, 56, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 56, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6cff4975-1365-4848-b503-a78b9b3a92c5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1841c11d-a93f-4dea-a369-e7d26e0725be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1841c11d-a93f-4dea-a369-e7d26e0725be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:56:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa99fdbb-6f29-4941-a557-a2b0793dd536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:56:59 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Volume 433528f5-09d7-47b6-b929-0245291bf28a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-433528f5-09d7-47b6-b929-0245291bf28a', 'volume_size': 1, 'image_id': '6cff4975-1365-4848-b503-a78b9b3a92c5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6cff4975-1365-4848-b503-a78b9b3a92c5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '757a46f868fb5e5bfd0d54aead2b71df', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2eeda33d434244d59e5c6875c0cb0fa8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fc42db8407b153291ac6109309838faaeb439562e83413998a246730dab70810cc6ab2fd46ed3b3c0e45a4a94286a36153028b83da66f564a41fd98eb2e0dc1a', 'id': '6cff4975-1365-4848-b503-a78b9b3a92c5', 'created_at': datetime.datetime(2026, 7, 10, 4, 56, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 56, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6cff4975-1365-4848-b503-a78b9b3a92c5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 10 06:56:59 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Trying to clone 433528f5-09d7-47b6-b929-0245291bf28a from image 6cff4975-1365-4848-b503-a78b9b3a92c5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6cff4975-1365-4848-b503-a78b9b3a92c5', 'metadata': {}}]). {{(pid=87294) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 06:56:59 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6cff4975-1365-4848-b503-a78b9b3a92c5_n5uaxwoadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87294) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 06:56:59 devstack cinder-volume[87294]: INFO cinder.image.image_utils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Image download 0.00 MB at 0.00 MB/s Jul 10 06:56:59 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c66fc7-cee0-457a-9c6b-8421207b687a]: (4, 'raw') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:56:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6cff4975-1365-4848-b503-a78b9b3a92c5_n5uaxwoadevstack@QuobyteHD {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-8b8e3b4f-0771-476d-bcfc-c6d6aaed50b3 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:56:59 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6cff4975-1365-4848-b503-a78b9b3a92c5_n5uaxwoadevstack@QuobyteHD Jul 10 06:56:59 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:56:59 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Jul 10 06:56:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-74b537c2-8c3e-4e2b-9e0b-4ff8785b1400 tempest-CreateVolumesFromImageTest-1630141042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-53bb2923-0160-4718-b7d6-d6e7b0474d80 1073741824" returned: 0 in 0.993s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:56:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-74b537c2-8c3e-4e2b-9e0b-4ff8785b1400 tempest-CreateVolumesFromImageTest-1630141042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-53bb2923-0160-4718-b7d6-d6e7b0474d80 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:56:59 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-53bb2923-0160-4718-b7d6-d6e7b0474d80 Jul 10 06:56:59 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:00 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6cff4975-1365-4848-b503-a78b9b3a92c5_n5uaxwoadevstack@QuobyteHD" returned: 0 in 0.760s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6cff4975-1365-4848-b503-a78b9b3a92c5_n5uaxwoadevstack@QuobyteHD {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:00 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6cff4975-1365-4848-b503-a78b9b3a92c5_n5uaxwoadevstack@QuobyteHD Jul 10 06:57:00 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:00 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-74b537c2-8c3e-4e2b-9e0b-4ff8785b1400 tempest-CreateVolumesFromImageTest-1630141042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-53bb2923-0160-4718-b7d6-d6e7b0474d80" returned: 0 in 0.659s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:00 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-74b537c2-8c3e-4e2b-9e0b-4ff8785b1400 tempest-CreateVolumesFromImageTest-1630141042 None] <== create_volume: return (1701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:57:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-74b537c2-8c3e-4e2b-9e0b-4ff8785b1400 tempest-CreateVolumesFromImageTest-1630141042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.705s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-18f402f7-b18a-4d3d-831b-72b2d12b94f1 tempest-CreateVolumesFromImageTest-1630141042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.268s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:00 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-18f402f7-b18a-4d3d-831b-72b2d12b94f1 tempest-CreateVolumesFromImageTest-1630141042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2070222745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=761b9567-b311-4c77-8626-02d744715fe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39ea8db51af24b4884e02266d0f086d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:56:56Z,use_quota=True,user_id='b805ec2a40144001ab202051c278c2eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:57:00 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-18f402f7-b18a-4d3d-831b-72b2d12b94f1 tempest-CreateVolumesFromImageTest-1630141042 None] Creating volume 761b9567-b311-4c77-8626-02d744715fe0 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:57:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-18f402f7-b18a-4d3d-831b-72b2d12b94f1 tempest-CreateVolumesFromImageTest-1630141042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-18f402f7-b18a-4d3d-831b-72b2d12b94f1 tempest-CreateVolumesFromImageTest-1630141042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:00 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-18f402f7-b18a-4d3d-831b-72b2d12b94f1 tempest-CreateVolumesFromImageTest-1630141042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:57:00 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-18f402f7-b18a-4d3d-831b-72b2d12b94f1 tempest-CreateVolumesFromImageTest-1630141042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:57:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-18f402f7-b18a-4d3d-831b-72b2d12b94f1 tempest-CreateVolumesFromImageTest-1630141042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:00 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-18f402f7-b18a-4d3d-831b-72b2d12b94f1 tempest-CreateVolumesFromImageTest-1630141042 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:57:00 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-18f402f7-b18a-4d3d-831b-72b2d12b94f1 tempest-CreateVolumesFromImageTest-1630141042 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:57:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-18f402f7-b18a-4d3d-831b-72b2d12b94f1 tempest-CreateVolumesFromImageTest-1630141042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-761b9567-b311-4c77-8626-02d744715fe0 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:00 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-761b9567-b311-4c77-8626-02d744715fe0 1073741824 Jul 10 06:57:00 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:00 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-74b537c2-8c3e-4e2b-9e0b-4ff8785b1400 tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96e2ee30-3e6d-4d84-b75a-d146e877c54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53bb2923-0160-4718-b7d6-d6e7b0474d80', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:00 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-74b537c2-8c3e-4e2b-9e0b-4ff8785b1400 tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a0539b9-a941-4331-8ce6-7426c0373fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:00 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-74b537c2-8c3e-4e2b-9e0b-4ff8785b1400 tempest-CreateVolumesFromImageTest-1630141042 None] Volume volume-53bb2923-0160-4718-b7d6-d6e7b0474d80 (53bb2923-0160-4718-b7d6-d6e7b0474d80): created successfully Jul 10 06:57:00 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-74b537c2-8c3e-4e2b-9e0b-4ff8785b1400 tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a0539b9-a941-4331-8ce6-7426c0373fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:00 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-74b537c2-8c3e-4e2b-9e0b-4ff8785b1400 tempest-CreateVolumesFromImageTest-1630141042 None] Flow 'volume_create_manager' (86ca2067-fb0b-46d5-a1fb-66e310644b7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:00 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-74b537c2-8c3e-4e2b-9e0b-4ff8785b1400 tempest-CreateVolumesFromImageTest-1630141042 None] Created volume successfully. Jul 10 06:57:01 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6cff4975-1365-4848-b503-a78b9b3a92c5_n5uaxwoadevstack@QuobyteHD" returned: 1 in 0.748s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6cff4975-1365-4848-b503-a78b9b3a92c5_n5uaxwoadevstack@QuobyteHD' failed. Not Retrying. {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:57:01 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Temporary image 6cff4975-1365-4848-b503-a78b9b3a92c5 is fetched for user 98f85848aa5c4889b58fb61d02c62d49. {{(pid=87294) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 06:57:01 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[9582de70-cbff-4a2e-9514-f191c20984ed]: (4, 'raw') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:57:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6cff4975-1365-4848-b503-a78b9b3a92c5_n5uaxwoadevstack@QuobyteHD {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:01 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6cff4975-1365-4848-b503-a78b9b3a92c5_n5uaxwoadevstack@QuobyteHD Jul 10 06:57:01 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:01 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-18f402f7-b18a-4d3d-831b-72b2d12b94f1 tempest-CreateVolumesFromImageTest-1630141042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-761b9567-b311-4c77-8626-02d744715fe0 1073741824" returned: 0 in 0.870s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-18f402f7-b18a-4d3d-831b-72b2d12b94f1 tempest-CreateVolumesFromImageTest-1630141042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-761b9567-b311-4c77-8626-02d744715fe0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:01 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-761b9567-b311-4c77-8626-02d744715fe0 Jul 10 06:57:01 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:01 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6cff4975-1365-4848-b503-a78b9b3a92c5_n5uaxwoadevstack@QuobyteHD" returned: 0 in 0.734s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6cff4975-1365-4848-b503-a78b9b3a92c5_n5uaxwoadevstack@QuobyteHD {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:01 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6cff4975-1365-4848-b503-a78b9b3a92c5_n5uaxwoadevstack@QuobyteHD Jul 10 06:57:01 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:02 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-18f402f7-b18a-4d3d-831b-72b2d12b94f1 tempest-CreateVolumesFromImageTest-1630141042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-761b9567-b311-4c77-8626-02d744715fe0" returned: 0 in 0.610s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:02 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-18f402f7-b18a-4d3d-831b-72b2d12b94f1 tempest-CreateVolumesFromImageTest-1630141042 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:57:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-18f402f7-b18a-4d3d-831b-72b2d12b94f1 tempest-CreateVolumesFromImageTest-1630141042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-dcaf46cb-c7bb-4532-bc61-86f7d28da35f tempest-CreateVolumesFromImageTest-1630141042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.406s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:02 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-dcaf46cb-c7bb-4532-bc61-86f7d28da35f tempest-CreateVolumesFromImageTest-1630141042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-22549694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81c5ec98-9a29-4339-8994-4b9cda98e824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39ea8db51af24b4884e02266d0f086d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:56:57Z,use_quota=True,user_id='b805ec2a40144001ab202051c278c2eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:57:02 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-dcaf46cb-c7bb-4532-bc61-86f7d28da35f tempest-CreateVolumesFromImageTest-1630141042 None] Creating volume 81c5ec98-9a29-4339-8994-4b9cda98e824 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:57:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-dcaf46cb-c7bb-4532-bc61-86f7d28da35f tempest-CreateVolumesFromImageTest-1630141042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-dcaf46cb-c7bb-4532-bc61-86f7d28da35f tempest-CreateVolumesFromImageTest-1630141042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:02 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-dcaf46cb-c7bb-4532-bc61-86f7d28da35f tempest-CreateVolumesFromImageTest-1630141042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:57:02 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-dcaf46cb-c7bb-4532-bc61-86f7d28da35f tempest-CreateVolumesFromImageTest-1630141042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:57:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-dcaf46cb-c7bb-4532-bc61-86f7d28da35f tempest-CreateVolumesFromImageTest-1630141042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:02 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-dcaf46cb-c7bb-4532-bc61-86f7d28da35f tempest-CreateVolumesFromImageTest-1630141042 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:57:02 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-dcaf46cb-c7bb-4532-bc61-86f7d28da35f tempest-CreateVolumesFromImageTest-1630141042 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:57:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-dcaf46cb-c7bb-4532-bc61-86f7d28da35f tempest-CreateVolumesFromImageTest-1630141042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-81c5ec98-9a29-4339-8994-4b9cda98e824 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:02 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-81c5ec98-9a29-4339-8994-4b9cda98e824 1073741824 Jul 10 06:57:02 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:02 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-18f402f7-b18a-4d3d-831b-72b2d12b94f1 tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfb6c701-231d-45e6-a25b-77da187609ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-761b9567-b311-4c77-8626-02d744715fe0', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:02 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-18f402f7-b18a-4d3d-831b-72b2d12b94f1 tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0ad0794-0033-4ba9-84a1-57a2c1bd8b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:02 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-18f402f7-b18a-4d3d-831b-72b2d12b94f1 tempest-CreateVolumesFromImageTest-1630141042 None] Volume volume-761b9567-b311-4c77-8626-02d744715fe0 (761b9567-b311-4c77-8626-02d744715fe0): created successfully Jul 10 06:57:02 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-18f402f7-b18a-4d3d-831b-72b2d12b94f1 tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0ad0794-0033-4ba9-84a1-57a2c1bd8b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:02 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-18f402f7-b18a-4d3d-831b-72b2d12b94f1 tempest-CreateVolumesFromImageTest-1630141042 None] Flow 'volume_create_manager' (9b4a5bb8-52a7-4eb5-8768-c374da330434) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:02 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-18f402f7-b18a-4d3d-831b-72b2d12b94f1 tempest-CreateVolumesFromImageTest-1630141042 None] Created volume successfully. Jul 10 06:57:02 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6cff4975-1365-4848-b503-a78b9b3a92c5_n5uaxwoadevstack@QuobyteHD" returned: 1 in 0.716s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6cff4975-1365-4848-b503-a78b9b3a92c5_n5uaxwoadevstack@QuobyteHD' failed. Not Retrying. {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:57:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:03 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-dcaf46cb-c7bb-4532-bc61-86f7d28da35f tempest-CreateVolumesFromImageTest-1630141042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-81c5ec98-9a29-4339-8994-4b9cda98e824 1073741824" returned: 0 in 0.855s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-dcaf46cb-c7bb-4532-bc61-86f7d28da35f tempest-CreateVolumesFromImageTest-1630141042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-81c5ec98-9a29-4339-8994-4b9cda98e824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:03 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-81c5ec98-9a29-4339-8994-4b9cda98e824 Jul 10 06:57:03 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:03 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-dcaf46cb-c7bb-4532-bc61-86f7d28da35f tempest-CreateVolumesFromImageTest-1630141042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-81c5ec98-9a29-4339-8994-4b9cda98e824" returned: 0 in 0.613s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:03 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-dcaf46cb-c7bb-4532-bc61-86f7d28da35f tempest-CreateVolumesFromImageTest-1630141042 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:57:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-dcaf46cb-c7bb-4532-bc61-86f7d28da35f tempest-CreateVolumesFromImageTest-1630141042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-39ba6fed-378a-4803-8d8e-dde995584b9c tempest-CreateVolumesFromImageTest-1630141042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.524s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:03 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-39ba6fed-378a-4803-8d8e-dde995584b9c tempest-CreateVolumesFromImageTest-1630141042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1037043478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29f97347-416b-45f7-b773-4fd797eeb78d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39ea8db51af24b4884e02266d0f086d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:56:57Z,use_quota=True,user_id='b805ec2a40144001ab202051c278c2eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:57:03 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-39ba6fed-378a-4803-8d8e-dde995584b9c tempest-CreateVolumesFromImageTest-1630141042 None] Creating volume 29f97347-416b-45f7-b773-4fd797eeb78d {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:57:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-39ba6fed-378a-4803-8d8e-dde995584b9c tempest-CreateVolumesFromImageTest-1630141042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-39ba6fed-378a-4803-8d8e-dde995584b9c tempest-CreateVolumesFromImageTest-1630141042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:03 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-39ba6fed-378a-4803-8d8e-dde995584b9c tempest-CreateVolumesFromImageTest-1630141042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:57:03 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-39ba6fed-378a-4803-8d8e-dde995584b9c tempest-CreateVolumesFromImageTest-1630141042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:57:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-39ba6fed-378a-4803-8d8e-dde995584b9c tempest-CreateVolumesFromImageTest-1630141042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:03 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-39ba6fed-378a-4803-8d8e-dde995584b9c tempest-CreateVolumesFromImageTest-1630141042 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:57:03 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-39ba6fed-378a-4803-8d8e-dde995584b9c tempest-CreateVolumesFromImageTest-1630141042 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:57:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-39ba6fed-378a-4803-8d8e-dde995584b9c tempest-CreateVolumesFromImageTest-1630141042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-29f97347-416b-45f7-b773-4fd797eeb78d 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:03 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-29f97347-416b-45f7-b773-4fd797eeb78d 1073741824 Jul 10 06:57:03 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:03 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dcaf46cb-c7bb-4532-bc61-86f7d28da35f tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b492f17-a31a-41cf-9a1a-58637247c7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81c5ec98-9a29-4339-8994-4b9cda98e824', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:03 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dcaf46cb-c7bb-4532-bc61-86f7d28da35f tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2af4326-1bd5-46f4-a031-cdfd20ce4ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:03 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-dcaf46cb-c7bb-4532-bc61-86f7d28da35f tempest-CreateVolumesFromImageTest-1630141042 None] Volume volume-81c5ec98-9a29-4339-8994-4b9cda98e824 (81c5ec98-9a29-4339-8994-4b9cda98e824): created successfully Jul 10 06:57:03 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dcaf46cb-c7bb-4532-bc61-86f7d28da35f tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2af4326-1bd5-46f4-a031-cdfd20ce4ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:03 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dcaf46cb-c7bb-4532-bc61-86f7d28da35f tempest-CreateVolumesFromImageTest-1630141042 None] Flow 'volume_create_manager' (5dc4d661-5537-4470-a0c1-2696351f8445) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:03 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-dcaf46cb-c7bb-4532-bc61-86f7d28da35f tempest-CreateVolumesFromImageTest-1630141042 None] Created volume successfully. Jul 10 06:57:04 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-39ba6fed-378a-4803-8d8e-dde995584b9c tempest-CreateVolumesFromImageTest-1630141042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-29f97347-416b-45f7-b773-4fd797eeb78d 1073741824" returned: 0 in 0.793s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-39ba6fed-378a-4803-8d8e-dde995584b9c tempest-CreateVolumesFromImageTest-1630141042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-29f97347-416b-45f7-b773-4fd797eeb78d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:04 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-29f97347-416b-45f7-b773-4fd797eeb78d Jul 10 06:57:04 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:05 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-39ba6fed-378a-4803-8d8e-dde995584b9c tempest-CreateVolumesFromImageTest-1630141042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-29f97347-416b-45f7-b773-4fd797eeb78d" returned: 0 in 0.596s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:05 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-39ba6fed-378a-4803-8d8e-dde995584b9c tempest-CreateVolumesFromImageTest-1630141042 None] <== create_volume: return (1424ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:57:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-39ba6fed-378a-4803-8d8e-dde995584b9c tempest-CreateVolumesFromImageTest-1630141042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.427s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-09700e55-53ea-4ba1-b3a1-ac4021c75b91 tempest-CreateVolumesFromImageTest-1630141042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.416s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:05 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-09700e55-53ea-4ba1-b3a1-ac4021c75b91 tempest-CreateVolumesFromImageTest-1630141042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-627497946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=571b5f99-7333-4bb3-aceb-657e01109729,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39ea8db51af24b4884e02266d0f086d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:56:57Z,use_quota=True,user_id='b805ec2a40144001ab202051c278c2eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:57:05 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-09700e55-53ea-4ba1-b3a1-ac4021c75b91 tempest-CreateVolumesFromImageTest-1630141042 None] Creating volume 571b5f99-7333-4bb3-aceb-657e01109729 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:57:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-09700e55-53ea-4ba1-b3a1-ac4021c75b91 tempest-CreateVolumesFromImageTest-1630141042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-09700e55-53ea-4ba1-b3a1-ac4021c75b91 tempest-CreateVolumesFromImageTest-1630141042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:05 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-09700e55-53ea-4ba1-b3a1-ac4021c75b91 tempest-CreateVolumesFromImageTest-1630141042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:57:05 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-09700e55-53ea-4ba1-b3a1-ac4021c75b91 tempest-CreateVolumesFromImageTest-1630141042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:57:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-09700e55-53ea-4ba1-b3a1-ac4021c75b91 tempest-CreateVolumesFromImageTest-1630141042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:05 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-09700e55-53ea-4ba1-b3a1-ac4021c75b91 tempest-CreateVolumesFromImageTest-1630141042 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:57:05 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-09700e55-53ea-4ba1-b3a1-ac4021c75b91 tempest-CreateVolumesFromImageTest-1630141042 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:57:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-09700e55-53ea-4ba1-b3a1-ac4021c75b91 tempest-CreateVolumesFromImageTest-1630141042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-571b5f99-7333-4bb3-aceb-657e01109729 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:05 devstack sudo[105935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-571b5f99-7333-4bb3-aceb-657e01109729 1073741824 Jul 10 06:57:05 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:05 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-39ba6fed-378a-4803-8d8e-dde995584b9c tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5029c3d-f7a9-4de5-8d79-57a689b87500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29f97347-416b-45f7-b773-4fd797eeb78d', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:05 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-39ba6fed-378a-4803-8d8e-dde995584b9c tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89cad842-9844-40ec-86bf-47024b2941a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:05 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-39ba6fed-378a-4803-8d8e-dde995584b9c tempest-CreateVolumesFromImageTest-1630141042 None] Volume volume-29f97347-416b-45f7-b773-4fd797eeb78d (29f97347-416b-45f7-b773-4fd797eeb78d): created successfully Jul 10 06:57:05 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-39ba6fed-378a-4803-8d8e-dde995584b9c tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89cad842-9844-40ec-86bf-47024b2941a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:05 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-39ba6fed-378a-4803-8d8e-dde995584b9c tempest-CreateVolumesFromImageTest-1630141042 None] Flow 'volume_create_manager' (df845c2c-22ec-4388-8853-48fb8e25c6fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:05 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-39ba6fed-378a-4803-8d8e-dde995584b9c tempest-CreateVolumesFromImageTest-1630141042 None] Created volume successfully. Jul 10 06:57:05 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-09700e55-53ea-4ba1-b3a1-ac4021c75b91 tempest-CreateVolumesFromImageTest-1630141042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-571b5f99-7333-4bb3-aceb-657e01109729 1073741824" returned: 0 in 0.798s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-09700e55-53ea-4ba1-b3a1-ac4021c75b91 tempest-CreateVolumesFromImageTest-1630141042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-571b5f99-7333-4bb3-aceb-657e01109729 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:05 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-571b5f99-7333-4bb3-aceb-657e01109729 Jul 10 06:57:05 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:06 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-09700e55-53ea-4ba1-b3a1-ac4021c75b91 tempest-CreateVolumesFromImageTest-1630141042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-571b5f99-7333-4bb3-aceb-657e01109729" returned: 0 in 0.615s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:06 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-09700e55-53ea-4ba1-b3a1-ac4021c75b91 tempest-CreateVolumesFromImageTest-1630141042 None] <== create_volume: return (1468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:57:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-09700e55-53ea-4ba1-b3a1-ac4021c75b91 tempest-CreateVolumesFromImageTest-1630141042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2840d409-231c-48d9-a13b-c81ed7b5b616 tempest-VolumeDependencyTests-2007432391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.042s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:06 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-09700e55-53ea-4ba1-b3a1-ac4021c75b91 tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7787c1c-c6df-4b05-ac89-770cce2e7f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-571b5f99-7333-4bb3-aceb-657e01109729', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:06 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-09700e55-53ea-4ba1-b3a1-ac4021c75b91 tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (595385c8-6c0d-4260-b795-3a9a337fe955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:06 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-2840d409-231c-48d9-a13b-c81ed7b5b616 tempest-VolumeDependencyTests-2007432391 None] Creating offline snapshot da535b6a-7fcd-464a-aac4-f01c59a7442c of volume 6dc3c309-8559-4e78-acdb-319f2b220bc8 {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:57:06 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de6f3c9-f117-45ed-a40c-1528caaaf409]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:57:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2840d409-231c-48d9-a13b-c81ed7b5b616 tempest-VolumeDependencyTests-2007432391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:06 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-09700e55-53ea-4ba1-b3a1-ac4021c75b91 tempest-CreateVolumesFromImageTest-1630141042 None] Volume volume-571b5f99-7333-4bb3-aceb-657e01109729 (571b5f99-7333-4bb3-aceb-657e01109729): created successfully Jul 10 06:57:06 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-09700e55-53ea-4ba1-b3a1-ac4021c75b91 tempest-CreateVolumesFromImageTest-1630141042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (595385c8-6c0d-4260-b795-3a9a337fe955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:06 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-09700e55-53ea-4ba1-b3a1-ac4021c75b91 tempest-CreateVolumesFromImageTest-1630141042 None] Flow 'volume_create_manager' (1d6c6755-a3c8-4356-a03d-32e1de233b3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:06 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-09700e55-53ea-4ba1-b3a1-ac4021c75b91 tempest-CreateVolumesFromImageTest-1630141042 None] Created volume successfully. Jul 10 06:57:06 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8 Jul 10 06:57:06 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:07 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b09cc460-2b24-42ad-8d85-805453a498f2 tempest-CreateVolumesFromImageTest-1630141042 None] Acquiring lock "cinder-571b5f99-7333-4bb3-aceb-657e01109729-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:57:07 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b09cc460-2b24-42ad-8d85-805453a498f2 tempest-CreateVolumesFromImageTest-1630141042 None] Lock "cinder-571b5f99-7333-4bb3-aceb-657e01109729-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:57:07 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:07 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b09cc460-2b24-42ad-8d85-805453a498f2 tempest-CreateVolumesFromImageTest-1630141042 None] Acquiring lock "cinder-quobyte-571b5f99-7333-4bb3-aceb-657e01109729" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:57:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2840d409-231c-48d9-a13b-c81ed7b5b616 tempest-VolumeDependencyTests-2007432391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8" returned: 0 in 0.807s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2840d409-231c-48d9-a13b-c81ed7b5b616 tempest-VolumeDependencyTests-2007432391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8.da535b6a-7fcd-464a-aac4-f01c59a7442c 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:07 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b09cc460-2b24-42ad-8d85-805453a498f2 tempest-CreateVolumesFromImageTest-1630141042 None] Lock "cinder-quobyte-571b5f99-7333-4bb3-aceb-657e01109729" acquired by "delete_volume" :: waited 0.028s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:57:07 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8.da535b6a-7fcd-464a-aac4-f01c59a7442c 1G Jul 10 06:57:07 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:07 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba1ad37-41bb-4fc0-a699-f4da253fa1c8]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:57:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b09cc460-2b24-42ad-8d85-805453a498f2 tempest-CreateVolumesFromImageTest-1630141042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-571b5f99-7333-4bb3-aceb-657e01109729 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:07 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-571b5f99-7333-4bb3-aceb-657e01109729 Jul 10 06:57:07 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:08 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2840d409-231c-48d9-a13b-c81ed7b5b616 tempest-VolumeDependencyTests-2007432391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8.da535b6a-7fcd-464a-aac4-f01c59a7442c 1G" returned: 0 in 0.786s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2840d409-231c-48d9-a13b-c81ed7b5b616 tempest-VolumeDependencyTests-2007432391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dc3c309-8559-4e78-acdb-319f2b220bc8 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8.da535b6a-7fcd-464a-aac4-f01c59a7442c {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:08 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b09cc460-2b24-42ad-8d85-805453a498f2 tempest-CreateVolumesFromImageTest-1630141042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-571b5f99-7333-4bb3-aceb-657e01109729" returned: 0 in 0.755s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b09cc460-2b24-42ad-8d85-805453a498f2 tempest-CreateVolumesFromImageTest-1630141042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-571b5f99-7333-4bb3-aceb-657e01109729 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:08 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dc3c309-8559-4e78-acdb-319f2b220bc8 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8.da535b6a-7fcd-464a-aac4-f01c59a7442c Jul 10 06:57:08 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:08 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-571b5f99-7333-4bb3-aceb-657e01109729 Jul 10 06:57:08 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:08 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2840d409-231c-48d9-a13b-c81ed7b5b616 tempest-VolumeDependencyTests-2007432391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dc3c309-8559-4e78-acdb-319f2b220bc8 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8.da535b6a-7fcd-464a-aac4-f01c59a7442c" returned: 0 in 0.677s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:08 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-2840d409-231c-48d9-a13b-c81ed7b5b616 tempest-VolumeDependencyTests-2007432391 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8.da535b6a-7fcd-464a-aac4-f01c59a7442c is being set with open permissions: ugo+rw Jul 10 06:57:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2840d409-231c-48d9-a13b-c81ed7b5b616 tempest-VolumeDependencyTests-2007432391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8.da535b6a-7fcd-464a-aac4-f01c59a7442c {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:08 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8.da535b6a-7fcd-464a-aac4-f01c59a7442c Jul 10 06:57:08 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:08 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b09cc460-2b24-42ad-8d85-805453a498f2 tempest-CreateVolumesFromImageTest-1630141042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-571b5f99-7333-4bb3-aceb-657e01109729" returned: 0 in 0.744s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:08 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b09cc460-2b24-42ad-8d85-805453a498f2 tempest-CreateVolumesFromImageTest-1630141042 None] Lock "cinder-quobyte-571b5f99-7333-4bb3-aceb-657e01109729" released by "delete_volume" :: held 1.540s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:57:09 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-b09cc460-2b24-42ad-8d85-805453a498f2 tempest-CreateVolumesFromImageTest-1630141042 None] Created reservations ['ad2c630a-ffef-4661-a13d-0320e97b1157', '55f9807a-8c89-4954-983b-4cc376a6ecc4', 'b0f539c2-8b27-48ee-803d-b86c36950786', 'f6adc79a-2a46-4a08-9be4-875bcdf832d0'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:57:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b09cc460-2b24-42ad-8d85-805453a498f2 tempest-CreateVolumesFromImageTest-1630141042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b09cc460-2b24-42ad-8d85-805453a498f2 tempest-CreateVolumesFromImageTest-1630141042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:09 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b09cc460-2b24-42ad-8d85-805453a498f2 tempest-CreateVolumesFromImageTest-1630141042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:57:09 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b09cc460-2b24-42ad-8d85-805453a498f2 tempest-CreateVolumesFromImageTest-1630141042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:57:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b09cc460-2b24-42ad-8d85-805453a498f2 tempest-CreateVolumesFromImageTest-1630141042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b09cc460-2b24-42ad-8d85-805453a498f2 tempest-CreateVolumesFromImageTest-1630141042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:09 devstack sudo[105970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:57:09 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:09 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-23995d31-804f-46b6-991c-4f330c23b73e tempest-CreateVolumesFromImageTest-1630141042 None] Acquiring lock "cinder-29f97347-416b-45f7-b773-4fd797eeb78d-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:57:09 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-23995d31-804f-46b6-991c-4f330c23b73e tempest-CreateVolumesFromImageTest-1630141042 None] Lock "cinder-29f97347-416b-45f7-b773-4fd797eeb78d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:57:09 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-23995d31-804f-46b6-991c-4f330c23b73e tempest-CreateVolumesFromImageTest-1630141042 None] Acquiring lock "cinder-quobyte-29f97347-416b-45f7-b773-4fd797eeb78d" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:57:09 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2840d409-231c-48d9-a13b-c81ed7b5b616 tempest-VolumeDependencyTests-2007432391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8.da535b6a-7fcd-464a-aac4-f01c59a7442c" returned: 0 in 0.771s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:09 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-23995d31-804f-46b6-991c-4f330c23b73e tempest-CreateVolumesFromImageTest-1630141042 None] Lock "cinder-quobyte-29f97347-416b-45f7-b773-4fd797eeb78d" acquired by "delete_volume" :: waited 0.025s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:57:09 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50d1e86-0489-48be-ad02-615d676024ac]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:57:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-23995d31-804f-46b6-991c-4f330c23b73e tempest-CreateVolumesFromImageTest-1630141042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-29f97347-416b-45f7-b773-4fd797eeb78d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2840d409-231c-48d9-a13b-c81ed7b5b616 tempest-VolumeDependencyTests-2007432391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:09 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8.info Jul 10 06:57:09 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:09 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b09cc460-2b24-42ad-8d85-805453a498f2 tempest-CreateVolumesFromImageTest-1630141042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.659s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:09 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-b09cc460-2b24-42ad-8d85-805453a498f2 tempest-CreateVolumesFromImageTest-1630141042 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:57:09 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-b09cc460-2b24-42ad-8d85-805453a498f2 tempest-CreateVolumesFromImageTest-1630141042 None] Deleted volume successfully. Jul 10 06:57:09 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b09cc460-2b24-42ad-8d85-805453a498f2 tempest-CreateVolumesFromImageTest-1630141042 None] Lock "cinder-571b5f99-7333-4bb3-aceb-657e01109729-delete_volume" released by "delete_volume" :: held 2.409s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:57:09 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-29f97347-416b-45f7-b773-4fd797eeb78d Jul 10 06:57:09 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:10 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-23995d31-804f-46b6-991c-4f330c23b73e tempest-CreateVolumesFromImageTest-1630141042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-29f97347-416b-45f7-b773-4fd797eeb78d" returned: 0 in 0.772s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-23995d31-804f-46b6-991c-4f330c23b73e tempest-CreateVolumesFromImageTest-1630141042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-29f97347-416b-45f7-b773-4fd797eeb78d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:10 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-29f97347-416b-45f7-b773-4fd797eeb78d Jul 10 06:57:10 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:10 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2840d409-231c-48d9-a13b-c81ed7b5b616 tempest-VolumeDependencyTests-2007432391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8.info" returned: 0 in 0.796s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:10 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-2840d409-231c-48d9-a13b-c81ed7b5b616 tempest-VolumeDependencyTests-2007432391 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8.info is being set with open permissions: ugo+rw Jul 10 06:57:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2840d409-231c-48d9-a13b-c81ed7b5b616 tempest-VolumeDependencyTests-2007432391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:10 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8.info Jul 10 06:57:10 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:11 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-23995d31-804f-46b6-991c-4f330c23b73e tempest-CreateVolumesFromImageTest-1630141042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-29f97347-416b-45f7-b773-4fd797eeb78d" returned: 0 in 0.681s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:11 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-23995d31-804f-46b6-991c-4f330c23b73e tempest-CreateVolumesFromImageTest-1630141042 None] Lock "cinder-quobyte-29f97347-416b-45f7-b773-4fd797eeb78d" released by "delete_volume" :: held 1.496s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:57:11 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2840d409-231c-48d9-a13b-c81ed7b5b616 tempest-VolumeDependencyTests-2007432391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8.info" returned: 0 in 0.685s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2840d409-231c-48d9-a13b-c81ed7b5b616 tempest-VolumeDependencyTests-2007432391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.665s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-8b8e3b4f-0771-476d-bcfc-c6d6aaed50b3 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.573s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:11 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-8b8e3b4f-0771-476d-bcfc-c6d6aaed50b3 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Creating offline snapshot 9e438730-f81f-4b20-894a-a0da7be3317d of volume 090a5e06-3c74-4824-90cb-006cc53a55bd {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:57:11 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-2840d409-231c-48d9-a13b-c81ed7b5b616 tempest-VolumeDependencyTests-2007432391 None] Create snapshot completed successfully Jul 10 06:57:11 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-23995d31-804f-46b6-991c-4f330c23b73e tempest-CreateVolumesFromImageTest-1630141042 None] Created reservations ['1d1f7c6f-9b52-4be0-abe2-54932aa860ed', '127bf85f-7c41-4b0d-aa0c-1098366442ab', '2400226c-4547-4856-8170-ef41aa57488e', '9dc65663-7d0a-4779-841d-8bd2b718fe02'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:57:11 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71e3e44-b801-4c42-9f6a-bedb4df2b17f]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:57:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8b8e3b4f-0771-476d-bcfc-c6d6aaed50b3 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-23995d31-804f-46b6-991c-4f330c23b73e tempest-CreateVolumesFromImageTest-1630141042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-23995d31-804f-46b6-991c-4f330c23b73e tempest-CreateVolumesFromImageTest-1630141042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:11 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-23995d31-804f-46b6-991c-4f330c23b73e tempest-CreateVolumesFromImageTest-1630141042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:57:11 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-23995d31-804f-46b6-991c-4f330c23b73e tempest-CreateVolumesFromImageTest-1630141042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:57:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-23995d31-804f-46b6-991c-4f330c23b73e tempest-CreateVolumesFromImageTest-1630141042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-23995d31-804f-46b6-991c-4f330c23b73e tempest-CreateVolumesFromImageTest-1630141042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:11 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:57:11 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:11 devstack sudo[105989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd Jul 10 06:57:11 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:11 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d1f60cb9-5136-412d-b27b-c14e2c1c7a1d tempest-CreateVolumesFromImageTest-1630141042 None] Acquiring lock "cinder-81c5ec98-9a29-4339-8994-4b9cda98e824-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:57:11 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d1f60cb9-5136-412d-b27b-c14e2c1c7a1d tempest-CreateVolumesFromImageTest-1630141042 None] Lock "cinder-81c5ec98-9a29-4339-8994-4b9cda98e824-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:57:11 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d1f60cb9-5136-412d-b27b-c14e2c1c7a1d tempest-CreateVolumesFromImageTest-1630141042 None] Acquiring lock "cinder-quobyte-81c5ec98-9a29-4339-8994-4b9cda98e824" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:57:11 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d1f60cb9-5136-412d-b27b-c14e2c1c7a1d tempest-CreateVolumesFromImageTest-1630141042 None] Lock "cinder-quobyte-81c5ec98-9a29-4339-8994-4b9cda98e824" acquired by "delete_volume" :: waited 0.018s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:57:11 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5106251-b734-4882-b629-1f2aa6e24ec4]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:57:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d1f60cb9-5136-412d-b27b-c14e2c1c7a1d tempest-CreateVolumesFromImageTest-1630141042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-81c5ec98-9a29-4339-8994-4b9cda98e824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:12 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-23995d31-804f-46b6-991c-4f330c23b73e tempest-CreateVolumesFromImageTest-1630141042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.685s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:12 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-23995d31-804f-46b6-991c-4f330c23b73e tempest-CreateVolumesFromImageTest-1630141042 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:57:12 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-23995d31-804f-46b6-991c-4f330c23b73e tempest-CreateVolumesFromImageTest-1630141042 None] Deleted volume successfully. Jul 10 06:57:12 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:12 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-81c5ec98-9a29-4339-8994-4b9cda98e824 Jul 10 06:57:12 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8b8e3b4f-0771-476d-bcfc-c6d6aaed50b3 tempest-CreateVolumesFromSnapshotTest-2117965649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd" returned: 0 in 0.788s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8b8e3b4f-0771-476d-bcfc-c6d6aaed50b3 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd.9e438730-f81f-4b20-894a-a0da7be3317d 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:12 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-23995d31-804f-46b6-991c-4f330c23b73e tempest-CreateVolumesFromImageTest-1630141042 None] Lock "cinder-29f97347-416b-45f7-b773-4fd797eeb78d-delete_volume" released by "delete_volume" :: held 2.472s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:57:12 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd.9e438730-f81f-4b20-894a-a0da7be3317d 1G Jul 10 06:57:12 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:12 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:57:12 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Flow 'volume_create_manager' (a0207472-c9d6-4407-81fc-3ce1145a7226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:12 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90fdd202-7dfd-48ab-8332-89c92c5cde17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:12 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:12 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90fdd202-7dfd-48ab-8332-89c92c5cde17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:57:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2128032000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f4068cf-21f2-4c0c-a562-260e1092fef1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b392bfbf150d4e06b44f0960da1d6a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=da535b6a-7fcd-464a-aac4-f01c59a7442c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:57:13Z,use_quota=True,user_id='7666ea9c638b481497289faadae77afd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:12 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95bff738-1ce9-4e3a-8a84-013993c2a512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:12 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95bff738-1ce9-4e3a-8a84-013993c2a512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:12 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91986cb0-8f29-427b-8f8e-8b2ceb865b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:12 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91986cb0-8f29-427b-8f8e-8b2ceb865b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3f4068cf-21f2-4c0c-a562-260e1092fef1', 'volume_name': 'volume-3f4068cf-21f2-4c0c-a562-260e1092fef1', 'volume_size': 1, 'snapshot_id': 'da535b6a-7fcd-464a-aac4-f01c59a7442c'}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:12 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f8eeda6-6ab0-4cfc-9b15-9120b9135aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:12 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f8eeda6-6ab0-4cfc-9b15-9120b9135aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:12 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cb9cef9-4154-442a-81b1-1be9f6ef5b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:12 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Volume 3f4068cf-21f2-4c0c-a562-260e1092fef1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3f4068cf-21f2-4c0c-a562-260e1092fef1', 'volume_size': 1, 'snapshot_id': 'da535b6a-7fcd-464a-aac4-f01c59a7442c'} Jul 10 06:57:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d1f60cb9-5136-412d-b27b-c14e2c1c7a1d tempest-CreateVolumesFromImageTest-1630141042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-81c5ec98-9a29-4339-8994-4b9cda98e824" returned: 0 in 0.879s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d1f60cb9-5136-412d-b27b-c14e2c1c7a1d tempest-CreateVolumesFromImageTest-1630141042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-81c5ec98-9a29-4339-8994-4b9cda98e824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:12 devstack sudo[106007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-81c5ec98-9a29-4339-8994-4b9cda98e824 Jul 10 06:57:12 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:12 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8b8e3b4f-0771-476d-bcfc-c6d6aaed50b3 tempest-CreateVolumesFromSnapshotTest-2117965649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd.9e438730-f81f-4b20-894a-a0da7be3317d 1G" returned: 0 in 0.893s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8b8e3b4f-0771-476d-bcfc-c6d6aaed50b3 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-090a5e06-3c74-4824-90cb-006cc53a55bd -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd.9e438730-f81f-4b20-894a-a0da7be3317d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:12 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-090a5e06-3c74-4824-90cb-006cc53a55bd -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd.9e438730-f81f-4b20-894a-a0da7be3317d Jul 10 06:57:12 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:13 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d1f60cb9-5136-412d-b27b-c14e2c1c7a1d tempest-CreateVolumesFromImageTest-1630141042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-81c5ec98-9a29-4339-8994-4b9cda98e824" returned: 0 in 0.633s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:13 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d1f60cb9-5136-412d-b27b-c14e2c1c7a1d tempest-CreateVolumesFromImageTest-1630141042 None] Lock "cinder-quobyte-81c5ec98-9a29-4339-8994-4b9cda98e824" released by "delete_volume" :: held 1.555s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:57:13 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-d1f60cb9-5136-412d-b27b-c14e2c1c7a1d tempest-CreateVolumesFromImageTest-1630141042 None] Created reservations ['67a796f0-bd6d-4ebf-be3b-ebb20a71b243', '9971401d-6ec7-421a-869b-e8fa4fa7f5a3', '4aae43f2-7741-4d6b-a661-0b8973dcdef7', '529ee84a-c4dc-4faa-b93a-271cf1030e5d'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:57:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d1f60cb9-5136-412d-b27b-c14e2c1c7a1d tempest-CreateVolumesFromImageTest-1630141042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d1f60cb9-5136-412d-b27b-c14e2c1c7a1d tempest-CreateVolumesFromImageTest-1630141042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:13 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-d1f60cb9-5136-412d-b27b-c14e2c1c7a1d tempest-CreateVolumesFromImageTest-1630141042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:57:13 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-d1f60cb9-5136-412d-b27b-c14e2c1c7a1d tempest-CreateVolumesFromImageTest-1630141042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:57:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d1f60cb9-5136-412d-b27b-c14e2c1c7a1d tempest-CreateVolumesFromImageTest-1630141042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d1f60cb9-5136-412d-b27b-c14e2c1c7a1d tempest-CreateVolumesFromImageTest-1630141042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:13 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:57:13 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:13 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8b8e3b4f-0771-476d-bcfc-c6d6aaed50b3 tempest-CreateVolumesFromSnapshotTest-2117965649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-090a5e06-3c74-4824-90cb-006cc53a55bd -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd.9e438730-f81f-4b20-894a-a0da7be3317d" returned: 0 in 0.711s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:13 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-8b8e3b4f-0771-476d-bcfc-c6d6aaed50b3 tempest-CreateVolumesFromSnapshotTest-2117965649 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd.9e438730-f81f-4b20-894a-a0da7be3317d is being set with open permissions: ugo+rw Jul 10 06:57:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8b8e3b4f-0771-476d-bcfc-c6d6aaed50b3 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd.9e438730-f81f-4b20-894a-a0da7be3317d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:13 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd.9e438730-f81f-4b20-894a-a0da7be3317d Jul 10 06:57:13 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:14 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e7f48e0b-a90d-4cda-b620-a861f79ac3ff tempest-CreateVolumesFromImageTest-1630141042 None] Acquiring lock "cinder-761b9567-b311-4c77-8626-02d744715fe0-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:57:14 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e7f48e0b-a90d-4cda-b620-a861f79ac3ff tempest-CreateVolumesFromImageTest-1630141042 None] Lock "cinder-761b9567-b311-4c77-8626-02d744715fe0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:57:14 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e7f48e0b-a90d-4cda-b620-a861f79ac3ff tempest-CreateVolumesFromImageTest-1630141042 None] Acquiring lock "cinder-quobyte-761b9567-b311-4c77-8626-02d744715fe0" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:57:14 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e7f48e0b-a90d-4cda-b620-a861f79ac3ff tempest-CreateVolumesFromImageTest-1630141042 None] Lock "cinder-quobyte-761b9567-b311-4c77-8626-02d744715fe0" acquired by "delete_volume" :: waited 0.020s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:57:14 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[313e238e-7cf8-42e9-9733-e360cbe5c638]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:57:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e7f48e0b-a90d-4cda-b620-a861f79ac3ff tempest-CreateVolumesFromImageTest-1630141042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-761b9567-b311-4c77-8626-02d744715fe0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:14 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d1f60cb9-5136-412d-b27b-c14e2c1c7a1d tempest-CreateVolumesFromImageTest-1630141042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.668s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:14 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-d1f60cb9-5136-412d-b27b-c14e2c1c7a1d tempest-CreateVolumesFromImageTest-1630141042 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:57:14 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-d1f60cb9-5136-412d-b27b-c14e2c1c7a1d tempest-CreateVolumesFromImageTest-1630141042 None] Deleted volume successfully. Jul 10 06:57:14 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-761b9567-b311-4c77-8626-02d744715fe0 Jul 10 06:57:14 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:14 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d1f60cb9-5136-412d-b27b-c14e2c1c7a1d tempest-CreateVolumesFromImageTest-1630141042 None] Lock "cinder-81c5ec98-9a29-4339-8994-4b9cda98e824-delete_volume" released by "delete_volume" :: held 2.455s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:57:14 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8b8e3b4f-0771-476d-bcfc-c6d6aaed50b3 tempest-CreateVolumesFromSnapshotTest-2117965649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd.9e438730-f81f-4b20-894a-a0da7be3317d" returned: 0 in 0.662s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8b8e3b4f-0771-476d-bcfc-c6d6aaed50b3 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:14 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd.info Jul 10 06:57:14 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:14 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e7f48e0b-a90d-4cda-b620-a861f79ac3ff tempest-CreateVolumesFromImageTest-1630141042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-761b9567-b311-4c77-8626-02d744715fe0" returned: 0 in 0.763s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e7f48e0b-a90d-4cda-b620-a861f79ac3ff tempest-CreateVolumesFromImageTest-1630141042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-761b9567-b311-4c77-8626-02d744715fe0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:14 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-761b9567-b311-4c77-8626-02d744715fe0 Jul 10 06:57:14 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:15 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8b8e3b4f-0771-476d-bcfc-c6d6aaed50b3 tempest-CreateVolumesFromSnapshotTest-2117965649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd.info" returned: 0 in 0.646s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:15 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-8b8e3b4f-0771-476d-bcfc-c6d6aaed50b3 tempest-CreateVolumesFromSnapshotTest-2117965649 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd.info is being set with open permissions: ugo+rw Jul 10 06:57:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8b8e3b4f-0771-476d-bcfc-c6d6aaed50b3 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:15 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd.info Jul 10 06:57:15 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:15 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e7f48e0b-a90d-4cda-b620-a861f79ac3ff tempest-CreateVolumesFromImageTest-1630141042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-761b9567-b311-4c77-8626-02d744715fe0" returned: 0 in 0.627s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:15 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e7f48e0b-a90d-4cda-b620-a861f79ac3ff tempest-CreateVolumesFromImageTest-1630141042 None] Lock "cinder-quobyte-761b9567-b311-4c77-8626-02d744715fe0" released by "delete_volume" :: held 1.436s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:57:15 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-e7f48e0b-a90d-4cda-b620-a861f79ac3ff tempest-CreateVolumesFromImageTest-1630141042 None] Created reservations ['cb48f7a7-eecf-4c8c-80aa-75fe5c3ffefb', '159c78e5-5275-4ac3-9f63-5aee8ced3306', '40e474b3-79bc-4f9d-a4b0-13ac9fb32871', 'aaf1f0b7-83a5-45ca-a421-7b4c14e0bcfb'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:57:15 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-8b8e3b4f-0771-476d-bcfc-c6d6aaed50b3 tempest-CreateVolumesFromSnapshotTest-2117965649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd.info" returned: 0 in 0.640s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-8b8e3b4f-0771-476d-bcfc-c6d6aaed50b3 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.439s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.119s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:15 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=433528f5-09d7-47b6-b929-0245291bf28a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eeda33d434244d59e5c6875c0cb0fa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:56:59Z,use_quota=True,user_id='98f85848aa5c4889b58fb61d02c62d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(424349b9-d3ea-43b8-bf40-3a61827805f8),volume_type_id=424349b9-d3ea-43b8-bf40-3a61827805f8)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:57:15 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Creating volume 433528f5-09d7-47b6-b929-0245291bf28a {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:57:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:15 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:57:15 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:57:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:15 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:57:15 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:57:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-433528f5-09d7-47b6-b929-0245291bf28a 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:15 devstack sudo[106036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-433528f5-09d7-47b6-b929-0245291bf28a 1073741824 Jul 10 06:57:15 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:15 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-8b8e3b4f-0771-476d-bcfc-c6d6aaed50b3 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Create snapshot completed successfully Jul 10 06:57:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e7f48e0b-a90d-4cda-b620-a861f79ac3ff tempest-CreateVolumesFromImageTest-1630141042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e7f48e0b-a90d-4cda-b620-a861f79ac3ff tempest-CreateVolumesFromImageTest-1630141042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:15 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-e7f48e0b-a90d-4cda-b620-a861f79ac3ff tempest-CreateVolumesFromImageTest-1630141042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:57:15 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-e7f48e0b-a90d-4cda-b620-a861f79ac3ff tempest-CreateVolumesFromImageTest-1630141042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:57:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e7f48e0b-a90d-4cda-b620-a861f79ac3ff tempest-CreateVolumesFromImageTest-1630141042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e7f48e0b-a90d-4cda-b620-a861f79ac3ff tempest-CreateVolumesFromImageTest-1630141042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:15 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:57:15 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:16 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d9c21daa-c7bb-45b6-93ba-c68d31d9b7d3 tempest-CreateVolumesFromImageTest-1630141042 None] Acquiring lock "cinder-53bb2923-0160-4718-b7d6-d6e7b0474d80-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:57:16 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d9c21daa-c7bb-45b6-93ba-c68d31d9b7d3 tempest-CreateVolumesFromImageTest-1630141042 None] Lock "cinder-53bb2923-0160-4718-b7d6-d6e7b0474d80-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:57:16 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d9c21daa-c7bb-45b6-93ba-c68d31d9b7d3 tempest-CreateVolumesFromImageTest-1630141042 None] Acquiring lock "cinder-quobyte-53bb2923-0160-4718-b7d6-d6e7b0474d80" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:57:16 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d9c21daa-c7bb-45b6-93ba-c68d31d9b7d3 tempest-CreateVolumesFromImageTest-1630141042 None] Lock "cinder-quobyte-53bb2923-0160-4718-b7d6-d6e7b0474d80" acquired by "delete_volume" :: waited 0.016s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:57:16 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c6634a-554e-4833-9893-92416772c949]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:57:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d9c21daa-c7bb-45b6-93ba-c68d31d9b7d3 tempest-CreateVolumesFromImageTest-1630141042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-53bb2923-0160-4718-b7d6-d6e7b0474d80 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:16 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e7f48e0b-a90d-4cda-b620-a861f79ac3ff tempest-CreateVolumesFromImageTest-1630141042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.693s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:16 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-e7f48e0b-a90d-4cda-b620-a861f79ac3ff tempest-CreateVolumesFromImageTest-1630141042 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:57:16 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-e7f48e0b-a90d-4cda-b620-a861f79ac3ff tempest-CreateVolumesFromImageTest-1630141042 None] Deleted volume successfully. Jul 10 06:57:16 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e7f48e0b-a90d-4cda-b620-a861f79ac3ff tempest-CreateVolumesFromImageTest-1630141042 None] Lock "cinder-761b9567-b311-4c77-8626-02d744715fe0-delete_volume" released by "delete_volume" :: held 2.439s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:57:16 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-53bb2923-0160-4718-b7d6-d6e7b0474d80 Jul 10 06:57:16 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:16 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-433528f5-09d7-47b6-b929-0245291bf28a 1073741824" returned: 0 in 0.949s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-433528f5-09d7-47b6-b929-0245291bf28a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:16 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-433528f5-09d7-47b6-b929-0245291bf28a Jul 10 06:57:16 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:16 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd091c13-eb7b-4f01-9a80-211739604e1f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:57:16 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dd091c13-eb7b-4f01-9a80-211739604e1f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Flow 'volume_create_manager' (98621a24-947b-46b4-89a2-049e09311b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:16 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dd091c13-eb7b-4f01-9a80-211739604e1f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (134cdc3d-3303-4b4a-88ab-55890424ed05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:16 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dd091c13-eb7b-4f01-9a80-211739604e1f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (134cdc3d-3303-4b4a-88ab-55890424ed05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-472071856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df8c37d0-8e16-48ac-8578-8db5543cc9e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f646c4fdb4d74c3c99368db448a41505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:57:17Z,use_quota=True,user_id='d12f423193ad41cb9a4d7c7156fa97a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:16 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dd091c13-eb7b-4f01-9a80-211739604e1f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54a6c6c1-7b3b-4c71-a396-639f12afbba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:16 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dd091c13-eb7b-4f01-9a80-211739604e1f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54a6c6c1-7b3b-4c71-a396-639f12afbba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:16 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dd091c13-eb7b-4f01-9a80-211739604e1f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d18c892-d326-4cb8-9930-ce6d0ce75d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:16 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dd091c13-eb7b-4f01-9a80-211739604e1f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d18c892-d326-4cb8-9930-ce6d0ce75d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df8c37d0-8e16-48ac-8578-8db5543cc9e8', 'volume_name': 'volume-df8c37d0-8e16-48ac-8578-8db5543cc9e8', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:16 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dd091c13-eb7b-4f01-9a80-211739604e1f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62c3c1db-4ccf-40a9-987a-c39a203225c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:16 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dd091c13-eb7b-4f01-9a80-211739604e1f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62c3c1db-4ccf-40a9-987a-c39a203225c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:16 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dd091c13-eb7b-4f01-9a80-211739604e1f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29b4c351-3ee9-4ad3-ba17-37e06055eb67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:16 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-dd091c13-eb7b-4f01-9a80-211739604e1f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Volume df8c37d0-8e16-48ac-8578-8db5543cc9e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df8c37d0-8e16-48ac-8578-8db5543cc9e8', 'volume_size': 1} Jul 10 06:57:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-dd091c13-eb7b-4f01-9a80-211739604e1f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:17 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d9c21daa-c7bb-45b6-93ba-c68d31d9b7d3 tempest-CreateVolumesFromImageTest-1630141042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-53bb2923-0160-4718-b7d6-d6e7b0474d80" returned: 0 in 0.938s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d9c21daa-c7bb-45b6-93ba-c68d31d9b7d3 tempest-CreateVolumesFromImageTest-1630141042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-53bb2923-0160-4718-b7d6-d6e7b0474d80 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:17 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:17 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-53bb2923-0160-4718-b7d6-d6e7b0474d80 Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-433528f5-09d7-47b6-b929-0245291bf28a" returned: 0 in 0.749s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:17 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] <== create_volume: return (1744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.748s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.588s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Acquiring lock "cinder-quobyte-da535b6a-7fcd-464a-aac4-f01c59a7442c-3f4068cf-21f2-4c0c-a562-260e1092fef1" by "_create_volume_from_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-a21e1773-7ea6-455a-a1b9-428f8b6d3d05 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a21e1773-7ea6-455a-a1b9-428f8b6d3d05 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Flow 'volume_create_manager' (c420f9df-6e2e-4b81-998f-fc29dc1fc12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a21e1773-7ea6-455a-a1b9-428f8b6d3d05 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b64b4427-6bd8-4bca-a7b0-fe30ea2e5ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Lock "cinder-quobyte-da535b6a-7fcd-464a-aac4-f01c59a7442c-3f4068cf-21f2-4c0c-a562-260e1092fef1" acquired by "_create_volume_from_snapshot" :: waited 0.077s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Creating volume 3f4068cf-21f2-4c0c-a562-260e1092fef1 from snapshot da535b6a-7fcd-464a-aac4-f01c59a7442c {{(pid=87294) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Acquiring lock "cinder-quobyte-3f4068cf-21f2-4c0c-a562-260e1092fef1" by "_copy_volume_from_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG cinder.volume.volume_utils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Attempting download of 6cff4975-1365-4848-b503-a78b9b3a92c5 ((None, [{'url': 'file:///opt/stack/data/glance/images/6cff4975-1365-4848-b503-a78b9b3a92c5', 'metadata': {}}])) to volume 433528f5-09d7-47b6-b929-0245291bf28a. {{(pid=87294) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a21e1773-7ea6-455a-a1b9-428f8b6d3d05 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b64b4427-6bd8-4bca-a7b0-fe30ea2e5ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-937790237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08fdd3d5-ab56-4594-896d-0f35bfce3741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f646c4fdb4d74c3c99368db448a41505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:57:17Z,use_quota=True,user_id='d12f423193ad41cb9a4d7c7156fa97a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a21e1773-7ea6-455a-a1b9-428f8b6d3d05 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7552358d-26f8-4f8e-954d-84432cd417f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a21e1773-7ea6-455a-a1b9-428f8b6d3d05 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7552358d-26f8-4f8e-954d-84432cd417f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a21e1773-7ea6-455a-a1b9-428f8b6d3d05 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34040547-e601-46bf-b44d-8dc2a95f7443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a21e1773-7ea6-455a-a1b9-428f8b6d3d05 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34040547-e601-46bf-b44d-8dc2a95f7443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08fdd3d5-ab56-4594-896d-0f35bfce3741', 'volume_name': 'volume-08fdd3d5-ab56-4594-896d-0f35bfce3741', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a21e1773-7ea6-455a-a1b9-428f8b6d3d05 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ad27de2-fa26-43f1-8e14-c1f3b27d9428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a21e1773-7ea6-455a-a1b9-428f8b6d3d05 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ad27de2-fa26-43f1-8e14-c1f3b27d9428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a21e1773-7ea6-455a-a1b9-428f8b6d3d05 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdc5327b-5a6a-4733-8c16-27061802ecc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:17 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-a21e1773-7ea6-455a-a1b9-428f8b6d3d05 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Volume 08fdd3d5-ab56-4594-896d-0f35bfce3741: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08fdd3d5-ab56-4594-896d-0f35bfce3741', 'volume_size': 1} Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a21e1773-7ea6-455a-a1b9-428f8b6d3d05 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Lock "cinder-quobyte-3f4068cf-21f2-4c0c-a562-260e1092fef1" acquired by "_copy_volume_from_snapshot" :: waited 0.074s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] snapshot: da535b6a-7fcd-464a-aac4-f01c59a7442c, volume: 3f4068cf-21f2-4c0c-a562-260e1092fef1, {{(pid=87294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[e892e449-1cf2-49d6-9db7-09a2f781aab6]: (4, 'raw') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6cff4975-1365-4848-b503-a78b9b3a92c5_ynxzzyke {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[1311dbdb-7adf-47bf-b4be-79edb138fbef]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8.da535b6a-7fcd-464a-aac4-f01c59a7442c {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:17 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6cff4975-1365-4848-b503-a78b9b3a92c5_ynxzzyke Jul 10 06:57:17 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:17 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8.da535b6a-7fcd-464a-aac4-f01c59a7442c Jul 10 06:57:17 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5d1e21b-7c1d-4aeb-9f18-7d5de9b2bc91 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b5d1e21b-7c1d-4aeb-9f18-7d5de9b2bc91 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Flow 'volume_create_manager' (5b1a38d7-239b-4616-9751-ae46a929aa4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b5d1e21b-7c1d-4aeb-9f18-7d5de9b2bc91 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0f96bcb-6af5-4387-af3d-5cae6682bfe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b5d1e21b-7c1d-4aeb-9f18-7d5de9b2bc91 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0f96bcb-6af5-4387-af3d-5cae6682bfe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-835942658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f4f508e-d2f9-414a-9f66-3ac2dc4a4ee5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f646c4fdb4d74c3c99368db448a41505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:57:18Z,use_quota=True,user_id='d12f423193ad41cb9a4d7c7156fa97a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b5d1e21b-7c1d-4aeb-9f18-7d5de9b2bc91 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (125f1469-f41d-4322-a423-1a76c0b1e3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b5d1e21b-7c1d-4aeb-9f18-7d5de9b2bc91 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (125f1469-f41d-4322-a423-1a76c0b1e3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b5d1e21b-7c1d-4aeb-9f18-7d5de9b2bc91 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a9ef0a8-28dc-4977-8d15-dd86eecc5563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b5d1e21b-7c1d-4aeb-9f18-7d5de9b2bc91 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a9ef0a8-28dc-4977-8d15-dd86eecc5563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f4f508e-d2f9-414a-9f66-3ac2dc4a4ee5', 'volume_name': 'volume-9f4f508e-d2f9-414a-9f66-3ac2dc4a4ee5', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b5d1e21b-7c1d-4aeb-9f18-7d5de9b2bc91 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5cc9e2b-1df1-4ad8-99ca-057f54933767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b5d1e21b-7c1d-4aeb-9f18-7d5de9b2bc91 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5cc9e2b-1df1-4ad8-99ca-057f54933767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b5d1e21b-7c1d-4aeb-9f18-7d5de9b2bc91 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba39ce83-4752-45b7-a2e5-a627ab9e3246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:18 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-b5d1e21b-7c1d-4aeb-9f18-7d5de9b2bc91 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Volume 9f4f508e-d2f9-414a-9f66-3ac2dc4a4ee5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f4f508e-d2f9-414a-9f66-3ac2dc4a4ee5', 'volume_size': 1} Jul 10 06:57:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b5d1e21b-7c1d-4aeb-9f18-7d5de9b2bc91 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:18 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d9c21daa-c7bb-45b6-93ba-c68d31d9b7d3 tempest-CreateVolumesFromImageTest-1630141042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-53bb2923-0160-4718-b7d6-d6e7b0474d80" returned: 0 in 1.049s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:18 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d9c21daa-c7bb-45b6-93ba-c68d31d9b7d3 tempest-CreateVolumesFromImageTest-1630141042 None] Lock "cinder-quobyte-53bb2923-0160-4718-b7d6-d6e7b0474d80" released by "delete_volume" :: held 2.048s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:57:18 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d84a14c-5e68-4a0d-b84d-83928e08d660 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:57:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7d84a14c-5e68-4a0d-b84d-83928e08d660 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Flow 'volume_create_manager' (9e74e46e-56c1-4ac9-bd9c-1aab0bae035a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7d84a14c-5e68-4a0d-b84d-83928e08d660 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (882203dc-92ab-4815-a8bf-e450a4baabfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:18 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7d84a14c-5e68-4a0d-b84d-83928e08d660 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (882203dc-92ab-4815-a8bf-e450a4baabfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-800967599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9be747a5-8ef1-4010-af3d-6bca04e14382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f646c4fdb4d74c3c99368db448a41505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:57:18Z,use_quota=True,user_id='d12f423193ad41cb9a4d7c7156fa97a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7d84a14c-5e68-4a0d-b84d-83928e08d660 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85ae8260-afec-4f8c-bcfa-6b554c46ceb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7d84a14c-5e68-4a0d-b84d-83928e08d660 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85ae8260-afec-4f8c-bcfa-6b554c46ceb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7d84a14c-5e68-4a0d-b84d-83928e08d660 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5e2d8e3-61b7-4d73-8032-b90d179e767d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7d84a14c-5e68-4a0d-b84d-83928e08d660 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5e2d8e3-61b7-4d73-8032-b90d179e767d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9be747a5-8ef1-4010-af3d-6bca04e14382', 'volume_name': 'volume-9be747a5-8ef1-4010-af3d-6bca04e14382', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7d84a14c-5e68-4a0d-b84d-83928e08d660 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca5eaf4-2242-410f-9c0f-a90b31f6fd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7d84a14c-5e68-4a0d-b84d-83928e08d660 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca5eaf4-2242-410f-9c0f-a90b31f6fd92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7d84a14c-5e68-4a0d-b84d-83928e08d660 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3fac5e7-359e-4a39-b7d4-260ea8cbc8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:18 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-7d84a14c-5e68-4a0d-b84d-83928e08d660 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Volume 9be747a5-8ef1-4010-af3d-6bca04e14382: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9be747a5-8ef1-4010-af3d-6bca04e14382', 'volume_size': 1} Jul 10 06:57:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7d84a14c-5e68-4a0d-b84d-83928e08d660 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6cff4975-1365-4848-b503-a78b9b3a92c5_ynxzzyke" returned: 0 in 1.020s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6cff4975-1365-4848-b503-a78b9b3a92c5_ynxzzyke {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:18 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-d9c21daa-c7bb-45b6-93ba-c68d31d9b7d3 tempest-CreateVolumesFromImageTest-1630141042 None] Created reservations ['76e7705d-e01f-4454-a657-f69aa36f4b54', 'f12e182d-4070-4315-ae85-f77ed42c530f', '24580019-dc1f-402e-a6c3-353ecf160897', 'c6d0acbb-8391-44eb-adba-822da9629ff4'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:57:18 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8.da535b6a-7fcd-464a-aac4-f01c59a7442c" returned: 0 in 1.070s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:18 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dc3c309-8559-4e78-acdb-319f2b220bc8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:57:18 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8 {{(pid=87294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 06:57:18 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Creating direct copy from snapshot {{(pid=87294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 06:57:18 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-967f9571-0e36-498c-a362-b00c81fa7ce0 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:57:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-967f9571-0e36-498c-a362-b00c81fa7ce0 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Flow 'volume_create_manager' (243ab6ea-2934-41ce-a566-b7371825095e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-967f9571-0e36-498c-a362-b00c81fa7ce0 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62ac5a8c-61cc-44df-8662-6e8309d8dd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:18 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cd6170-cebc-4d04-bb1d-d18a766cb890]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:57:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:18 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6cff4975-1365-4848-b503-a78b9b3a92c5_ynxzzyke Jul 10 06:57:18 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-967f9571-0e36-498c-a362-b00c81fa7ce0 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62ac5a8c-61cc-44df-8662-6e8309d8dd61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1071960630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90576f24-9382-4954-86af-c6784477e22b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f646c4fdb4d74c3c99368db448a41505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:57:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:57:19Z,use_quota=True,user_id='d12f423193ad41cb9a4d7c7156fa97a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-967f9571-0e36-498c-a362-b00c81fa7ce0 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dccb266-b136-4f6c-b090-58d3f157f87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-967f9571-0e36-498c-a362-b00c81fa7ce0 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dccb266-b136-4f6c-b090-58d3f157f87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-967f9571-0e36-498c-a362-b00c81fa7ce0 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab941e53-8adc-4a25-be7d-ad61d8f7d6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-967f9571-0e36-498c-a362-b00c81fa7ce0 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab941e53-8adc-4a25-be7d-ad61d8f7d6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90576f24-9382-4954-86af-c6784477e22b', 'volume_name': 'volume-90576f24-9382-4954-86af-c6784477e22b', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-967f9571-0e36-498c-a362-b00c81fa7ce0 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18e6fc4d-36e1-446b-9d62-d056736e16b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-967f9571-0e36-498c-a362-b00c81fa7ce0 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18e6fc4d-36e1-446b-9d62-d056736e16b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:18 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-967f9571-0e36-498c-a362-b00c81fa7ce0 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b89f96f-a5c6-4ab1-bd56-dd9acd3d86bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:18 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-967f9571-0e36-498c-a362-b00c81fa7ce0 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Volume 90576f24-9382-4954-86af-c6784477e22b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90576f24-9382-4954-86af-c6784477e22b', 'volume_size': 1} Jul 10 06:57:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-967f9571-0e36-498c-a362-b00c81fa7ce0 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d9c21daa-c7bb-45b6-93ba-c68d31d9b7d3 tempest-CreateVolumesFromImageTest-1630141042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d9c21daa-c7bb-45b6-93ba-c68d31d9b7d3 tempest-CreateVolumesFromImageTest-1630141042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:18 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-d9c21daa-c7bb-45b6-93ba-c68d31d9b7d3 tempest-CreateVolumesFromImageTest-1630141042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:57:18 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8 Jul 10 06:57:18 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-d9c21daa-c7bb-45b6-93ba-c68d31d9b7d3 tempest-CreateVolumesFromImageTest-1630141042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:57:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d9c21daa-c7bb-45b6-93ba-c68d31d9b7d3 tempest-CreateVolumesFromImageTest-1630141042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:18 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d9c21daa-c7bb-45b6-93ba-c68d31d9b7d3 tempest-CreateVolumesFromImageTest-1630141042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:18 devstack sudo[106070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:57:18 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:19 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6cff4975-1365-4848-b503-a78b9b3a92c5_ynxzzyke" returned: 1 in 0.787s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6cff4975-1365-4848-b503-a78b9b3a92c5_ynxzzyke' failed. Not Retrying. {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:57:19 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdee01ab-ad53-4eb6-85a7-7edd54b57cc7]: (4, 'raw') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:57:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6cff4975-1365-4848-b503-a78b9b3a92c5_n5uaxwoadevstack@QuobyteHD {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:19 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8" returned: 0 in 0.779s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:19 devstack cinder-volume[87294]: DEBUG cinder.utils [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Path /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-3f4068cf-21f2-4c0c-a562-260e1092fef1 not found in is_blk_device check {{(pid=87294) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 06:57:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-3f4068cf-21f2-4c0c-a562-260e1092fef1 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:19 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6cff4975-1365-4848-b503-a78b9b3a92c5_n5uaxwoadevstack@QuobyteHD Jul 10 06:57:19 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:19 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-3f4068cf-21f2-4c0c-a562-260e1092fef1 Jul 10 06:57:19 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:19 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d9c21daa-c7bb-45b6-93ba-c68d31d9b7d3 tempest-CreateVolumesFromImageTest-1630141042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.768s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:19 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-d9c21daa-c7bb-45b6-93ba-c68d31d9b7d3 tempest-CreateVolumesFromImageTest-1630141042 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:57:19 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-d9c21daa-c7bb-45b6-93ba-c68d31d9b7d3 tempest-CreateVolumesFromImageTest-1630141042 None] Deleted volume successfully. Jul 10 06:57:19 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d9c21daa-c7bb-45b6-93ba-c68d31d9b7d3 tempest-CreateVolumesFromImageTest-1630141042 None] Lock "cinder-53bb2923-0160-4718-b7d6-d6e7b0474d80-delete_volume" released by "delete_volume" :: held 3.407s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:57:20 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6cff4975-1365-4848-b503-a78b9b3a92c5_n5uaxwoadevstack@QuobyteHD" returned: 0 in 0.757s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6cff4975-1365-4848-b503-a78b9b3a92c5_n5uaxwoadevstack@QuobyteHD {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:20 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6cff4975-1365-4848-b503-a78b9b3a92c5_n5uaxwoadevstack@QuobyteHD Jul 10 06:57:20 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:21 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6cff4975-1365-4848-b503-a78b9b3a92c5_n5uaxwoadevstack@QuobyteHD" returned: 1 in 1.414s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6cff4975-1365-4848-b503-a78b9b3a92c5_n5uaxwoadevstack@QuobyteHD' failed. Not Retrying. {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:57:21 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] 6cff4975-1365-4848-b503-a78b9b3a92c5 was raw, converting to raw {{(pid=87294) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 06:57:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6cff4975-1365-4848-b503-a78b9b3a92c5_n5uaxwoadevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-433528f5-09d7-47b6-b929-0245291bf28a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:21 devstack sudo[106101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6cff4975-1365-4848-b503-a78b9b3a92c5_n5uaxwoadevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-433528f5-09d7-47b6-b929-0245291bf28a Jul 10 06:57:21 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:21 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:57:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:57:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:57:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:22 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:57:22 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:23 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.351s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:23 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:57:23 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager._thread_info {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:57:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread count: 28 {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:57:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread info: [<_MainThread(MainThread, started 139245706264704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:57:23 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6cff4975-1365-4848-b503-a78b9b3a92c5_n5uaxwoadevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-433528f5-09d7-47b6-b929-0245291bf28a" returned: 0 in 2.340s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:24 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6cff4975-1365-4848-b503-a78b9b3a92c5_n5uaxwoadevstack@QuobyteHD, size 0.00 MB, duration 2.35 sec, destination /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-433528f5-09d7-47b6-b929-0245291bf28a {{(pid=87294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 06:57:24 devstack cinder-volume[87294]: INFO cinder.image.image_utils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 06:57:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-433528f5-09d7-47b6-b929-0245291bf28a 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:24 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-433528f5-09d7-47b6-b929-0245291bf28a 1G Jul 10 06:57:24 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:25 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-433528f5-09d7-47b6-b929-0245291bf28a 1G" returned: 0 in 1.689s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:25 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a06a12-f2f1-4097-bb37-11b4ddd16118]: (4, 'raw') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:57:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-433528f5-09d7-47b6-b929-0245291bf28a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:25 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-3f4068cf-21f2-4c0c-a562-260e1092fef1" returned: 0 in 6.210s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:25 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5445a2-52be-4d7f-a6bd-b766e50159b8]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:57:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:25 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-433528f5-09d7-47b6-b929-0245291bf28a Jul 10 06:57:25 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:25 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8 Jul 10 06:57:25 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:25 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-92e50581-bf73-4855-9b83-e1cf7b89add3 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:57:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-92e50581-bf73-4855-9b83-e1cf7b89add3 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Flow 'volume_create_manager' (0a14fd0a-eef8-47b4-be4a-3111137a0269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-92e50581-bf73-4855-9b83-e1cf7b89add3 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1d3ac3e-d4eb-4e48-be6e-dfc9390bbe65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-92e50581-bf73-4855-9b83-e1cf7b89add3 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1d3ac3e-d4eb-4e48-be6e-dfc9390bbe65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1444813151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02657582-42b6-409f-9a75-7da96d79f1ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7771f46cf86d45fa9ed083478cce8def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:57:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:57:26Z,use_quota=True,user_id='a7ef439e73b74e47bc04d9da93e12c36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-92e50581-bf73-4855-9b83-e1cf7b89add3 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0235a880-eda2-4fe0-9f35-6f4f36f8bb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-92e50581-bf73-4855-9b83-e1cf7b89add3 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0235a880-eda2-4fe0-9f35-6f4f36f8bb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-92e50581-bf73-4855-9b83-e1cf7b89add3 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b27af41-caa4-445e-b2e1-f6e6fd8eb499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-92e50581-bf73-4855-9b83-e1cf7b89add3 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b27af41-caa4-445e-b2e1-f6e6fd8eb499) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02657582-42b6-409f-9a75-7da96d79f1ff', 'volume_name': 'volume-02657582-42b6-409f-9a75-7da96d79f1ff', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-92e50581-bf73-4855-9b83-e1cf7b89add3 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dc77e60-3614-4470-b4dd-a8f842be0e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-92e50581-bf73-4855-9b83-e1cf7b89add3 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dc77e60-3614-4470-b4dd-a8f842be0e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-92e50581-bf73-4855-9b83-e1cf7b89add3 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77452c52-01ac-4704-8624-a67f2b1d748e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:26 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-92e50581-bf73-4855-9b83-e1cf7b89add3 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Volume 02657582-42b6-409f-9a75-7da96d79f1ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02657582-42b6-409f-9a75-7da96d79f1ff', 'volume_size': 1} Jul 10 06:57:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-92e50581-bf73-4855-9b83-e1cf7b89add3 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:26 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-433528f5-09d7-47b6-b929-0245291bf28a" returned: 0 in 0.804s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-433528f5-09d7-47b6-b929-0245291bf28a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:26 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-433528f5-09d7-47b6-b929-0245291bf28a Jul 10 06:57:26 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:26 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8" returned: 0 in 1.034s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:26 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8, size 1024.00 MB, duration 6.21 sec, destination /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-3f4068cf-21f2-4c0c-a562-260e1092fef1 {{(pid=87294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 06:57:26 devstack cinder-volume[87294]: INFO cinder.image.image_utils [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Converted 1024.00 MB image at 164.83 MB/s Jul 10 06:57:26 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-3f4068cf-21f2-4c0c-a562-260e1092fef1 is being set with open permissions: ugo+rw Jul 10 06:57:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-3f4068cf-21f2-4c0c-a562-260e1092fef1 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:26 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-3f4068cf-21f2-4c0c-a562-260e1092fef1 Jul 10 06:57:26 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:27 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-433528f5-09d7-47b6-b929-0245291bf28a" returned: 1 in 0.748s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-433528f5-09d7-47b6-b929-0245291bf28a' failed. Not Retrying. {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:57:27 devstack cinder-volume[87294]: DEBUG cinder.volume.volume_utils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Downloaded image 6cff4975-1365-4848-b503-a78b9b3a92c5 ((None, [{'url': 'file:///opt/stack/data/glance/images/6cff4975-1365-4848-b503-a78b9b3a92c5', 'metadata': {}}])) to volume 433528f5-09d7-47b6-b929-0245291bf28a successfully. {{(pid=87294) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 06:57:27 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Temporary image 6cff4975-1365-4848-b503-a78b9b3a92c5 for user 98f85848aa5c4889b58fb61d02c62d49 is deleted. {{(pid=87294) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 06:57:27 devstack cinder-volume[87294]: DEBUG cinder.volume.volume_utils [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Marking volume 433528f5-09d7-47b6-b929-0245291bf28a as bootable. {{(pid=87294) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 06:57:27 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Copying metadata from image 6cff4975-1365-4848-b503-a78b9b3a92c5 to 433528f5-09d7-47b6-b929-0245291bf28a. {{(pid=87294) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 06:57:27 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Creating volume glance metadata for volume 433528f5-09d7-47b6-b929-0245291bf28a backed by image 6cff4975-1365-4848-b503-a78b9b3a92c5 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '6cff4975-1365-4848-b503-a78b9b3a92c5', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '757a46f868fb5e5bfd0d54aead2b71df', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87294) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 06:57:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa99fdbb-6f29-4941-a557-a2b0793dd536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-433528f5-09d7-47b6-b929-0245291bf28a', 'volume_size': 1, 'image_id': '6cff4975-1365-4848-b503-a78b9b3a92c5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6cff4975-1365-4848-b503-a78b9b3a92c5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '757a46f868fb5e5bfd0d54aead2b71df', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2eeda33d434244d59e5c6875c0cb0fa8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fc42db8407b153291ac6109309838faaeb439562e83413998a246730dab70810cc6ab2fd46ed3b3c0e45a4a94286a36153028b83da66f564a41fd98eb2e0dc1a', 'id': '6cff4975-1365-4848-b503-a78b9b3a92c5', 'created_at': datetime.datetime(2026, 7, 10, 4, 56, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 56, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6cff4975-1365-4848-b503-a78b9b3a92c5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (246b3a16-ab86-450b-89e7-63fd15a8b6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:27 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Volume volume-433528f5-09d7-47b6-b929-0245291bf28a (433528f5-09d7-47b6-b929-0245291bf28a): created successfully Jul 10 06:57:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (246b3a16-ab86-450b-89e7-63fd15a8b6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Flow 'volume_create_manager' (406ba652-388a-4e05-8a8a-18aaea771366) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:27 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-3dd97729-edb3-45ba-ab52-f43c850ea564 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Created volume successfully. Jul 10 06:57:27 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-3f4068cf-21f2-4c0c-a562-260e1092fef1" returned: 0 in 0.726s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:27 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Lock "cinder-quobyte-3f4068cf-21f2-4c0c-a562-260e1092fef1" released by "_copy_volume_from_snapshot" :: held 9.990s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:57:27 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Lock "cinder-quobyte-da535b6a-7fcd-464a-aac4-f01c59a7442c-3f4068cf-21f2-4c0c-a562-260e1092fef1" released by "_create_volume_from_snapshot" :: held 10.080s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:57:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.160s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-dd091c13-eb7b-4f01-9a80-211739604e1f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.652s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:27 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-dd091c13-eb7b-4f01-9a80-211739604e1f tempest-CreateVolumesFromSnapshotTest-2117965649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-472071856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df8c37d0-8e16-48ac-8578-8db5543cc9e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f646c4fdb4d74c3c99368db448a41505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:57:17Z,use_quota=True,user_id='d12f423193ad41cb9a4d7c7156fa97a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:57:27 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-dd091c13-eb7b-4f01-9a80-211739604e1f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Creating volume df8c37d0-8e16-48ac-8578-8db5543cc9e8 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:57:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-dd091c13-eb7b-4f01-9a80-211739604e1f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-dd091c13-eb7b-4f01-9a80-211739604e1f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:27 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-dd091c13-eb7b-4f01-9a80-211739604e1f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:57:27 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-dd091c13-eb7b-4f01-9a80-211739604e1f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:57:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-dd091c13-eb7b-4f01-9a80-211739604e1f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:27 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-dd091c13-eb7b-4f01-9a80-211739604e1f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:57:27 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-dd091c13-eb7b-4f01-9a80-211739604e1f tempest-CreateVolumesFromSnapshotTest-2117965649 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:57:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-dd091c13-eb7b-4f01-9a80-211739604e1f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-df8c37d0-8e16-48ac-8578-8db5543cc9e8 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:27 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-df8c37d0-8e16-48ac-8578-8db5543cc9e8 1073741824 Jul 10 06:57:27 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cb9cef9-4154-442a-81b1-1be9f6ef5b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f4068cf-21f2-4c0c-a562-260e1092fef1', 'volume_size': 1, 'snapshot_id': 'da535b6a-7fcd-464a-aac4-f01c59a7442c'}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5f645fd-b729-446e-8e20-97932e79d58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:27 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Volume volume-3f4068cf-21f2-4c0c-a562-260e1092fef1 (3f4068cf-21f2-4c0c-a562-260e1092fef1): created successfully Jul 10 06:57:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5f645fd-b729-446e-8e20-97932e79d58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Flow 'volume_create_manager' (a0207472-c9d6-4407-81fc-3ce1145a7226) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:27 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-f82f7fb0-004b-40a7-bba8-9e91faf875b2 tempest-VolumeDependencyTests-2007432391 None] Created volume successfully. Jul 10 06:57:28 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6c9ffd8c-7263-4c3c-ad97-e338f0f1c0d4 tempest-VolumeDependencyTests-2007432391 None] Acquiring lock "cinder-da535b6a-7fcd-464a-aac4-f01c59a7442c-delete_snapshot" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:57:28 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6c9ffd8c-7263-4c3c-ad97-e338f0f1c0d4 tempest-VolumeDependencyTests-2007432391 None] Lock "cinder-da535b6a-7fcd-464a-aac4-f01c59a7442c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:57:28 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6c9ffd8c-7263-4c3c-ad97-e338f0f1c0d4 tempest-VolumeDependencyTests-2007432391 None] Acquiring lock "cinder-quobyte-6dc3c309-8559-4e78-acdb-319f2b220bc8" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:57:28 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6c9ffd8c-7263-4c3c-ad97-e338f0f1c0d4 tempest-VolumeDependencyTests-2007432391 None] Lock "cinder-quobyte-6dc3c309-8559-4e78-acdb-319f2b220bc8" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:57:28 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6c9ffd8c-7263-4c3c-ad97-e338f0f1c0d4 tempest-VolumeDependencyTests-2007432391 None] Acquiring lock "cinder-quobyte-da535b6a-7fcd-464a-aac4-f01c59a7442c" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:57:28 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6c9ffd8c-7263-4c3c-ad97-e338f0f1c0d4 tempest-VolumeDependencyTests-2007432391 None] Lock "cinder-quobyte-da535b6a-7fcd-464a-aac4-f01c59a7442c" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:57:28 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-6c9ffd8c-7263-4c3c-ad97-e338f0f1c0d4 tempest-VolumeDependencyTests-2007432391 None] Deleting offline snapshot da535b6a-7fcd-464a-aac4-f01c59a7442c of volume 6dc3c309-8559-4e78-acdb-319f2b220bc8 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:57:28 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-6c9ffd8c-7263-4c3c-ad97-e338f0f1c0d4 tempest-VolumeDependencyTests-2007432391 None] snapshot_file for this snap is: volume-6dc3c309-8559-4e78-acdb-319f2b220bc8.da535b6a-7fcd-464a-aac4-f01c59a7442c {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:57:28 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e2d819-e1d0-49ed-8610-bcfa4bbbdf6a]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:57:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6c9ffd8c-7263-4c3c-ad97-e338f0f1c0d4 tempest-VolumeDependencyTests-2007432391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8.da535b6a-7fcd-464a-aac4-f01c59a7442c {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:28 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c1a58bc3-8ab0-4fc9-8bc2-07483bab94f4 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Acquiring lock "cinder-433528f5-09d7-47b6-b929-0245291bf28a-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:57:28 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c1a58bc3-8ab0-4fc9-8bc2-07483bab94f4 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Lock "cinder-433528f5-09d7-47b6-b929-0245291bf28a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:57:28 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c1a58bc3-8ab0-4fc9-8bc2-07483bab94f4 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Acquiring lock "cinder-quobyte-433528f5-09d7-47b6-b929-0245291bf28a" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:57:28 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c1a58bc3-8ab0-4fc9-8bc2-07483bab94f4 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Lock "cinder-quobyte-433528f5-09d7-47b6-b929-0245291bf28a" acquired by "delete_volume" :: waited 0.013s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:57:28 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4cc13a-dd3d-4ab3-b30c-835aabaac5d5]: (4, 'raw') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:57:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c1a58bc3-8ab0-4fc9-8bc2-07483bab94f4 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-433528f5-09d7-47b6-b929-0245291bf28a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:28 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8.da535b6a-7fcd-464a-aac4-f01c59a7442c Jul 10 06:57:28 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:28 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-433528f5-09d7-47b6-b929-0245291bf28a Jul 10 06:57:28 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:28 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-dd091c13-eb7b-4f01-9a80-211739604e1f tempest-CreateVolumesFromSnapshotTest-2117965649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-df8c37d0-8e16-48ac-8578-8db5543cc9e8 1073741824" returned: 0 in 0.913s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-dd091c13-eb7b-4f01-9a80-211739604e1f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-df8c37d0-8e16-48ac-8578-8db5543cc9e8 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:28 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-df8c37d0-8e16-48ac-8578-8db5543cc9e8 Jul 10 06:57:28 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:28 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6c9ffd8c-7263-4c3c-ad97-e338f0f1c0d4 tempest-VolumeDependencyTests-2007432391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8.da535b6a-7fcd-464a-aac4-f01c59a7442c" returned: 0 in 0.795s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:28 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-6c9ffd8c-7263-4c3c-ad97-e338f0f1c0d4 tempest-VolumeDependencyTests-2007432391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dc3c309-8559-4e78-acdb-319f2b220bc8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:57:29 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[7250a4ee-1b5e-4ac7-9076-eaae44964038]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:57:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6c9ffd8c-7263-4c3c-ad97-e338f0f1c0d4 tempest-VolumeDependencyTests-2007432391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:29 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c1a58bc3-8ab0-4fc9-8bc2-07483bab94f4 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-433528f5-09d7-47b6-b929-0245291bf28a" returned: 0 in 0.800s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c1a58bc3-8ab0-4fc9-8bc2-07483bab94f4 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-433528f5-09d7-47b6-b929-0245291bf28a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:29 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8 Jul 10 06:57:29 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:29 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-dd091c13-eb7b-4f01-9a80-211739604e1f tempest-CreateVolumesFromSnapshotTest-2117965649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-df8c37d0-8e16-48ac-8578-8db5543cc9e8" returned: 0 in 0.676s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:29 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-dd091c13-eb7b-4f01-9a80-211739604e1f tempest-CreateVolumesFromSnapshotTest-2117965649 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:57:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-dd091c13-eb7b-4f01-9a80-211739604e1f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a21e1773-7ea6-455a-a1b9-428f8b6d3d05 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.646s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:29 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-a21e1773-7ea6-455a-a1b9-428f8b6d3d05 tempest-CreateVolumesFromSnapshotTest-2117965649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-937790237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08fdd3d5-ab56-4594-896d-0f35bfce3741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f646c4fdb4d74c3c99368db448a41505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:57:17Z,use_quota=True,user_id='d12f423193ad41cb9a4d7c7156fa97a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:57:29 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-a21e1773-7ea6-455a-a1b9-428f8b6d3d05 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Creating volume 08fdd3d5-ab56-4594-896d-0f35bfce3741 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:57:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a21e1773-7ea6-455a-a1b9-428f8b6d3d05 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a21e1773-7ea6-455a-a1b9-428f8b6d3d05 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:29 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-a21e1773-7ea6-455a-a1b9-428f8b6d3d05 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:57:29 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-a21e1773-7ea6-455a-a1b9-428f8b6d3d05 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:57:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a21e1773-7ea6-455a-a1b9-428f8b6d3d05 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:29 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-a21e1773-7ea6-455a-a1b9-428f8b6d3d05 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:57:29 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-a21e1773-7ea6-455a-a1b9-428f8b6d3d05 tempest-CreateVolumesFromSnapshotTest-2117965649 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:57:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a21e1773-7ea6-455a-a1b9-428f8b6d3d05 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-08fdd3d5-ab56-4594-896d-0f35bfce3741 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:29 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dd091c13-eb7b-4f01-9a80-211739604e1f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29b4c351-3ee9-4ad3-ba17-37e06055eb67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df8c37d0-8e16-48ac-8578-8db5543cc9e8', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:29 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-433528f5-09d7-47b6-b929-0245291bf28a Jul 10 06:57:29 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dd091c13-eb7b-4f01-9a80-211739604e1f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e47f8d5-23c9-4ddc-b417-45f85cd3c78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:29 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-08fdd3d5-ab56-4594-896d-0f35bfce3741 1073741824 Jul 10 06:57:29 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:29 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:29 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-dd091c13-eb7b-4f01-9a80-211739604e1f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Volume volume-df8c37d0-8e16-48ac-8578-8db5543cc9e8 (df8c37d0-8e16-48ac-8578-8db5543cc9e8): created successfully Jul 10 06:57:29 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dd091c13-eb7b-4f01-9a80-211739604e1f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e47f8d5-23c9-4ddc-b417-45f85cd3c78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:29 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-dd091c13-eb7b-4f01-9a80-211739604e1f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Flow 'volume_create_manager' (98621a24-947b-46b4-89a2-049e09311b07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:29 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-dd091c13-eb7b-4f01-9a80-211739604e1f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Created volume successfully. Jul 10 06:57:29 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6c9ffd8c-7263-4c3c-ad97-e338f0f1c0d4 tempest-VolumeDependencyTests-2007432391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8" returned: 0 in 0.832s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6c9ffd8c-7263-4c3c-ad97-e338f0f1c0d4 tempest-VolumeDependencyTests-2007432391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8.da535b6a-7fcd-464a-aac4-f01c59a7442c {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:29 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8.da535b6a-7fcd-464a-aac4-f01c59a7442c Jul 10 06:57:29 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:30 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c1a58bc3-8ab0-4fc9-8bc2-07483bab94f4 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-433528f5-09d7-47b6-b929-0245291bf28a" returned: 1 in 0.870s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c1a58bc3-8ab0-4fc9-8bc2-07483bab94f4 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-433528f5-09d7-47b6-b929-0245291bf28a' failed. Not Retrying. {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:57:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c1a58bc3-8ab0-4fc9-8bc2-07483bab94f4 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-433528f5-09d7-47b6-b929-0245291bf28a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:30 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-433528f5-09d7-47b6-b929-0245291bf28a Jul 10 06:57:30 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:30 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a21e1773-7ea6-455a-a1b9-428f8b6d3d05 tempest-CreateVolumesFromSnapshotTest-2117965649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-08fdd3d5-ab56-4594-896d-0f35bfce3741 1073741824" returned: 0 in 0.901s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a21e1773-7ea6-455a-a1b9-428f8b6d3d05 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-08fdd3d5-ab56-4594-896d-0f35bfce3741 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:30 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-08fdd3d5-ab56-4594-896d-0f35bfce3741 Jul 10 06:57:30 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:30 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6c9ffd8c-7263-4c3c-ad97-e338f0f1c0d4 tempest-VolumeDependencyTests-2007432391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8.da535b6a-7fcd-464a-aac4-f01c59a7442c" returned: 0 in 0.789s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6c9ffd8c-7263-4c3c-ad97-e338f0f1c0d4 tempest-VolumeDependencyTests-2007432391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8.da535b6a-7fcd-464a-aac4-f01c59a7442c {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:30 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8.da535b6a-7fcd-464a-aac4-f01c59a7442c Jul 10 06:57:30 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:30 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c1a58bc3-8ab0-4fc9-8bc2-07483bab94f4 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-433528f5-09d7-47b6-b929-0245291bf28a" returned: 0 in 0.726s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:30 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c1a58bc3-8ab0-4fc9-8bc2-07483bab94f4 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Lock "cinder-quobyte-433528f5-09d7-47b6-b929-0245291bf28a" released by "delete_volume" :: held 2.462s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:57:30 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-c1a58bc3-8ab0-4fc9-8bc2-07483bab94f4 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Created reservations ['ea38cb4f-9954-45a0-bc0d-6029feb6a82c', 'dd737f47-6db7-48f2-bf5b-ec715802fb44', '3e2e955c-17d7-4073-b630-304a0d94d63b', '488abb6b-9e87-4fca-abdc-56a5becdadfa'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:57:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c1a58bc3-8ab0-4fc9-8bc2-07483bab94f4 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c1a58bc3-8ab0-4fc9-8bc2-07483bab94f4 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:30 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-c1a58bc3-8ab0-4fc9-8bc2-07483bab94f4 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:57:30 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-c1a58bc3-8ab0-4fc9-8bc2-07483bab94f4 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:57:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c1a58bc3-8ab0-4fc9-8bc2-07483bab94f4 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c1a58bc3-8ab0-4fc9-8bc2-07483bab94f4 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:30 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:57:30 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:30 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a21e1773-7ea6-455a-a1b9-428f8b6d3d05 tempest-CreateVolumesFromSnapshotTest-2117965649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-08fdd3d5-ab56-4594-896d-0f35bfce3741" returned: 0 in 0.748s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:30 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-a21e1773-7ea6-455a-a1b9-428f8b6d3d05 tempest-CreateVolumesFromSnapshotTest-2117965649 None] <== create_volume: return (1701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:57:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a21e1773-7ea6-455a-a1b9-428f8b6d3d05 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.706s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b5d1e21b-7c1d-4aeb-9f18-7d5de9b2bc91 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.942s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:30 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b5d1e21b-7c1d-4aeb-9f18-7d5de9b2bc91 tempest-CreateVolumesFromSnapshotTest-2117965649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-835942658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f4f508e-d2f9-414a-9f66-3ac2dc4a4ee5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f646c4fdb4d74c3c99368db448a41505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:57:18Z,use_quota=True,user_id='d12f423193ad41cb9a4d7c7156fa97a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:57:30 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-b5d1e21b-7c1d-4aeb-9f18-7d5de9b2bc91 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Creating volume 9f4f508e-d2f9-414a-9f66-3ac2dc4a4ee5 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:57:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b5d1e21b-7c1d-4aeb-9f18-7d5de9b2bc91 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b5d1e21b-7c1d-4aeb-9f18-7d5de9b2bc91 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:30 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b5d1e21b-7c1d-4aeb-9f18-7d5de9b2bc91 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:57:30 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b5d1e21b-7c1d-4aeb-9f18-7d5de9b2bc91 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:57:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b5d1e21b-7c1d-4aeb-9f18-7d5de9b2bc91 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:30 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b5d1e21b-7c1d-4aeb-9f18-7d5de9b2bc91 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:57:30 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-b5d1e21b-7c1d-4aeb-9f18-7d5de9b2bc91 tempest-CreateVolumesFromSnapshotTest-2117965649 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:57:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b5d1e21b-7c1d-4aeb-9f18-7d5de9b2bc91 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9f4f508e-d2f9-414a-9f66-3ac2dc4a4ee5 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:30 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a21e1773-7ea6-455a-a1b9-428f8b6d3d05 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdc5327b-5a6a-4733-8c16-27061802ecc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08fdd3d5-ab56-4594-896d-0f35bfce3741', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:30 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9f4f508e-d2f9-414a-9f66-3ac2dc4a4ee5 1073741824 Jul 10 06:57:30 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:30 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a21e1773-7ea6-455a-a1b9-428f8b6d3d05 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64399921-597b-4671-8144-b2626783c609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:31 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-a21e1773-7ea6-455a-a1b9-428f8b6d3d05 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Volume volume-08fdd3d5-ab56-4594-896d-0f35bfce3741 (08fdd3d5-ab56-4594-896d-0f35bfce3741): created successfully Jul 10 06:57:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a21e1773-7ea6-455a-a1b9-428f8b6d3d05 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64399921-597b-4671-8144-b2626783c609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-a21e1773-7ea6-455a-a1b9-428f8b6d3d05 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Flow 'volume_create_manager' (c420f9df-6e2e-4b81-998f-fc29dc1fc12b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:31 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-a21e1773-7ea6-455a-a1b9-428f8b6d3d05 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Created volume successfully. Jul 10 06:57:31 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6c9ffd8c-7263-4c3c-ad97-e338f0f1c0d4 tempest-VolumeDependencyTests-2007432391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8.da535b6a-7fcd-464a-aac4-f01c59a7442c" returned: 0 in 0.711s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:31 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6c9ffd8c-7263-4c3c-ad97-e338f0f1c0d4 tempest-VolumeDependencyTests-2007432391 None] Lock "cinder-quobyte-da535b6a-7fcd-464a-aac4-f01c59a7442c" released by "_delete_snapshot" :: held 3.246s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:57:31 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6c9ffd8c-7263-4c3c-ad97-e338f0f1c0d4 tempest-VolumeDependencyTests-2007432391 None] Lock "cinder-quobyte-6dc3c309-8559-4e78-acdb-319f2b220bc8" released by "delete_snapshot" :: held 3.285s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:57:31 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-6c9ffd8c-7263-4c3c-ad97-e338f0f1c0d4 tempest-VolumeDependencyTests-2007432391 None] Created reservations ['10cd4ff0-e49c-42bc-9786-0ffc8af1e1b8', '79559e23-4dd4-42f1-b023-99736e48a0a3', 'be297ea7-8bba-4835-9fae-7b542ffee3f5', '0127616f-7dec-4782-816f-47edf49a6da0'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:57:31 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-6c9ffd8c-7263-4c3c-ad97-e338f0f1c0d4 tempest-VolumeDependencyTests-2007432391 None] Delete snapshot completed successfully. Jul 10 06:57:31 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6c9ffd8c-7263-4c3c-ad97-e338f0f1c0d4 tempest-VolumeDependencyTests-2007432391 None] Lock "cinder-da535b6a-7fcd-464a-aac4-f01c59a7442c-delete_snapshot" released by "delete_snapshot" :: held 3.504s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:57:31 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c1a58bc3-8ab0-4fc9-8bc2-07483bab94f4 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.748s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:31 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-c1a58bc3-8ab0-4fc9-8bc2-07483bab94f4 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:57:31 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-c1a58bc3-8ab0-4fc9-8bc2-07483bab94f4 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Deleted volume successfully. Jul 10 06:57:31 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c1a58bc3-8ab0-4fc9-8bc2-07483bab94f4 tempest-VolumeAndVolumeTypeFromImageTest-1399746318 None] Lock "cinder-433528f5-09d7-47b6-b929-0245291bf28a-delete_volume" released by "delete_volume" :: held 3.434s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:57:31 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b5d1e21b-7c1d-4aeb-9f18-7d5de9b2bc91 tempest-CreateVolumesFromSnapshotTest-2117965649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9f4f508e-d2f9-414a-9f66-3ac2dc4a4ee5 1073741824" returned: 0 in 0.972s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b5d1e21b-7c1d-4aeb-9f18-7d5de9b2bc91 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9f4f508e-d2f9-414a-9f66-3ac2dc4a4ee5 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:31 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9f4f508e-d2f9-414a-9f66-3ac2dc4a4ee5 Jul 10 06:57:31 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:32 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a35883e1-f2e9-4127-bd20-4eca358c0581 tempest-VolumeDependencyTests-2007432391 None] Acquiring lock "cinder-6dc3c309-8559-4e78-acdb-319f2b220bc8-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:57:32 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a35883e1-f2e9-4127-bd20-4eca358c0581 tempest-VolumeDependencyTests-2007432391 None] Lock "cinder-6dc3c309-8559-4e78-acdb-319f2b220bc8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:57:32 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a35883e1-f2e9-4127-bd20-4eca358c0581 tempest-VolumeDependencyTests-2007432391 None] Acquiring lock "cinder-quobyte-6dc3c309-8559-4e78-acdb-319f2b220bc8" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:57:32 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a35883e1-f2e9-4127-bd20-4eca358c0581 tempest-VolumeDependencyTests-2007432391 None] Lock "cinder-quobyte-6dc3c309-8559-4e78-acdb-319f2b220bc8" acquired by "delete_volume" :: waited 0.018s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:57:32 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f09eea-2d43-410b-af0a-40d039dc6471]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:57:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a35883e1-f2e9-4127-bd20-4eca358c0581 tempest-VolumeDependencyTests-2007432391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:32 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8 Jul 10 06:57:32 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:32 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b5d1e21b-7c1d-4aeb-9f18-7d5de9b2bc91 tempest-CreateVolumesFromSnapshotTest-2117965649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9f4f508e-d2f9-414a-9f66-3ac2dc4a4ee5" returned: 0 in 0.694s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:32 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b5d1e21b-7c1d-4aeb-9f18-7d5de9b2bc91 tempest-CreateVolumesFromSnapshotTest-2117965649 None] <== create_volume: return (1711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:57:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b5d1e21b-7c1d-4aeb-9f18-7d5de9b2bc91 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.716s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7d84a14c-5e68-4a0d-b84d-83928e08d660 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.996s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:32 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-7d84a14c-5e68-4a0d-b84d-83928e08d660 tempest-CreateVolumesFromSnapshotTest-2117965649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-800967599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9be747a5-8ef1-4010-af3d-6bca04e14382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f646c4fdb4d74c3c99368db448a41505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:57:18Z,use_quota=True,user_id='d12f423193ad41cb9a4d7c7156fa97a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:57:32 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-7d84a14c-5e68-4a0d-b84d-83928e08d660 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Creating volume 9be747a5-8ef1-4010-af3d-6bca04e14382 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:57:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7d84a14c-5e68-4a0d-b84d-83928e08d660 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7d84a14c-5e68-4a0d-b84d-83928e08d660 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:32 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-7d84a14c-5e68-4a0d-b84d-83928e08d660 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:57:32 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-7d84a14c-5e68-4a0d-b84d-83928e08d660 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:57:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7d84a14c-5e68-4a0d-b84d-83928e08d660 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:32 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-7d84a14c-5e68-4a0d-b84d-83928e08d660 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:57:32 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-7d84a14c-5e68-4a0d-b84d-83928e08d660 tempest-CreateVolumesFromSnapshotTest-2117965649 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:57:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7d84a14c-5e68-4a0d-b84d-83928e08d660 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9be747a5-8ef1-4010-af3d-6bca04e14382 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:32 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b5d1e21b-7c1d-4aeb-9f18-7d5de9b2bc91 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba39ce83-4752-45b7-a2e5-a627ab9e3246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f4f508e-d2f9-414a-9f66-3ac2dc4a4ee5', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:32 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9be747a5-8ef1-4010-af3d-6bca04e14382 1073741824 Jul 10 06:57:32 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:32 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b5d1e21b-7c1d-4aeb-9f18-7d5de9b2bc91 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc9f95d7-3697-452a-9bb0-95f9b741c503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:32 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-b5d1e21b-7c1d-4aeb-9f18-7d5de9b2bc91 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Volume volume-9f4f508e-d2f9-414a-9f66-3ac2dc4a4ee5 (9f4f508e-d2f9-414a-9f66-3ac2dc4a4ee5): created successfully Jul 10 06:57:32 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b5d1e21b-7c1d-4aeb-9f18-7d5de9b2bc91 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc9f95d7-3697-452a-9bb0-95f9b741c503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:32 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b5d1e21b-7c1d-4aeb-9f18-7d5de9b2bc91 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Flow 'volume_create_manager' (5b1a38d7-239b-4616-9751-ae46a929aa4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:32 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-b5d1e21b-7c1d-4aeb-9f18-7d5de9b2bc91 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Created volume successfully. Jul 10 06:57:33 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a35883e1-f2e9-4127-bd20-4eca358c0581 tempest-VolumeDependencyTests-2007432391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8" returned: 0 in 0.884s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a35883e1-f2e9-4127-bd20-4eca358c0581 tempest-VolumeDependencyTests-2007432391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:33 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8 Jul 10 06:57:33 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:33 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7d84a14c-5e68-4a0d-b84d-83928e08d660 tempest-CreateVolumesFromSnapshotTest-2117965649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9be747a5-8ef1-4010-af3d-6bca04e14382 1073741824" returned: 0 in 1.036s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7d84a14c-5e68-4a0d-b84d-83928e08d660 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9be747a5-8ef1-4010-af3d-6bca04e14382 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:33 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9be747a5-8ef1-4010-af3d-6bca04e14382 Jul 10 06:57:33 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:34 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a35883e1-f2e9-4127-bd20-4eca358c0581 tempest-VolumeDependencyTests-2007432391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-6dc3c309-8559-4e78-acdb-319f2b220bc8" returned: 0 in 0.810s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:34 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a35883e1-f2e9-4127-bd20-4eca358c0581 tempest-VolumeDependencyTests-2007432391 None] Lock "cinder-quobyte-6dc3c309-8559-4e78-acdb-319f2b220bc8" released by "delete_volume" :: held 1.771s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:57:34 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-a35883e1-f2e9-4127-bd20-4eca358c0581 tempest-VolumeDependencyTests-2007432391 None] Created reservations ['374f2456-395d-4a71-94d5-99916649d04a', '60f9e00b-9c9a-46ac-bb75-ac5841ffa3ec', '379e2343-1c24-4d83-ba31-41caa78ba85b', 'fa541379-0875-4ca3-b49f-d0d4ead4cd1c'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:57:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a35883e1-f2e9-4127-bd20-4eca358c0581 tempest-VolumeDependencyTests-2007432391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a35883e1-f2e9-4127-bd20-4eca358c0581 tempest-VolumeDependencyTests-2007432391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:34 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-a35883e1-f2e9-4127-bd20-4eca358c0581 tempest-VolumeDependencyTests-2007432391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:57:34 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-a35883e1-f2e9-4127-bd20-4eca358c0581 tempest-VolumeDependencyTests-2007432391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:57:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a35883e1-f2e9-4127-bd20-4eca358c0581 tempest-VolumeDependencyTests-2007432391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a35883e1-f2e9-4127-bd20-4eca358c0581 tempest-VolumeDependencyTests-2007432391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:34 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:57:34 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:34 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7d84a14c-5e68-4a0d-b84d-83928e08d660 tempest-CreateVolumesFromSnapshotTest-2117965649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9be747a5-8ef1-4010-af3d-6bca04e14382" returned: 0 in 0.733s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:34 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-7d84a14c-5e68-4a0d-b84d-83928e08d660 tempest-CreateVolumesFromSnapshotTest-2117965649 None] <== create_volume: return (1817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:57:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7d84a14c-5e68-4a0d-b84d-83928e08d660 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.819s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-967f9571-0e36-498c-a362-b00c81fa7ce0 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.625s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:34 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-967f9571-0e36-498c-a362-b00c81fa7ce0 tempest-CreateVolumesFromSnapshotTest-2117965649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1071960630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90576f24-9382-4954-86af-c6784477e22b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f646c4fdb4d74c3c99368db448a41505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:57:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:57:19Z,use_quota=True,user_id='d12f423193ad41cb9a4d7c7156fa97a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:57:34 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-967f9571-0e36-498c-a362-b00c81fa7ce0 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Creating volume 90576f24-9382-4954-86af-c6784477e22b {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:57:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-967f9571-0e36-498c-a362-b00c81fa7ce0 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-967f9571-0e36-498c-a362-b00c81fa7ce0 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:34 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-967f9571-0e36-498c-a362-b00c81fa7ce0 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:57:34 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-967f9571-0e36-498c-a362-b00c81fa7ce0 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:57:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-967f9571-0e36-498c-a362-b00c81fa7ce0 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:34 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-967f9571-0e36-498c-a362-b00c81fa7ce0 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:57:34 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-967f9571-0e36-498c-a362-b00c81fa7ce0 tempest-CreateVolumesFromSnapshotTest-2117965649 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:57:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-967f9571-0e36-498c-a362-b00c81fa7ce0 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-90576f24-9382-4954-86af-c6784477e22b 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:34 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-90576f24-9382-4954-86af-c6784477e22b 1073741824 Jul 10 06:57:34 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7d84a14c-5e68-4a0d-b84d-83928e08d660 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3fac5e7-359e-4a39-b7d4-260ea8cbc8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9be747a5-8ef1-4010-af3d-6bca04e14382', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7d84a14c-5e68-4a0d-b84d-83928e08d660 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98383b55-46f7-4da0-9882-f695d0f7d861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:34 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-7d84a14c-5e68-4a0d-b84d-83928e08d660 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Volume volume-9be747a5-8ef1-4010-af3d-6bca04e14382 (9be747a5-8ef1-4010-af3d-6bca04e14382): created successfully Jul 10 06:57:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7d84a14c-5e68-4a0d-b84d-83928e08d660 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98383b55-46f7-4da0-9882-f695d0f7d861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:34 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7d84a14c-5e68-4a0d-b84d-83928e08d660 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Flow 'volume_create_manager' (9e74e46e-56c1-4ac9-bd9c-1aab0bae035a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:34 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-7d84a14c-5e68-4a0d-b84d-83928e08d660 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Created volume successfully. Jul 10 06:57:34 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c1541541-5330-4b8b-9794-cc835f9db306 tempest-VolumeDependencyTests-2007432391 None] Acquiring lock "cinder-3f4068cf-21f2-4c0c-a562-260e1092fef1-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:57:34 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c1541541-5330-4b8b-9794-cc835f9db306 tempest-VolumeDependencyTests-2007432391 None] Lock "cinder-3f4068cf-21f2-4c0c-a562-260e1092fef1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:57:34 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c1541541-5330-4b8b-9794-cc835f9db306 tempest-VolumeDependencyTests-2007432391 None] Acquiring lock "cinder-quobyte-3f4068cf-21f2-4c0c-a562-260e1092fef1" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:57:34 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c1541541-5330-4b8b-9794-cc835f9db306 tempest-VolumeDependencyTests-2007432391 None] Lock "cinder-quobyte-3f4068cf-21f2-4c0c-a562-260e1092fef1" acquired by "delete_volume" :: waited 0.018s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:57:34 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabc3776-baa5-455d-b12f-86dfd85e93cd]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:57:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c1541541-5330-4b8b-9794-cc835f9db306 tempest-VolumeDependencyTests-2007432391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-3f4068cf-21f2-4c0c-a562-260e1092fef1 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:34 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-3f4068cf-21f2-4c0c-a562-260e1092fef1 Jul 10 06:57:34 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:35 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a35883e1-f2e9-4127-bd20-4eca358c0581 tempest-VolumeDependencyTests-2007432391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.830s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:35 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-a35883e1-f2e9-4127-bd20-4eca358c0581 tempest-VolumeDependencyTests-2007432391 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:57:35 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-a35883e1-f2e9-4127-bd20-4eca358c0581 tempest-VolumeDependencyTests-2007432391 None] Deleted volume successfully. Jul 10 06:57:35 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a35883e1-f2e9-4127-bd20-4eca358c0581 tempest-VolumeDependencyTests-2007432391 None] Lock "cinder-6dc3c309-8559-4e78-acdb-319f2b220bc8-delete_volume" released by "delete_volume" :: held 2.858s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:57:35 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-967f9571-0e36-498c-a362-b00c81fa7ce0 tempest-CreateVolumesFromSnapshotTest-2117965649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-90576f24-9382-4954-86af-c6784477e22b 1073741824" returned: 0 in 1.047s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-967f9571-0e36-498c-a362-b00c81fa7ce0 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-90576f24-9382-4954-86af-c6784477e22b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:35 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-90576f24-9382-4954-86af-c6784477e22b Jul 10 06:57:35 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:35 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c1541541-5330-4b8b-9794-cc835f9db306 tempest-VolumeDependencyTests-2007432391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-3f4068cf-21f2-4c0c-a562-260e1092fef1" returned: 0 in 0.991s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c1541541-5330-4b8b-9794-cc835f9db306 tempest-VolumeDependencyTests-2007432391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-3f4068cf-21f2-4c0c-a562-260e1092fef1 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:35 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-3f4068cf-21f2-4c0c-a562-260e1092fef1 Jul 10 06:57:35 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:36 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-967f9571-0e36-498c-a362-b00c81fa7ce0 tempest-CreateVolumesFromSnapshotTest-2117965649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-90576f24-9382-4954-86af-c6784477e22b" returned: 0 in 0.722s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:36 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-967f9571-0e36-498c-a362-b00c81fa7ce0 tempest-CreateVolumesFromSnapshotTest-2117965649 None] <== create_volume: return (1817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:57:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-967f9571-0e36-498c-a362-b00c81fa7ce0 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.821s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-92e50581-bf73-4855-9b83-e1cf7b89add3 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.250s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:36 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-92e50581-bf73-4855-9b83-e1cf7b89add3 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1444813151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02657582-42b6-409f-9a75-7da96d79f1ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7771f46cf86d45fa9ed083478cce8def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:57:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:57:26Z,use_quota=True,user_id='a7ef439e73b74e47bc04d9da93e12c36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:57:36 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-92e50581-bf73-4855-9b83-e1cf7b89add3 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Creating volume 02657582-42b6-409f-9a75-7da96d79f1ff {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:57:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-92e50581-bf73-4855-9b83-e1cf7b89add3 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-92e50581-bf73-4855-9b83-e1cf7b89add3 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:36 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-92e50581-bf73-4855-9b83-e1cf7b89add3 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:57:36 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-92e50581-bf73-4855-9b83-e1cf7b89add3 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:57:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-92e50581-bf73-4855-9b83-e1cf7b89add3 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:36 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-92e50581-bf73-4855-9b83-e1cf7b89add3 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:57:36 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-92e50581-bf73-4855-9b83-e1cf7b89add3 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:57:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-92e50581-bf73-4855-9b83-e1cf7b89add3 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-02657582-42b6-409f-9a75-7da96d79f1ff 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:36 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-967f9571-0e36-498c-a362-b00c81fa7ce0 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b89f96f-a5c6-4ab1-bd56-dd9acd3d86bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90576f24-9382-4954-86af-c6784477e22b', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:36 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-967f9571-0e36-498c-a362-b00c81fa7ce0 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66a8cbd8-25a0-4bab-bbf8-d84f0aeb6b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:36 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-02657582-42b6-409f-9a75-7da96d79f1ff 1073741824 Jul 10 06:57:36 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:36 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-967f9571-0e36-498c-a362-b00c81fa7ce0 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Volume volume-90576f24-9382-4954-86af-c6784477e22b (90576f24-9382-4954-86af-c6784477e22b): created successfully Jul 10 06:57:36 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-967f9571-0e36-498c-a362-b00c81fa7ce0 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66a8cbd8-25a0-4bab-bbf8-d84f0aeb6b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:36 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-967f9571-0e36-498c-a362-b00c81fa7ce0 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Flow 'volume_create_manager' (243ab6ea-2934-41ce-a566-b7371825095e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:36 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-967f9571-0e36-498c-a362-b00c81fa7ce0 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Created volume successfully. Jul 10 06:57:36 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c1541541-5330-4b8b-9794-cc835f9db306 tempest-VolumeDependencyTests-2007432391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-3f4068cf-21f2-4c0c-a562-260e1092fef1" returned: 0 in 0.735s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:36 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c1541541-5330-4b8b-9794-cc835f9db306 tempest-VolumeDependencyTests-2007432391 None] Lock "cinder-quobyte-3f4068cf-21f2-4c0c-a562-260e1092fef1" released by "delete_volume" :: held 1.793s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:57:36 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-c1541541-5330-4b8b-9794-cc835f9db306 tempest-VolumeDependencyTests-2007432391 None] Created reservations ['b140ba39-49e9-43ee-a430-13d8cf016d60', '10f6a64e-ac06-456b-b128-d7a8e8bf712b', 'e73b13d1-bdc2-44a4-ad67-31bbf29514d3', '2376f9f8-830f-46c1-9c5f-4350f1f043be'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:57:36 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-84f42ed5-c09d-4d6f-b25f-ad28168ddc64 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Acquiring lock "cinder-90576f24-9382-4954-86af-c6784477e22b-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:57:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c1541541-5330-4b8b-9794-cc835f9db306 tempest-VolumeDependencyTests-2007432391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c1541541-5330-4b8b-9794-cc835f9db306 tempest-VolumeDependencyTests-2007432391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:36 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-c1541541-5330-4b8b-9794-cc835f9db306 tempest-VolumeDependencyTests-2007432391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:57:36 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-c1541541-5330-4b8b-9794-cc835f9db306 tempest-VolumeDependencyTests-2007432391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:57:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c1541541-5330-4b8b-9794-cc835f9db306 tempest-VolumeDependencyTests-2007432391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c1541541-5330-4b8b-9794-cc835f9db306 tempest-VolumeDependencyTests-2007432391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:36 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:57:36 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:36 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-84f42ed5-c09d-4d6f-b25f-ad28168ddc64 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "cinder-90576f24-9382-4954-86af-c6784477e22b-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:57:36 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-84f42ed5-c09d-4d6f-b25f-ad28168ddc64 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Acquiring lock "cinder-quobyte-90576f24-9382-4954-86af-c6784477e22b" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:57:37 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-84f42ed5-c09d-4d6f-b25f-ad28168ddc64 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "cinder-quobyte-90576f24-9382-4954-86af-c6784477e22b" acquired by "delete_volume" :: waited 0.037s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:57:37 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de739b6-32ff-4596-a020-bd059b4f474d]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:57:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-84f42ed5-c09d-4d6f-b25f-ad28168ddc64 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-90576f24-9382-4954-86af-c6784477e22b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:37 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-90576f24-9382-4954-86af-c6784477e22b Jul 10 06:57:37 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:37 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-92e50581-bf73-4855-9b83-e1cf7b89add3 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-02657582-42b6-409f-9a75-7da96d79f1ff 1073741824" returned: 0 in 1.333s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-92e50581-bf73-4855-9b83-e1cf7b89add3 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-02657582-42b6-409f-9a75-7da96d79f1ff {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:37 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-02657582-42b6-409f-9a75-7da96d79f1ff Jul 10 06:57:37 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:37 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c1541541-5330-4b8b-9794-cc835f9db306 tempest-VolumeDependencyTests-2007432391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.000s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:37 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-c1541541-5330-4b8b-9794-cc835f9db306 tempest-VolumeDependencyTests-2007432391 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:57:37 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-c1541541-5330-4b8b-9794-cc835f9db306 tempest-VolumeDependencyTests-2007432391 None] Deleted volume successfully. Jul 10 06:57:37 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c1541541-5330-4b8b-9794-cc835f9db306 tempest-VolumeDependencyTests-2007432391 None] Lock "cinder-3f4068cf-21f2-4c0c-a562-260e1092fef1-delete_volume" released by "delete_volume" :: held 3.143s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:57:38 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-84f42ed5-c09d-4d6f-b25f-ad28168ddc64 tempest-CreateVolumesFromSnapshotTest-2117965649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-90576f24-9382-4954-86af-c6784477e22b" returned: 0 in 1.075s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-84f42ed5-c09d-4d6f-b25f-ad28168ddc64 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-90576f24-9382-4954-86af-c6784477e22b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:38 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-90576f24-9382-4954-86af-c6784477e22b Jul 10 06:57:38 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:38 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-92e50581-bf73-4855-9b83-e1cf7b89add3 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-02657582-42b6-409f-9a75-7da96d79f1ff" returned: 0 in 0.755s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:38 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-92e50581-bf73-4855-9b83-e1cf7b89add3 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] <== create_volume: return (2157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:57:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-92e50581-bf73-4855-9b83-e1cf7b89add3 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.165s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:38 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-92e50581-bf73-4855-9b83-e1cf7b89add3 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77452c52-01ac-4704-8624-a67f2b1d748e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02657582-42b6-409f-9a75-7da96d79f1ff', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:38 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-92e50581-bf73-4855-9b83-e1cf7b89add3 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0dfd580-90e8-48d6-b14c-8bd40517487b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:38 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-92e50581-bf73-4855-9b83-e1cf7b89add3 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Volume volume-02657582-42b6-409f-9a75-7da96d79f1ff (02657582-42b6-409f-9a75-7da96d79f1ff): created successfully Jul 10 06:57:38 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-92e50581-bf73-4855-9b83-e1cf7b89add3 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0dfd580-90e8-48d6-b14c-8bd40517487b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:38 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-92e50581-bf73-4855-9b83-e1cf7b89add3 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Flow 'volume_create_manager' (0a14fd0a-eef8-47b4-be4a-3111137a0269) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:38 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-92e50581-bf73-4855-9b83-e1cf7b89add3 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Created volume successfully. Jul 10 06:57:38 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-84f42ed5-c09d-4d6f-b25f-ad28168ddc64 tempest-CreateVolumesFromSnapshotTest-2117965649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-90576f24-9382-4954-86af-c6784477e22b" returned: 0 in 0.802s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:38 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-84f42ed5-c09d-4d6f-b25f-ad28168ddc64 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "cinder-quobyte-90576f24-9382-4954-86af-c6784477e22b" released by "delete_volume" :: held 1.938s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:57:39 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-84f42ed5-c09d-4d6f-b25f-ad28168ddc64 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Created reservations ['9a4f4489-ac8f-4f89-a86b-c87a4a3f54d1', 'cdc0d41c-ef8e-40eb-9c5f-16e587655ef3', 'faca5a2c-fe73-4794-ba09-b3be695fba52', '7d3c1172-57ca-495c-9e8f-1437389ec517'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:57:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-84f42ed5-c09d-4d6f-b25f-ad28168ddc64 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-84f42ed5-c09d-4d6f-b25f-ad28168ddc64 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:39 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-84f42ed5-c09d-4d6f-b25f-ad28168ddc64 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:57:39 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-84f42ed5-c09d-4d6f-b25f-ad28168ddc64 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:57:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-84f42ed5-c09d-4d6f-b25f-ad28168ddc64 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-84f42ed5-c09d-4d6f-b25f-ad28168ddc64 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:39 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:57:39 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:39 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-b936bcb2-c5f0-4255-8094-bcadc2d6b791 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:57:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b936bcb2-c5f0-4255-8094-bcadc2d6b791 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Flow 'volume_create_manager' (cb260977-81f3-48ff-bd9f-98136c32a83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b936bcb2-c5f0-4255-8094-bcadc2d6b791 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa947d15-eecb-4f28-8283-66c59b64faaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b936bcb2-c5f0-4255-8094-bcadc2d6b791 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa947d15-eecb-4f28-8283-66c59b64faaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:57:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-136304692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58f654d7-168f-41b1-aece-618fc2fc077e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7771f46cf86d45fa9ed083478cce8def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:57:39Z,use_quota=True,user_id='a7ef439e73b74e47bc04d9da93e12c36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b936bcb2-c5f0-4255-8094-bcadc2d6b791 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0ae824a-556e-4d7f-9fe0-41f91018465f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b936bcb2-c5f0-4255-8094-bcadc2d6b791 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0ae824a-556e-4d7f-9fe0-41f91018465f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b936bcb2-c5f0-4255-8094-bcadc2d6b791 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec60bd04-802c-4094-938b-847eb6d2b8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b936bcb2-c5f0-4255-8094-bcadc2d6b791 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec60bd04-802c-4094-938b-847eb6d2b8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58f654d7-168f-41b1-aece-618fc2fc077e', 'volume_name': 'volume-58f654d7-168f-41b1-aece-618fc2fc077e', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b936bcb2-c5f0-4255-8094-bcadc2d6b791 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e40ad1a7-e36e-4598-91ba-bc710229f7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b936bcb2-c5f0-4255-8094-bcadc2d6b791 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e40ad1a7-e36e-4598-91ba-bc710229f7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b936bcb2-c5f0-4255-8094-bcadc2d6b791 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dadd048-ad45-4673-97af-09c056298420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:39 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-b936bcb2-c5f0-4255-8094-bcadc2d6b791 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Volume 58f654d7-168f-41b1-aece-618fc2fc077e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58f654d7-168f-41b1-aece-618fc2fc077e', 'volume_size': 1} Jul 10 06:57:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b936bcb2-c5f0-4255-8094-bcadc2d6b791 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b936bcb2-c5f0-4255-8094-bcadc2d6b791 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:39 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b936bcb2-c5f0-4255-8094-bcadc2d6b791 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:57:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-136304692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58f654d7-168f-41b1-aece-618fc2fc077e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7771f46cf86d45fa9ed083478cce8def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:57:39Z,use_quota=True,user_id='a7ef439e73b74e47bc04d9da93e12c36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:57:39 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-b936bcb2-c5f0-4255-8094-bcadc2d6b791 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Creating volume 58f654d7-168f-41b1-aece-618fc2fc077e {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:57:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b936bcb2-c5f0-4255-8094-bcadc2d6b791 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b936bcb2-c5f0-4255-8094-bcadc2d6b791 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:39 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b936bcb2-c5f0-4255-8094-bcadc2d6b791 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:57:39 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b936bcb2-c5f0-4255-8094-bcadc2d6b791 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:57:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b936bcb2-c5f0-4255-8094-bcadc2d6b791 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:39 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b936bcb2-c5f0-4255-8094-bcadc2d6b791 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:57:39 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-b936bcb2-c5f0-4255-8094-bcadc2d6b791 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:57:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b936bcb2-c5f0-4255-8094-bcadc2d6b791 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-58f654d7-168f-41b1-aece-618fc2fc077e 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:39 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-58f654d7-168f-41b1-aece-618fc2fc077e 1073741824 Jul 10 06:57:39 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:40 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d4c3b76-e1cb-4312-a189-865451115f2f tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:57:40 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0d4c3b76-e1cb-4312-a189-865451115f2f tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Flow 'volume_create_manager' (73ef4f4e-f722-426e-99ef-3db98e43189e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:40 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0d4c3b76-e1cb-4312-a189-865451115f2f tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfb3d99c-652c-4374-aeae-4d22953286c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:40 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0d4c3b76-e1cb-4312-a189-865451115f2f tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfb3d99c-652c-4374-aeae-4d22953286c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1611910870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=100e51c0-9bfb-4484-babb-95f1c31641e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7771f46cf86d45fa9ed083478cce8def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:57:40Z,use_quota=True,user_id='a7ef439e73b74e47bc04d9da93e12c36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:40 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0d4c3b76-e1cb-4312-a189-865451115f2f tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (425df187-98f8-4db4-aa42-3ff0c6c30474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:40 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0d4c3b76-e1cb-4312-a189-865451115f2f tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (425df187-98f8-4db4-aa42-3ff0c6c30474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:40 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0d4c3b76-e1cb-4312-a189-865451115f2f tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fe65b2c-a3f1-4630-bb22-acf481e5289a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:40 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0d4c3b76-e1cb-4312-a189-865451115f2f tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fe65b2c-a3f1-4630-bb22-acf481e5289a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '100e51c0-9bfb-4484-babb-95f1c31641e8', 'volume_name': 'volume-100e51c0-9bfb-4484-babb-95f1c31641e8', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:40 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0d4c3b76-e1cb-4312-a189-865451115f2f tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (661714e2-9578-4358-bef2-ce45dcd25b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:40 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:40 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0d4c3b76-e1cb-4312-a189-865451115f2f tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (661714e2-9578-4358-bef2-ce45dcd25b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:40 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0d4c3b76-e1cb-4312-a189-865451115f2f tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3442cb02-d4f4-42ee-92a4-e65432ee2610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:40 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-0d4c3b76-e1cb-4312-a189-865451115f2f tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Volume 100e51c0-9bfb-4484-babb-95f1c31641e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-100e51c0-9bfb-4484-babb-95f1c31641e8', 'volume_size': 1} Jul 10 06:57:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-0d4c3b76-e1cb-4312-a189-865451115f2f tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:40 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1d98a12d-65a4-46f7-8aa5-dee8c8bc6444 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Acquiring lock "cinder-9be747a5-8ef1-4010-af3d-6bca04e14382-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:57:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-84f42ed5-c09d-4d6f-b25f-ad28168ddc64 tempest-CreateVolumesFromSnapshotTest-2117965649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.180s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:40 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-84f42ed5-c09d-4d6f-b25f-ad28168ddc64 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:57:40 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-84f42ed5-c09d-4d6f-b25f-ad28168ddc64 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Deleted volume successfully. Jul 10 06:57:40 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1d98a12d-65a4-46f7-8aa5-dee8c8bc6444 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "cinder-9be747a5-8ef1-4010-af3d-6bca04e14382-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:57:40 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-84f42ed5-c09d-4d6f-b25f-ad28168ddc64 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "cinder-90576f24-9382-4954-86af-c6784477e22b-delete_volume" released by "delete_volume" :: held 3.498s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:57:40 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1d98a12d-65a4-46f7-8aa5-dee8c8bc6444 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Acquiring lock "cinder-quobyte-9be747a5-8ef1-4010-af3d-6bca04e14382" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:57:40 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1d98a12d-65a4-46f7-8aa5-dee8c8bc6444 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "cinder-quobyte-9be747a5-8ef1-4010-af3d-6bca04e14382" acquired by "delete_volume" :: waited 0.031s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:57:40 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f89bbc5-54ec-4d85-a404-6474a5c5f647]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:57:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1d98a12d-65a4-46f7-8aa5-dee8c8bc6444 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9be747a5-8ef1-4010-af3d-6bca04e14382 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:40 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9be747a5-8ef1-4010-af3d-6bca04e14382 Jul 10 06:57:40 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:40 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-203b20ba-7290-4d92-839a-b1f447fd5ff8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:57:40 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-203b20ba-7290-4d92-839a-b1f447fd5ff8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Flow 'volume_create_manager' (e7a57fae-5792-46d0-b084-a6f6725e2e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:40 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-203b20ba-7290-4d92-839a-b1f447fd5ff8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f11063e6-8c74-4a7b-a142-c1824574ba97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:40 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-203b20ba-7290-4d92-839a-b1f447fd5ff8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f11063e6-8c74-4a7b-a142-c1824574ba97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1000077387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c00b79d1-ca93-40eb-a4a6-de3d59d581f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7771f46cf86d45fa9ed083478cce8def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:57:41Z,use_quota=True,user_id='a7ef439e73b74e47bc04d9da93e12c36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:40 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-203b20ba-7290-4d92-839a-b1f447fd5ff8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a16f1b16-c3a8-4fe6-9b64-b245c9c2cc87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:40 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-203b20ba-7290-4d92-839a-b1f447fd5ff8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a16f1b16-c3a8-4fe6-9b64-b245c9c2cc87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:40 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-203b20ba-7290-4d92-839a-b1f447fd5ff8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96e30f4c-4ede-4b05-888d-c6a02e5cf393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:40 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-203b20ba-7290-4d92-839a-b1f447fd5ff8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96e30f4c-4ede-4b05-888d-c6a02e5cf393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c00b79d1-ca93-40eb-a4a6-de3d59d581f2', 'volume_name': 'volume-c00b79d1-ca93-40eb-a4a6-de3d59d581f2', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:40 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-203b20ba-7290-4d92-839a-b1f447fd5ff8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (628d5e04-77f3-4b93-b6e4-44efe70f1e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:40 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-203b20ba-7290-4d92-839a-b1f447fd5ff8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (628d5e04-77f3-4b93-b6e4-44efe70f1e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:40 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-203b20ba-7290-4d92-839a-b1f447fd5ff8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a28cfbef-4e25-4738-bb05-0a5a3a2dc130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:40 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-203b20ba-7290-4d92-839a-b1f447fd5ff8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Volume c00b79d1-ca93-40eb-a4a6-de3d59d581f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c00b79d1-ca93-40eb-a4a6-de3d59d581f2', 'volume_size': 1} Jul 10 06:57:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-203b20ba-7290-4d92-839a-b1f447fd5ff8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:41 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f5e0cba-30f4-4a22-b3b9-2fa5d8bcb741 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:57:41 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9f5e0cba-30f4-4a22-b3b9-2fa5d8bcb741 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Flow 'volume_create_manager' (c89984a0-1421-45ee-afc3-4e88335fcd9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:41 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9f5e0cba-30f4-4a22-b3b9-2fa5d8bcb741 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66c92c27-1271-4453-863a-2df90ede533b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:41 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9f5e0cba-30f4-4a22-b3b9-2fa5d8bcb741 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66c92c27-1271-4453-863a-2df90ede533b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1795785439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7600aa5-dec8-483f-b940-e186f83716ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7771f46cf86d45fa9ed083478cce8def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:57:41Z,use_quota=True,user_id='a7ef439e73b74e47bc04d9da93e12c36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:41 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9f5e0cba-30f4-4a22-b3b9-2fa5d8bcb741 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feee4774-8f8b-4460-a115-0f49562713c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:41 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9f5e0cba-30f4-4a22-b3b9-2fa5d8bcb741 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feee4774-8f8b-4460-a115-0f49562713c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:41 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9f5e0cba-30f4-4a22-b3b9-2fa5d8bcb741 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97df1198-69ae-4cb8-ae2e-ae5aba23c587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:41 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9f5e0cba-30f4-4a22-b3b9-2fa5d8bcb741 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97df1198-69ae-4cb8-ae2e-ae5aba23c587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7600aa5-dec8-483f-b940-e186f83716ab', 'volume_name': 'volume-b7600aa5-dec8-483f-b940-e186f83716ab', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:41 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9f5e0cba-30f4-4a22-b3b9-2fa5d8bcb741 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5a91561-6027-4660-9f21-f79617926ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:41 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9f5e0cba-30f4-4a22-b3b9-2fa5d8bcb741 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5a91561-6027-4660-9f21-f79617926ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:41 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9f5e0cba-30f4-4a22-b3b9-2fa5d8bcb741 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c0a3458-b0e9-4dfb-a3e5-3e192a95a1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:41 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-9f5e0cba-30f4-4a22-b3b9-2fa5d8bcb741 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Volume b7600aa5-dec8-483f-b940-e186f83716ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7600aa5-dec8-483f-b940-e186f83716ab', 'volume_size': 1} Jul 10 06:57:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9f5e0cba-30f4-4a22-b3b9-2fa5d8bcb741 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:41 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b936bcb2-c5f0-4255-8094-bcadc2d6b791 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-58f654d7-168f-41b1-aece-618fc2fc077e 1073741824" returned: 0 in 1.980s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b936bcb2-c5f0-4255-8094-bcadc2d6b791 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-58f654d7-168f-41b1-aece-618fc2fc077e {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:41 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-58f654d7-168f-41b1-aece-618fc2fc077e Jul 10 06:57:41 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:41 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1d98a12d-65a4-46f7-8aa5-dee8c8bc6444 tempest-CreateVolumesFromSnapshotTest-2117965649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9be747a5-8ef1-4010-af3d-6bca04e14382" returned: 0 in 1.365s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1d98a12d-65a4-46f7-8aa5-dee8c8bc6444 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9be747a5-8ef1-4010-af3d-6bca04e14382 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:41 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9be747a5-8ef1-4010-af3d-6bca04e14382 Jul 10 06:57:41 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-d38f2679-b312-4925-a96a-3e4d9ffd32d4 tempest-CinderUnicodeTest-636037436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d38f2679-b312-4925-a96a-3e4d9ffd32d4 tempest-CinderUnicodeTest-636037436 None] Flow 'volume_create_manager' (86866143-4065-4fe0-9753-efeaa74c40af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d38f2679-b312-4925-a96a-3e4d9ffd32d4 tempest-CinderUnicodeTest-636037436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53613c49-5595-468f-b101-239f646dbb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-745f3675-a02c-4a37-9eb4-0fe976d3f5a8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-745f3675-a02c-4a37-9eb4-0fe976d3f5a8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Flow 'volume_create_manager' (efddf18a-2892-4318-928f-b25493783c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-745f3675-a02c-4a37-9eb4-0fe976d3f5a8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ea95cb8-9a82-430e-9f70-3315bca73c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-745f3675-a02c-4a37-9eb4-0fe976d3f5a8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ea95cb8-9a82-430e-9f70-3315bca73c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-972509291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=637ba402-7df9-4e71-91cb-8f4f6b7460d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7771f46cf86d45fa9ed083478cce8def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:57:42Z,use_quota=True,user_id='a7ef439e73b74e47bc04d9da93e12c36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-745f3675-a02c-4a37-9eb4-0fe976d3f5a8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e697caa6-ac17-4984-ad18-7cc9257358bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-745f3675-a02c-4a37-9eb4-0fe976d3f5a8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e697caa6-ac17-4984-ad18-7cc9257358bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-745f3675-a02c-4a37-9eb4-0fe976d3f5a8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa3bf7e5-f1e7-47c6-950a-ff0f38fc4034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-745f3675-a02c-4a37-9eb4-0fe976d3f5a8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa3bf7e5-f1e7-47c6-950a-ff0f38fc4034) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '637ba402-7df9-4e71-91cb-8f4f6b7460d7', 'volume_name': 'volume-637ba402-7df9-4e71-91cb-8f4f6b7460d7', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-745f3675-a02c-4a37-9eb4-0fe976d3f5a8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65822e23-be4a-4f73-9ee7-16fa9ca528e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-745f3675-a02c-4a37-9eb4-0fe976d3f5a8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65822e23-be4a-4f73-9ee7-16fa9ca528e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-745f3675-a02c-4a37-9eb4-0fe976d3f5a8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5f6c80a-ae01-4d0a-abf4-abb8c1d3bffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:42 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-745f3675-a02c-4a37-9eb4-0fe976d3f5a8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Volume 637ba402-7df9-4e71-91cb-8f4f6b7460d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-637ba402-7df9-4e71-91cb-8f4f6b7460d7', 'volume_size': 1} Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-745f3675-a02c-4a37-9eb4-0fe976d3f5a8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d38f2679-b312-4925-a96a-3e4d9ffd32d4 tempest-CinderUnicodeTest-636037436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53613c49-5595-468f-b101-239f646dbb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e937ba51-88ac-4368-8c63-53a858646253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0227de555d1545aa8df29202bccaf0ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:57:42Z,use_quota=True,user_id='ecc25333531b4145855df3195051fdb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d38f2679-b312-4925-a96a-3e4d9ffd32d4 tempest-CinderUnicodeTest-636037436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cead63c-dd47-43b3-9b95-c708378ac0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d38f2679-b312-4925-a96a-3e4d9ffd32d4 tempest-CinderUnicodeTest-636037436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cead63c-dd47-43b3-9b95-c708378ac0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d38f2679-b312-4925-a96a-3e4d9ffd32d4 tempest-CinderUnicodeTest-636037436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2de823db-23ef-4bf5-9720-0e05080f4810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d38f2679-b312-4925-a96a-3e4d9ffd32d4 tempest-CinderUnicodeTest-636037436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2de823db-23ef-4bf5-9720-0e05080f4810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e937ba51-88ac-4368-8c63-53a858646253', 'volume_name': 'volume-e937ba51-88ac-4368-8c63-53a858646253', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d38f2679-b312-4925-a96a-3e4d9ffd32d4 tempest-CinderUnicodeTest-636037436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9e23280-bef9-41c2-9675-05a4b117ac05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d38f2679-b312-4925-a96a-3e4d9ffd32d4 tempest-CinderUnicodeTest-636037436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9e23280-bef9-41c2-9675-05a4b117ac05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d38f2679-b312-4925-a96a-3e4d9ffd32d4 tempest-CinderUnicodeTest-636037436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbe14250-caf0-4b89-9a73-ebceae7f5867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:42 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-d38f2679-b312-4925-a96a-3e4d9ffd32d4 tempest-CinderUnicodeTest-636037436 None] Volume e937ba51-88ac-4368-8c63-53a858646253: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e937ba51-88ac-4368-8c63-53a858646253', 'volume_size': 1} Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d38f2679-b312-4925-a96a-3e4d9ffd32d4 tempest-CinderUnicodeTest-636037436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:42 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b936bcb2-c5f0-4255-8094-bcadc2d6b791 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-58f654d7-168f-41b1-aece-618fc2fc077e" returned: 0 in 0.772s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b936bcb2-c5f0-4255-8094-bcadc2d6b791 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] <== create_volume: return (2806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b936bcb2-c5f0-4255-8094-bcadc2d6b791 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.810s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-0d4c3b76-e1cb-4312-a189-865451115f2f tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.225s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-0d4c3b76-e1cb-4312-a189-865451115f2f tempest-CreateVolumesFromSourceVolumeTest-650305471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1611910870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=100e51c0-9bfb-4484-babb-95f1c31641e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7771f46cf86d45fa9ed083478cce8def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:57:40Z,use_quota=True,user_id='a7ef439e73b74e47bc04d9da93e12c36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-0d4c3b76-e1cb-4312-a189-865451115f2f tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Creating volume 100e51c0-9bfb-4484-babb-95f1c31641e8 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-0d4c3b76-e1cb-4312-a189-865451115f2f tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-0d4c3b76-e1cb-4312-a189-865451115f2f tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-0d4c3b76-e1cb-4312-a189-865451115f2f tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-0d4c3b76-e1cb-4312-a189-865451115f2f tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-0d4c3b76-e1cb-4312-a189-865451115f2f tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-0d4c3b76-e1cb-4312-a189-865451115f2f tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:57:42 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-0d4c3b76-e1cb-4312-a189-865451115f2f tempest-CreateVolumesFromSourceVolumeTest-650305471 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0d4c3b76-e1cb-4312-a189-865451115f2f tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-100e51c0-9bfb-4484-babb-95f1c31641e8 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b936bcb2-c5f0-4255-8094-bcadc2d6b791 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dadd048-ad45-4673-97af-09c056298420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58f654d7-168f-41b1-aece-618fc2fc077e', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:42 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-100e51c0-9bfb-4484-babb-95f1c31641e8 1073741824 Jul 10 06:57:42 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b936bcb2-c5f0-4255-8094-bcadc2d6b791 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (819d7ef1-8672-4470-9107-8a4ced994bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:42 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-b936bcb2-c5f0-4255-8094-bcadc2d6b791 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Volume volume-58f654d7-168f-41b1-aece-618fc2fc077e (58f654d7-168f-41b1-aece-618fc2fc077e): created successfully Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b936bcb2-c5f0-4255-8094-bcadc2d6b791 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (819d7ef1-8672-4470-9107-8a4ced994bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-b936bcb2-c5f0-4255-8094-bcadc2d6b791 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Flow 'volume_create_manager' (cb260977-81f3-48ff-bd9f-98136c32a83e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:42 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-b936bcb2-c5f0-4255-8094-bcadc2d6b791 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Created volume successfully. Jul 10 06:57:42 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1d98a12d-65a4-46f7-8aa5-dee8c8bc6444 tempest-CreateVolumesFromSnapshotTest-2117965649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9be747a5-8ef1-4010-af3d-6bca04e14382" returned: 0 in 0.817s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1d98a12d-65a4-46f7-8aa5-dee8c8bc6444 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "cinder-quobyte-9be747a5-8ef1-4010-af3d-6bca04e14382" released by "delete_volume" :: held 2.266s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-1d98a12d-65a4-46f7-8aa5-dee8c8bc6444 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Created reservations ['748bbc79-890d-4d33-9485-694314beeb3d', '885ac9c9-e0e0-4663-9365-2963752edbfa', '26a3c2cb-0846-4d92-9ab3-b1df4b4645aa', 'cff9dd43-0f26-4685-8f4e-fdb47e057946'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-1d98a12d-65a4-46f7-8aa5-dee8c8bc6444 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-1d98a12d-65a4-46f7-8aa5-dee8c8bc6444 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-1d98a12d-65a4-46f7-8aa5-dee8c8bc6444 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-1d98a12d-65a4-46f7-8aa5-dee8c8bc6444 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-1d98a12d-65a4-46f7-8aa5-dee8c8bc6444 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1d98a12d-65a4-46f7-8aa5-dee8c8bc6444 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:42 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:57:42 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:43 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0d4c3b76-e1cb-4312-a189-865451115f2f tempest-CreateVolumesFromSourceVolumeTest-650305471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-100e51c0-9bfb-4484-babb-95f1c31641e8 1073741824" returned: 0 in 0.996s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:43 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1d98a12d-65a4-46f7-8aa5-dee8c8bc6444 tempest-CreateVolumesFromSnapshotTest-2117965649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.683s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:43 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-1d98a12d-65a4-46f7-8aa5-dee8c8bc6444 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:57:43 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-1d98a12d-65a4-46f7-8aa5-dee8c8bc6444 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Deleted volume successfully. Jul 10 06:57:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0d4c3b76-e1cb-4312-a189-865451115f2f tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-100e51c0-9bfb-4484-babb-95f1c31641e8 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:43 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1d98a12d-65a4-46f7-8aa5-dee8c8bc6444 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "cinder-9be747a5-8ef1-4010-af3d-6bca04e14382-delete_volume" released by "delete_volume" :: held 3.252s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:57:43 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-100e51c0-9bfb-4484-babb-95f1c31641e8 Jul 10 06:57:43 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:43 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2b9814d0-2a5a-491d-9540-0fb93d6f8942 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Acquiring lock "cinder-9f4f508e-d2f9-414a-9f66-3ac2dc4a4ee5-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:57:43 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2b9814d0-2a5a-491d-9540-0fb93d6f8942 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "cinder-9f4f508e-d2f9-414a-9f66-3ac2dc4a4ee5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:57:43 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2b9814d0-2a5a-491d-9540-0fb93d6f8942 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Acquiring lock "cinder-quobyte-9f4f508e-d2f9-414a-9f66-3ac2dc4a4ee5" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:57:43 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2b9814d0-2a5a-491d-9540-0fb93d6f8942 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "cinder-quobyte-9f4f508e-d2f9-414a-9f66-3ac2dc4a4ee5" acquired by "delete_volume" :: waited 0.018s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:57:43 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb037df-b038-4f34-8f82-e4e3455a43f5]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:57:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2b9814d0-2a5a-491d-9540-0fb93d6f8942 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9f4f508e-d2f9-414a-9f66-3ac2dc4a4ee5 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:44 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9f4f508e-d2f9-414a-9f66-3ac2dc4a4ee5 Jul 10 06:57:44 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:44 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0d4c3b76-e1cb-4312-a189-865451115f2f tempest-CreateVolumesFromSourceVolumeTest-650305471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-100e51c0-9bfb-4484-babb-95f1c31641e8" returned: 0 in 0.676s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:44 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-0d4c3b76-e1cb-4312-a189-865451115f2f tempest-CreateVolumesFromSourceVolumeTest-650305471 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:57:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-0d4c3b76-e1cb-4312-a189-865451115f2f tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.738s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-203b20ba-7290-4d92-839a-b1f447fd5ff8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.291s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:44 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-203b20ba-7290-4d92-839a-b1f447fd5ff8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1000077387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c00b79d1-ca93-40eb-a4a6-de3d59d581f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7771f46cf86d45fa9ed083478cce8def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:57:41Z,use_quota=True,user_id='a7ef439e73b74e47bc04d9da93e12c36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:57:44 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-203b20ba-7290-4d92-839a-b1f447fd5ff8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Creating volume c00b79d1-ca93-40eb-a4a6-de3d59d581f2 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:57:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-203b20ba-7290-4d92-839a-b1f447fd5ff8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-203b20ba-7290-4d92-839a-b1f447fd5ff8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:44 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-203b20ba-7290-4d92-839a-b1f447fd5ff8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:57:44 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-203b20ba-7290-4d92-839a-b1f447fd5ff8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:57:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-203b20ba-7290-4d92-839a-b1f447fd5ff8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:44 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-203b20ba-7290-4d92-839a-b1f447fd5ff8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:57:44 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-203b20ba-7290-4d92-839a-b1f447fd5ff8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:57:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-203b20ba-7290-4d92-839a-b1f447fd5ff8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c00b79d1-ca93-40eb-a4a6-de3d59d581f2 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:44 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0d4c3b76-e1cb-4312-a189-865451115f2f tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3442cb02-d4f4-42ee-92a4-e65432ee2610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-100e51c0-9bfb-4484-babb-95f1c31641e8', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:44 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c00b79d1-ca93-40eb-a4a6-de3d59d581f2 1073741824 Jul 10 06:57:44 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:44 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0d4c3b76-e1cb-4312-a189-865451115f2f tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db7326e7-4637-45d8-9d3c-361162efaca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:44 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-0d4c3b76-e1cb-4312-a189-865451115f2f tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Volume volume-100e51c0-9bfb-4484-babb-95f1c31641e8 (100e51c0-9bfb-4484-babb-95f1c31641e8): created successfully Jul 10 06:57:44 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0d4c3b76-e1cb-4312-a189-865451115f2f tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db7326e7-4637-45d8-9d3c-361162efaca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:44 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0d4c3b76-e1cb-4312-a189-865451115f2f tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Flow 'volume_create_manager' (73ef4f4e-f722-426e-99ef-3db98e43189e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:44 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-0d4c3b76-e1cb-4312-a189-865451115f2f tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Created volume successfully. Jul 10 06:57:44 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2b9814d0-2a5a-491d-9540-0fb93d6f8942 tempest-CreateVolumesFromSnapshotTest-2117965649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9f4f508e-d2f9-414a-9f66-3ac2dc4a4ee5" returned: 0 in 0.879s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2b9814d0-2a5a-491d-9540-0fb93d6f8942 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9f4f508e-d2f9-414a-9f66-3ac2dc4a4ee5 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:44 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9f4f508e-d2f9-414a-9f66-3ac2dc4a4ee5 Jul 10 06:57:44 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:45 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-203b20ba-7290-4d92-839a-b1f447fd5ff8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c00b79d1-ca93-40eb-a4a6-de3d59d581f2 1073741824" returned: 0 in 0.910s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-203b20ba-7290-4d92-839a-b1f447fd5ff8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c00b79d1-ca93-40eb-a4a6-de3d59d581f2 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:45 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c00b79d1-ca93-40eb-a4a6-de3d59d581f2 Jul 10 06:57:45 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:45 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2b9814d0-2a5a-491d-9540-0fb93d6f8942 tempest-CreateVolumesFromSnapshotTest-2117965649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-9f4f508e-d2f9-414a-9f66-3ac2dc4a4ee5" returned: 0 in 0.767s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:45 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2b9814d0-2a5a-491d-9540-0fb93d6f8942 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "cinder-quobyte-9f4f508e-d2f9-414a-9f66-3ac2dc4a4ee5" released by "delete_volume" :: held 1.696s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:57:45 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-2b9814d0-2a5a-491d-9540-0fb93d6f8942 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Created reservations ['04a61c7b-0938-42a2-ac82-a7d96c7be41d', '82c9fc9e-c366-40b9-bc4d-e0f40b605731', '79025720-9327-48a0-bd29-699ac06dcf3c', '4ae23155-7b4b-486e-b404-58e723d1985d'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:57:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2b9814d0-2a5a-491d-9540-0fb93d6f8942 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2b9814d0-2a5a-491d-9540-0fb93d6f8942 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:45 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-2b9814d0-2a5a-491d-9540-0fb93d6f8942 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:57:45 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-2b9814d0-2a5a-491d-9540-0fb93d6f8942 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:57:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2b9814d0-2a5a-491d-9540-0fb93d6f8942 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2b9814d0-2a5a-491d-9540-0fb93d6f8942 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:45 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:57:45 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:45 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-203b20ba-7290-4d92-839a-b1f447fd5ff8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c00b79d1-ca93-40eb-a4a6-de3d59d581f2" returned: 0 in 0.704s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:45 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-203b20ba-7290-4d92-839a-b1f447fd5ff8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] <== create_volume: return (1662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:57:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-203b20ba-7290-4d92-839a-b1f447fd5ff8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9f5e0cba-30f4-4a22-b3b9-2fa5d8bcb741 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.352s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:45 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9f5e0cba-30f4-4a22-b3b9-2fa5d8bcb741 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1795785439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7600aa5-dec8-483f-b940-e186f83716ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7771f46cf86d45fa9ed083478cce8def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:57:41Z,use_quota=True,user_id='a7ef439e73b74e47bc04d9da93e12c36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:57:45 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-9f5e0cba-30f4-4a22-b3b9-2fa5d8bcb741 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Creating volume b7600aa5-dec8-483f-b940-e186f83716ab {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:57:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9f5e0cba-30f4-4a22-b3b9-2fa5d8bcb741 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9f5e0cba-30f4-4a22-b3b9-2fa5d8bcb741 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:45 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9f5e0cba-30f4-4a22-b3b9-2fa5d8bcb741 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:57:45 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9f5e0cba-30f4-4a22-b3b9-2fa5d8bcb741 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:57:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9f5e0cba-30f4-4a22-b3b9-2fa5d8bcb741 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:45 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9f5e0cba-30f4-4a22-b3b9-2fa5d8bcb741 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:57:45 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-9f5e0cba-30f4-4a22-b3b9-2fa5d8bcb741 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:57:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9f5e0cba-30f4-4a22-b3b9-2fa5d8bcb741 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b7600aa5-dec8-483f-b940-e186f83716ab 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:45 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b7600aa5-dec8-483f-b940-e186f83716ab 1073741824 Jul 10 06:57:45 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:45 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-203b20ba-7290-4d92-839a-b1f447fd5ff8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a28cfbef-4e25-4738-bb05-0a5a3a2dc130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c00b79d1-ca93-40eb-a4a6-de3d59d581f2', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:45 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-203b20ba-7290-4d92-839a-b1f447fd5ff8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0eb81a1-a288-404c-80d3-de990580bf80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:46 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-203b20ba-7290-4d92-839a-b1f447fd5ff8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Volume volume-c00b79d1-ca93-40eb-a4a6-de3d59d581f2 (c00b79d1-ca93-40eb-a4a6-de3d59d581f2): created successfully Jul 10 06:57:46 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-203b20ba-7290-4d92-839a-b1f447fd5ff8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0eb81a1-a288-404c-80d3-de990580bf80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:46 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-203b20ba-7290-4d92-839a-b1f447fd5ff8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Flow 'volume_create_manager' (e7a57fae-5792-46d0-b084-a6f6725e2e29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:46 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-203b20ba-7290-4d92-839a-b1f447fd5ff8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Created volume successfully. Jul 10 06:57:46 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-923bc3bc-0a14-4005-9e95-4814edc1bb36 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Acquiring lock "cinder-08fdd3d5-ab56-4594-896d-0f35bfce3741-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:57:46 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-923bc3bc-0a14-4005-9e95-4814edc1bb36 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "cinder-08fdd3d5-ab56-4594-896d-0f35bfce3741-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:57:46 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-923bc3bc-0a14-4005-9e95-4814edc1bb36 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Acquiring lock "cinder-quobyte-08fdd3d5-ab56-4594-896d-0f35bfce3741" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:57:46 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-923bc3bc-0a14-4005-9e95-4814edc1bb36 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "cinder-quobyte-08fdd3d5-ab56-4594-896d-0f35bfce3741" acquired by "delete_volume" :: waited 0.020s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:57:46 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ff4c2d-5746-4824-8a92-52241f7cfbd0]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:57:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-923bc3bc-0a14-4005-9e95-4814edc1bb36 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-08fdd3d5-ab56-4594-896d-0f35bfce3741 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:46 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-08fdd3d5-ab56-4594-896d-0f35bfce3741 Jul 10 06:57:46 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:46 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2b9814d0-2a5a-491d-9540-0fb93d6f8942 tempest-CreateVolumesFromSnapshotTest-2117965649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.719s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:46 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-2b9814d0-2a5a-491d-9540-0fb93d6f8942 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:57:46 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-2b9814d0-2a5a-491d-9540-0fb93d6f8942 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Deleted volume successfully. Jul 10 06:57:46 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-2b9814d0-2a5a-491d-9540-0fb93d6f8942 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "cinder-9f4f508e-d2f9-414a-9f66-3ac2dc4a4ee5-delete_volume" released by "delete_volume" :: held 2.660s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:57:46 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9f5e0cba-30f4-4a22-b3b9-2fa5d8bcb741 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b7600aa5-dec8-483f-b940-e186f83716ab 1073741824" returned: 0 in 1.011s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9f5e0cba-30f4-4a22-b3b9-2fa5d8bcb741 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b7600aa5-dec8-483f-b940-e186f83716ab {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:47 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b7600aa5-dec8-483f-b940-e186f83716ab Jul 10 06:57:47 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:47 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-923bc3bc-0a14-4005-9e95-4814edc1bb36 tempest-CreateVolumesFromSnapshotTest-2117965649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-08fdd3d5-ab56-4594-896d-0f35bfce3741" returned: 0 in 0.841s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-923bc3bc-0a14-4005-9e95-4814edc1bb36 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-08fdd3d5-ab56-4594-896d-0f35bfce3741 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:47 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-08fdd3d5-ab56-4594-896d-0f35bfce3741 Jul 10 06:57:47 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:47 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9f5e0cba-30f4-4a22-b3b9-2fa5d8bcb741 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b7600aa5-dec8-483f-b940-e186f83716ab" returned: 0 in 0.709s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:47 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9f5e0cba-30f4-4a22-b3b9-2fa5d8bcb741 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] <== create_volume: return (1774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:57:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9f5e0cba-30f4-4a22-b3b9-2fa5d8bcb741 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.777s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-745f3675-a02c-4a37-9eb4-0fe976d3f5a8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.467s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:47 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-745f3675-a02c-4a37-9eb4-0fe976d3f5a8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-972509291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=637ba402-7df9-4e71-91cb-8f4f6b7460d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7771f46cf86d45fa9ed083478cce8def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:57:42Z,use_quota=True,user_id='a7ef439e73b74e47bc04d9da93e12c36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:57:47 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-745f3675-a02c-4a37-9eb4-0fe976d3f5a8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Creating volume 637ba402-7df9-4e71-91cb-8f4f6b7460d7 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:57:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-745f3675-a02c-4a37-9eb4-0fe976d3f5a8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-745f3675-a02c-4a37-9eb4-0fe976d3f5a8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:47 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-745f3675-a02c-4a37-9eb4-0fe976d3f5a8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:57:47 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-745f3675-a02c-4a37-9eb4-0fe976d3f5a8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:57:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-745f3675-a02c-4a37-9eb4-0fe976d3f5a8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:47 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-745f3675-a02c-4a37-9eb4-0fe976d3f5a8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:57:47 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-745f3675-a02c-4a37-9eb4-0fe976d3f5a8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:57:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-745f3675-a02c-4a37-9eb4-0fe976d3f5a8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-637ba402-7df9-4e71-91cb-8f4f6b7460d7 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:47 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-923bc3bc-0a14-4005-9e95-4814edc1bb36 tempest-CreateVolumesFromSnapshotTest-2117965649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-08fdd3d5-ab56-4594-896d-0f35bfce3741" returned: 0 in 0.666s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:47 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-637ba402-7df9-4e71-91cb-8f4f6b7460d7 1073741824 Jul 10 06:57:47 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:47 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9f5e0cba-30f4-4a22-b3b9-2fa5d8bcb741 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c0a3458-b0e9-4dfb-a3e5-3e192a95a1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7600aa5-dec8-483f-b940-e186f83716ab', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:47 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9f5e0cba-30f4-4a22-b3b9-2fa5d8bcb741 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a51c6476-da49-42c9-8411-1f883c334322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:47 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-923bc3bc-0a14-4005-9e95-4814edc1bb36 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "cinder-quobyte-08fdd3d5-ab56-4594-896d-0f35bfce3741" released by "delete_volume" :: held 1.580s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:57:47 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-9f5e0cba-30f4-4a22-b3b9-2fa5d8bcb741 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Volume volume-b7600aa5-dec8-483f-b940-e186f83716ab (b7600aa5-dec8-483f-b940-e186f83716ab): created successfully Jul 10 06:57:47 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9f5e0cba-30f4-4a22-b3b9-2fa5d8bcb741 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a51c6476-da49-42c9-8411-1f883c334322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:47 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-9f5e0cba-30f4-4a22-b3b9-2fa5d8bcb741 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Flow 'volume_create_manager' (c89984a0-1421-45ee-afc3-4e88335fcd9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:47 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-9f5e0cba-30f4-4a22-b3b9-2fa5d8bcb741 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Created volume successfully. Jul 10 06:57:47 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-923bc3bc-0a14-4005-9e95-4814edc1bb36 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Created reservations ['e125fb5a-598b-4f6d-a802-5b6cab625e26', 'f80eaffa-ac2d-4cd0-8261-895bd6a7c116', '8daa409c-eae2-44bc-91d5-bb38799967c2', 'c8ccc7c1-10c9-4c96-8b72-b8d4074ae09b'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:57:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-923bc3bc-0a14-4005-9e95-4814edc1bb36 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-923bc3bc-0a14-4005-9e95-4814edc1bb36 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:47 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-923bc3bc-0a14-4005-9e95-4814edc1bb36 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:57:47 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-923bc3bc-0a14-4005-9e95-4814edc1bb36 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:57:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-923bc3bc-0a14-4005-9e95-4814edc1bb36 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-923bc3bc-0a14-4005-9e95-4814edc1bb36 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:47 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:57:47 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:48 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-91e6ba08-709d-461b-ac63-dcb25c5b43ca tempest-CreateVolumesFromSnapshotTest-2117965649 None] Acquiring lock "cinder-df8c37d0-8e16-48ac-8578-8db5543cc9e8-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:57:48 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-91e6ba08-709d-461b-ac63-dcb25c5b43ca tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "cinder-df8c37d0-8e16-48ac-8578-8db5543cc9e8-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:57:48 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-91e6ba08-709d-461b-ac63-dcb25c5b43ca tempest-CreateVolumesFromSnapshotTest-2117965649 None] Acquiring lock "cinder-quobyte-df8c37d0-8e16-48ac-8578-8db5543cc9e8" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:57:48 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-91e6ba08-709d-461b-ac63-dcb25c5b43ca tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "cinder-quobyte-df8c37d0-8e16-48ac-8578-8db5543cc9e8" acquired by "delete_volume" :: waited 0.029s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:57:48 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c90a56-8d00-430c-94ae-35c50c6ffc50]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:57:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-91e6ba08-709d-461b-ac63-dcb25c5b43ca tempest-CreateVolumesFromSnapshotTest-2117965649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-df8c37d0-8e16-48ac-8578-8db5543cc9e8 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:48 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-923bc3bc-0a14-4005-9e95-4814edc1bb36 tempest-CreateVolumesFromSnapshotTest-2117965649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.700s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:48 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-923bc3bc-0a14-4005-9e95-4814edc1bb36 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:57:48 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-923bc3bc-0a14-4005-9e95-4814edc1bb36 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Deleted volume successfully. Jul 10 06:57:48 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-923bc3bc-0a14-4005-9e95-4814edc1bb36 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "cinder-08fdd3d5-ab56-4594-896d-0f35bfce3741-delete_volume" released by "delete_volume" :: held 2.534s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:57:48 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-745f3675-a02c-4a37-9eb4-0fe976d3f5a8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-637ba402-7df9-4e71-91cb-8f4f6b7460d7 1073741824" returned: 0 in 0.948s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:48 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-df8c37d0-8e16-48ac-8578-8db5543cc9e8 Jul 10 06:57:48 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-745f3675-a02c-4a37-9eb4-0fe976d3f5a8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-637ba402-7df9-4e71-91cb-8f4f6b7460d7 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:48 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-637ba402-7df9-4e71-91cb-8f4f6b7460d7 Jul 10 06:57:48 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:49 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-91e6ba08-709d-461b-ac63-dcb25c5b43ca tempest-CreateVolumesFromSnapshotTest-2117965649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-df8c37d0-8e16-48ac-8578-8db5543cc9e8" returned: 0 in 0.828s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-91e6ba08-709d-461b-ac63-dcb25c5b43ca tempest-CreateVolumesFromSnapshotTest-2117965649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-df8c37d0-8e16-48ac-8578-8db5543cc9e8 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:49 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-745f3675-a02c-4a37-9eb4-0fe976d3f5a8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-637ba402-7df9-4e71-91cb-8f4f6b7460d7" returned: 0 in 0.664s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:49 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-745f3675-a02c-4a37-9eb4-0fe976d3f5a8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:57:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-745f3675-a02c-4a37-9eb4-0fe976d3f5a8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.660s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d38f2679-b312-4925-a96a-3e4d9ffd32d4 tempest-CinderUnicodeTest-636037436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.088s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:49 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-d38f2679-b312-4925-a96a-3e4d9ffd32d4 tempest-CinderUnicodeTest-636037436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e937ba51-88ac-4368-8c63-53a858646253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0227de555d1545aa8df29202bccaf0ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:57:42Z,use_quota=True,user_id='ecc25333531b4145855df3195051fdb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:57:49 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-d38f2679-b312-4925-a96a-3e4d9ffd32d4 tempest-CinderUnicodeTest-636037436 None] Creating volume e937ba51-88ac-4368-8c63-53a858646253 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:57:49 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-df8c37d0-8e16-48ac-8578-8db5543cc9e8 Jul 10 06:57:49 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d38f2679-b312-4925-a96a-3e4d9ffd32d4 tempest-CinderUnicodeTest-636037436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d38f2679-b312-4925-a96a-3e4d9ffd32d4 tempest-CinderUnicodeTest-636037436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:49 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-d38f2679-b312-4925-a96a-3e4d9ffd32d4 tempest-CinderUnicodeTest-636037436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:57:49 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-d38f2679-b312-4925-a96a-3e4d9ffd32d4 tempest-CinderUnicodeTest-636037436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:57:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d38f2679-b312-4925-a96a-3e4d9ffd32d4 tempest-CinderUnicodeTest-636037436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:49 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-d38f2679-b312-4925-a96a-3e4d9ffd32d4 tempest-CinderUnicodeTest-636037436 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:57:49 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-d38f2679-b312-4925-a96a-3e4d9ffd32d4 tempest-CinderUnicodeTest-636037436 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:57:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d38f2679-b312-4925-a96a-3e4d9ffd32d4 tempest-CinderUnicodeTest-636037436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e937ba51-88ac-4368-8c63-53a858646253 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:49 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-745f3675-a02c-4a37-9eb4-0fe976d3f5a8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5f6c80a-ae01-4d0a-abf4-abb8c1d3bffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-637ba402-7df9-4e71-91cb-8f4f6b7460d7', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:49 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e937ba51-88ac-4368-8c63-53a858646253 1073741824 Jul 10 06:57:49 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:49 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-745f3675-a02c-4a37-9eb4-0fe976d3f5a8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38b38470-3386-46c9-881e-f87cdf4b47f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:49 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-745f3675-a02c-4a37-9eb4-0fe976d3f5a8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Volume volume-637ba402-7df9-4e71-91cb-8f4f6b7460d7 (637ba402-7df9-4e71-91cb-8f4f6b7460d7): created successfully Jul 10 06:57:49 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-745f3675-a02c-4a37-9eb4-0fe976d3f5a8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38b38470-3386-46c9-881e-f87cdf4b47f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:49 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-745f3675-a02c-4a37-9eb4-0fe976d3f5a8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Flow 'volume_create_manager' (efddf18a-2892-4318-928f-b25493783c03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:49 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-745f3675-a02c-4a37-9eb4-0fe976d3f5a8 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Created volume successfully. Jul 10 06:57:49 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-fab125da-7dc6-40d2-afd4-83b959b4f68d tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Acquiring lock "cinder-637ba402-7df9-4e71-91cb-8f4f6b7460d7-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:57:49 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-fab125da-7dc6-40d2-afd4-83b959b4f68d tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "cinder-637ba402-7df9-4e71-91cb-8f4f6b7460d7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:57:49 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-fab125da-7dc6-40d2-afd4-83b959b4f68d tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Acquiring lock "cinder-quobyte-637ba402-7df9-4e71-91cb-8f4f6b7460d7" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:57:49 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-fab125da-7dc6-40d2-afd4-83b959b4f68d tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "cinder-quobyte-637ba402-7df9-4e71-91cb-8f4f6b7460d7" acquired by "delete_volume" :: waited 0.024s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:57:49 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[b645e18d-3651-490b-b4bb-3fa928859ea5]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:57:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-fab125da-7dc6-40d2-afd4-83b959b4f68d tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-637ba402-7df9-4e71-91cb-8f4f6b7460d7 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:49 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-637ba402-7df9-4e71-91cb-8f4f6b7460d7 Jul 10 06:57:49 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:50 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-91e6ba08-709d-461b-ac63-dcb25c5b43ca tempest-CreateVolumesFromSnapshotTest-2117965649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-df8c37d0-8e16-48ac-8578-8db5543cc9e8" returned: 0 in 0.871s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:50 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-91e6ba08-709d-461b-ac63-dcb25c5b43ca tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "cinder-quobyte-df8c37d0-8e16-48ac-8578-8db5543cc9e8" released by "delete_volume" :: held 1.771s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:57:50 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-91e6ba08-709d-461b-ac63-dcb25c5b43ca tempest-CreateVolumesFromSnapshotTest-2117965649 None] Created reservations ['02d565cc-4c4a-4c7c-bc39-5c4b4c61bbdc', '3298ef9d-fa98-4f38-bfea-2d7d0125285b', 'e2b86c46-9e46-4610-9d03-26d612846e8a', 'd94b3894-a685-43ba-bb8b-7faf142634c0'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:57:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-91e6ba08-709d-461b-ac63-dcb25c5b43ca tempest-CreateVolumesFromSnapshotTest-2117965649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-91e6ba08-709d-461b-ac63-dcb25c5b43ca tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:50 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-91e6ba08-709d-461b-ac63-dcb25c5b43ca tempest-CreateVolumesFromSnapshotTest-2117965649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:57:50 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-91e6ba08-709d-461b-ac63-dcb25c5b43ca tempest-CreateVolumesFromSnapshotTest-2117965649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:57:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-91e6ba08-709d-461b-ac63-dcb25c5b43ca tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-91e6ba08-709d-461b-ac63-dcb25c5b43ca tempest-CreateVolumesFromSnapshotTest-2117965649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:50 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:57:50 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:50 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d38f2679-b312-4925-a96a-3e4d9ffd32d4 tempest-CinderUnicodeTest-636037436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e937ba51-88ac-4368-8c63-53a858646253 1073741824" returned: 0 in 1.151s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d38f2679-b312-4925-a96a-3e4d9ffd32d4 tempest-CinderUnicodeTest-636037436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e937ba51-88ac-4368-8c63-53a858646253 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:50 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e937ba51-88ac-4368-8c63-53a858646253 Jul 10 06:57:50 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:50 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-9cdeb553-9cba-4362-82d1-ec3c06fa584f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Acquiring lock "cinder-9e438730-f81f-4b20-894a-a0da7be3317d-delete_snapshot" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:57:50 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-9cdeb553-9cba-4362-82d1-ec3c06fa584f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "cinder-9e438730-f81f-4b20-894a-a0da7be3317d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:57:50 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-9cdeb553-9cba-4362-82d1-ec3c06fa584f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Acquiring lock "cinder-quobyte-090a5e06-3c74-4824-90cb-006cc53a55bd" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:57:50 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-9cdeb553-9cba-4362-82d1-ec3c06fa584f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "cinder-quobyte-090a5e06-3c74-4824-90cb-006cc53a55bd" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:57:50 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-9cdeb553-9cba-4362-82d1-ec3c06fa584f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Acquiring lock "cinder-quobyte-9e438730-f81f-4b20-894a-a0da7be3317d" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:57:50 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-9cdeb553-9cba-4362-82d1-ec3c06fa584f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "cinder-quobyte-9e438730-f81f-4b20-894a-a0da7be3317d" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:57:50 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-9cdeb553-9cba-4362-82d1-ec3c06fa584f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Deleting offline snapshot 9e438730-f81f-4b20-894a-a0da7be3317d of volume 090a5e06-3c74-4824-90cb-006cc53a55bd {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:57:50 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-9cdeb553-9cba-4362-82d1-ec3c06fa584f tempest-CreateVolumesFromSnapshotTest-2117965649 None] snapshot_file for this snap is: volume-090a5e06-3c74-4824-90cb-006cc53a55bd.9e438730-f81f-4b20-894a-a0da7be3317d {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:57:50 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[a040a3e5-3e79-457f-bca8-a5535ae0b2b4]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:57:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9cdeb553-9cba-4362-82d1-ec3c06fa584f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd.9e438730-f81f-4b20-894a-a0da7be3317d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:50 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-fab125da-7dc6-40d2-afd4-83b959b4f68d tempest-CreateVolumesFromSourceVolumeTest-650305471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-637ba402-7df9-4e71-91cb-8f4f6b7460d7" returned: 0 in 1.118s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-fab125da-7dc6-40d2-afd4-83b959b4f68d tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-637ba402-7df9-4e71-91cb-8f4f6b7460d7 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:50 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-637ba402-7df9-4e71-91cb-8f4f6b7460d7 Jul 10 06:57:50 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:51 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd.9e438730-f81f-4b20-894a-a0da7be3317d Jul 10 06:57:51 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:51 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-91e6ba08-709d-461b-ac63-dcb25c5b43ca tempest-CreateVolumesFromSnapshotTest-2117965649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.859s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:51 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-91e6ba08-709d-461b-ac63-dcb25c5b43ca tempest-CreateVolumesFromSnapshotTest-2117965649 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:57:51 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-91e6ba08-709d-461b-ac63-dcb25c5b43ca tempest-CreateVolumesFromSnapshotTest-2117965649 None] Deleted volume successfully. Jul 10 06:57:51 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-91e6ba08-709d-461b-ac63-dcb25c5b43ca tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "cinder-df8c37d0-8e16-48ac-8578-8db5543cc9e8-delete_volume" released by "delete_volume" :: held 2.928s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:57:51 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d38f2679-b312-4925-a96a-3e4d9ffd32d4 tempest-CinderUnicodeTest-636037436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e937ba51-88ac-4368-8c63-53a858646253" returned: 0 in 0.898s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:51 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-d38f2679-b312-4925-a96a-3e4d9ffd32d4 tempest-CinderUnicodeTest-636037436 None] <== create_volume: return (2130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:57:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d38f2679-b312-4925-a96a-3e4d9ffd32d4 tempest-CinderUnicodeTest-636037436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.134s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:51 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d38f2679-b312-4925-a96a-3e4d9ffd32d4 tempest-CinderUnicodeTest-636037436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbe14250-caf0-4b89-9a73-ebceae7f5867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e937ba51-88ac-4368-8c63-53a858646253', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:51 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d38f2679-b312-4925-a96a-3e4d9ffd32d4 tempest-CinderUnicodeTest-636037436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee02f958-7dc7-4fd9-a96f-68791508b10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:51 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-d38f2679-b312-4925-a96a-3e4d9ffd32d4 tempest-CinderUnicodeTest-636037436 None] Volume volume-e937ba51-88ac-4368-8c63-53a858646253 (e937ba51-88ac-4368-8c63-53a858646253): created successfully Jul 10 06:57:51 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d38f2679-b312-4925-a96a-3e4d9ffd32d4 tempest-CinderUnicodeTest-636037436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee02f958-7dc7-4fd9-a96f-68791508b10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:51 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-d38f2679-b312-4925-a96a-3e4d9ffd32d4 tempest-CinderUnicodeTest-636037436 None] Flow 'volume_create_manager' (86866143-4065-4fe0-9753-efeaa74c40af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:51 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-d38f2679-b312-4925-a96a-3e4d9ffd32d4 tempest-CinderUnicodeTest-636037436 None] Created volume successfully. Jul 10 06:57:51 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-fab125da-7dc6-40d2-afd4-83b959b4f68d tempest-CreateVolumesFromSourceVolumeTest-650305471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-637ba402-7df9-4e71-91cb-8f4f6b7460d7" returned: 0 in 0.848s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:51 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-fab125da-7dc6-40d2-afd4-83b959b4f68d tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "cinder-quobyte-637ba402-7df9-4e71-91cb-8f4f6b7460d7" released by "delete_volume" :: held 2.028s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:57:51 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-fab125da-7dc6-40d2-afd4-83b959b4f68d tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Created reservations ['006bef27-3cbb-4d1b-b28f-7c3ad1e6fe16', '51e7c8c1-b092-4b57-8662-c82f3b8e394a', '05c5dd54-db74-4eea-a179-9c64fd515953', '5f49209c-20e8-4a3e-acb6-17c01dc5d4d1'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:57:51 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9cdeb553-9cba-4362-82d1-ec3c06fa584f tempest-CreateVolumesFromSnapshotTest-2117965649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd.9e438730-f81f-4b20-894a-a0da7be3317d" returned: 0 in 1.091s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:51 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-9cdeb553-9cba-4362-82d1-ec3c06fa584f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-090a5e06-3c74-4824-90cb-006cc53a55bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:57:51 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94253f6-02f8-49ff-8852-be78b1f754ee]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:57:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9cdeb553-9cba-4362-82d1-ec3c06fa584f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-fab125da-7dc6-40d2-afd4-83b959b4f68d tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-fab125da-7dc6-40d2-afd4-83b959b4f68d tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:52 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-fab125da-7dc6-40d2-afd4-83b959b4f68d tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:57:52 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-fab125da-7dc6-40d2-afd4-83b959b4f68d tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:57:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-fab125da-7dc6-40d2-afd4-83b959b4f68d tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-fab125da-7dc6-40d2-afd4-83b959b4f68d tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:52 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:57:52 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:52 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd Jul 10 06:57:52 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:52 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-fab125da-7dc6-40d2-afd4-83b959b4f68d tempest-CreateVolumesFromSourceVolumeTest-650305471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.758s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:52 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-fab125da-7dc6-40d2-afd4-83b959b4f68d tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:57:52 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-fab125da-7dc6-40d2-afd4-83b959b4f68d tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Deleted volume successfully. Jul 10 06:57:52 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-fab125da-7dc6-40d2-afd4-83b959b4f68d tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "cinder-637ba402-7df9-4e71-91cb-8f4f6b7460d7-delete_volume" released by "delete_volume" :: held 3.151s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:57:52 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9cdeb553-9cba-4362-82d1-ec3c06fa584f tempest-CreateVolumesFromSnapshotTest-2117965649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd" returned: 0 in 0.901s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9cdeb553-9cba-4362-82d1-ec3c06fa584f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd.9e438730-f81f-4b20-894a-a0da7be3317d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:52 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd.9e438730-f81f-4b20-894a-a0da7be3317d Jul 10 06:57:52 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:53 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e148e12e-a1ad-4648-9167-b4d5faf54525 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Acquiring lock "cinder-b7600aa5-dec8-483f-b940-e186f83716ab-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:57:53 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:UPDATE=186,cinder:SELECT=124,cinder:INSERT=44,cinder:DELETE=23 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:57:53 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e148e12e-a1ad-4648-9167-b4d5faf54525 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "cinder-b7600aa5-dec8-483f-b940-e186f83716ab-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:57:53 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f8d4b53-8ab6-4460-b148-62d53ccf1189 tempest-CinderUnicodeTest-636037436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:57:53 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5f8d4b53-8ab6-4460-b148-62d53ccf1189 tempest-CinderUnicodeTest-636037436 None] Flow 'volume_create_manager' (c099f602-6d67-4be4-98d0-4cd87deda634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:53 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5f8d4b53-8ab6-4460-b148-62d53ccf1189 tempest-CinderUnicodeTest-636037436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21956c3b-ab1e-4100-977d-3b4d6900b876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:53 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5f8d4b53-8ab6-4460-b148-62d53ccf1189 tempest-CinderUnicodeTest-636037436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21956c3b-ab1e-4100-977d-3b4d6900b876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:57:53Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-873159302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb00d3de-1d61-4cfe-8150-9d8ae9a381ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0227de555d1545aa8df29202bccaf0ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:57:53Z,use_quota=True,user_id='ecc25333531b4145855df3195051fdb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:53 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5f8d4b53-8ab6-4460-b148-62d53ccf1189 tempest-CinderUnicodeTest-636037436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a3c772a-06a6-42ad-b92a-54a679cf0b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:53 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5f8d4b53-8ab6-4460-b148-62d53ccf1189 tempest-CinderUnicodeTest-636037436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a3c772a-06a6-42ad-b92a-54a679cf0b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:53 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5f8d4b53-8ab6-4460-b148-62d53ccf1189 tempest-CinderUnicodeTest-636037436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf818707-c5fe-4334-9da6-e165f9cc99c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:53 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5f8d4b53-8ab6-4460-b148-62d53ccf1189 tempest-CinderUnicodeTest-636037436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf818707-c5fe-4334-9da6-e165f9cc99c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb00d3de-1d61-4cfe-8150-9d8ae9a381ee', 'volume_name': 'volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:53 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5f8d4b53-8ab6-4460-b148-62d53ccf1189 tempest-CinderUnicodeTest-636037436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c86f381-1d7a-4554-87bb-eee440529818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:53 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5f8d4b53-8ab6-4460-b148-62d53ccf1189 tempest-CinderUnicodeTest-636037436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c86f381-1d7a-4554-87bb-eee440529818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:53 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5f8d4b53-8ab6-4460-b148-62d53ccf1189 tempest-CinderUnicodeTest-636037436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99264abc-f130-4a21-a3e9-860d4834f11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:53 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-5f8d4b53-8ab6-4460-b148-62d53ccf1189 tempest-CinderUnicodeTest-636037436 None] Volume eb00d3de-1d61-4cfe-8150-9d8ae9a381ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee', 'volume_size': 1} Jul 10 06:57:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5f8d4b53-8ab6-4460-b148-62d53ccf1189 tempest-CinderUnicodeTest-636037436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5f8d4b53-8ab6-4460-b148-62d53ccf1189 tempest-CinderUnicodeTest-636037436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:53 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5f8d4b53-8ab6-4460-b148-62d53ccf1189 tempest-CinderUnicodeTest-636037436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:57:53Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-873159302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb00d3de-1d61-4cfe-8150-9d8ae9a381ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0227de555d1545aa8df29202bccaf0ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:57:53Z,use_quota=True,user_id='ecc25333531b4145855df3195051fdb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:57:53 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-5f8d4b53-8ab6-4460-b148-62d53ccf1189 tempest-CinderUnicodeTest-636037436 None] Creating volume eb00d3de-1d61-4cfe-8150-9d8ae9a381ee {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:57:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5f8d4b53-8ab6-4460-b148-62d53ccf1189 tempest-CinderUnicodeTest-636037436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5f8d4b53-8ab6-4460-b148-62d53ccf1189 tempest-CinderUnicodeTest-636037436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:53 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5f8d4b53-8ab6-4460-b148-62d53ccf1189 tempest-CinderUnicodeTest-636037436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:57:53 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5f8d4b53-8ab6-4460-b148-62d53ccf1189 tempest-CinderUnicodeTest-636037436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:57:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5f8d4b53-8ab6-4460-b148-62d53ccf1189 tempest-CinderUnicodeTest-636037436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:53 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5f8d4b53-8ab6-4460-b148-62d53ccf1189 tempest-CinderUnicodeTest-636037436 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:57:53 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-5f8d4b53-8ab6-4460-b148-62d53ccf1189 tempest-CinderUnicodeTest-636037436 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:57:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5f8d4b53-8ab6-4460-b148-62d53ccf1189 tempest-CinderUnicodeTest-636037436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:53 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee 1073741824 Jul 10 06:57:53 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:53 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e148e12e-a1ad-4648-9167-b4d5faf54525 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Acquiring lock "cinder-quobyte-b7600aa5-dec8-483f-b940-e186f83716ab" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:57:53 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e148e12e-a1ad-4648-9167-b4d5faf54525 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "cinder-quobyte-b7600aa5-dec8-483f-b940-e186f83716ab" acquired by "delete_volume" :: waited 0.026s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:57:53 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ab8d88-34e0-45b2-bda9-536c1c353244]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:57:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e148e12e-a1ad-4648-9167-b4d5faf54525 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b7600aa5-dec8-483f-b940-e186f83716ab {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:53 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b7600aa5-dec8-483f-b940-e186f83716ab Jul 10 06:57:53 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:53 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9cdeb553-9cba-4362-82d1-ec3c06fa584f tempest-CreateVolumesFromSnapshotTest-2117965649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd.9e438730-f81f-4b20-894a-a0da7be3317d" returned: 0 in 0.961s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9cdeb553-9cba-4362-82d1-ec3c06fa584f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd.9e438730-f81f-4b20-894a-a0da7be3317d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:53 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd.9e438730-f81f-4b20-894a-a0da7be3317d Jul 10 06:57:53 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:54 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e148e12e-a1ad-4648-9167-b4d5faf54525 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b7600aa5-dec8-483f-b940-e186f83716ab" returned: 0 in 0.877s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e148e12e-a1ad-4648-9167-b4d5faf54525 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b7600aa5-dec8-483f-b940-e186f83716ab {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:54 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b7600aa5-dec8-483f-b940-e186f83716ab Jul 10 06:57:54 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:54 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5f8d4b53-8ab6-4460-b148-62d53ccf1189 tempest-CinderUnicodeTest-636037436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee 1073741824" returned: 0 in 1.071s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:54 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:SELECT=143,cinder:UPDATE=184,cinder:INSERT=48,cinder:DELETE=14 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:57:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5f8d4b53-8ab6-4460-b148-62d53ccf1189 tempest-CinderUnicodeTest-636037436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:54 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee Jul 10 06:57:54 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:54 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9cdeb553-9cba-4362-82d1-ec3c06fa584f tempest-CreateVolumesFromSnapshotTest-2117965649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd.9e438730-f81f-4b20-894a-a0da7be3317d" returned: 0 in 0.857s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:54 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-9cdeb553-9cba-4362-82d1-ec3c06fa584f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "cinder-quobyte-9e438730-f81f-4b20-894a-a0da7be3317d" released by "_delete_snapshot" :: held 3.971s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:57:54 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-9cdeb553-9cba-4362-82d1-ec3c06fa584f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "cinder-quobyte-090a5e06-3c74-4824-90cb-006cc53a55bd" released by "delete_snapshot" :: held 4.022s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:57:54 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-9cdeb553-9cba-4362-82d1-ec3c06fa584f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Created reservations ['69267502-a621-4a21-9473-3127f76a3d68', '2c44668c-7821-4224-9d6f-3666aa774c6c', 'c688f2d4-a7b8-4919-aca0-0b57ae570042', '6af21d43-463b-4e08-9863-54a6bb5f3425'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:57:54 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-9cdeb553-9cba-4362-82d1-ec3c06fa584f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Delete snapshot completed successfully. Jul 10 06:57:54 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-9cdeb553-9cba-4362-82d1-ec3c06fa584f tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "cinder-9e438730-f81f-4b20-894a-a0da7be3317d-delete_snapshot" released by "delete_snapshot" :: held 4.194s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:57:55 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e148e12e-a1ad-4648-9167-b4d5faf54525 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b7600aa5-dec8-483f-b940-e186f83716ab" returned: 0 in 0.776s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e148e12e-a1ad-4648-9167-b4d5faf54525 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "cinder-quobyte-b7600aa5-dec8-483f-b940-e186f83716ab" released by "delete_volume" :: held 1.701s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:57:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-36f2d0a9-a836-4a06-aee9-886087974177 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Acquiring lock "cinder-090a5e06-3c74-4824-90cb-006cc53a55bd-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:57:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-36f2d0a9-a836-4a06-aee9-886087974177 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "cinder-090a5e06-3c74-4824-90cb-006cc53a55bd-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:57:55 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-e148e12e-a1ad-4648-9167-b4d5faf54525 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Created reservations ['591b63c5-e293-4228-87fa-3412e60c12fe', '3918ee9a-ad5b-4642-b97d-b7736aba4eb5', 'a208e114-75e2-4020-a9c6-38a237a131b7', 'a5ae0ce9-f104-4461-919c-b66b326a60b5'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:57:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-36f2d0a9-a836-4a06-aee9-886087974177 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Acquiring lock "cinder-quobyte-090a5e06-3c74-4824-90cb-006cc53a55bd" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:57:55 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-36f2d0a9-a836-4a06-aee9-886087974177 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "cinder-quobyte-090a5e06-3c74-4824-90cb-006cc53a55bd" acquired by "delete_volume" :: waited 0.047s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:57:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5f8d4b53-8ab6-4460-b148-62d53ccf1189 tempest-CinderUnicodeTest-636037436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee" returned: 0 in 0.835s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:55 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5f8d4b53-8ab6-4460-b148-62d53ccf1189 tempest-CinderUnicodeTest-636037436 None] <== create_volume: return (1970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:57:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5f8d4b53-8ab6-4460-b148-62d53ccf1189 tempest-CinderUnicodeTest-636037436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.974s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:55 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed6fede-fe11-4092-ba97-f05c4996d994]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:57:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-36f2d0a9-a836-4a06-aee9-886087974177 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5f8d4b53-8ab6-4460-b148-62d53ccf1189 tempest-CinderUnicodeTest-636037436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99264abc-f130-4a21-a3e9-860d4834f11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5f8d4b53-8ab6-4460-b148-62d53ccf1189 tempest-CinderUnicodeTest-636037436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ecfbe6f-f0fc-4d5f-8806-2b53d914c2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:57:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e148e12e-a1ad-4648-9167-b4d5faf54525 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e148e12e-a1ad-4648-9167-b4d5faf54525 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:55 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-e148e12e-a1ad-4648-9167-b4d5faf54525 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:57:55 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-e148e12e-a1ad-4648-9167-b4d5faf54525 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:57:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e148e12e-a1ad-4648-9167-b4d5faf54525 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e148e12e-a1ad-4648-9167-b4d5faf54525 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:55 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-5f8d4b53-8ab6-4460-b148-62d53ccf1189 tempest-CinderUnicodeTest-636037436 None] Volume volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee (eb00d3de-1d61-4cfe-8150-9d8ae9a381ee): created successfully Jul 10 06:57:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5f8d4b53-8ab6-4460-b148-62d53ccf1189 tempest-CinderUnicodeTest-636037436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ecfbe6f-f0fc-4d5f-8806-2b53d914c2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:57:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-5f8d4b53-8ab6-4460-b148-62d53ccf1189 tempest-CinderUnicodeTest-636037436 None] Flow 'volume_create_manager' (c099f602-6d67-4be4-98d0-4cd87deda634) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:57:55 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-5f8d4b53-8ab6-4460-b148-62d53ccf1189 tempest-CinderUnicodeTest-636037436 None] Created volume successfully. Jul 10 06:57:55 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:57:55 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-9a0c47dc-2357-47fa-aa14-6c0720456e1d tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Acquiring lock "cinder-c00b79d1-ca93-40eb-a4a6-de3d59d581f2-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:57:55 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd Jul 10 06:57:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-9a0c47dc-2357-47fa-aa14-6c0720456e1d tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "cinder-c00b79d1-ca93-40eb-a4a6-de3d59d581f2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:57:55 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-9a0c47dc-2357-47fa-aa14-6c0720456e1d tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Acquiring lock "cinder-quobyte-c00b79d1-ca93-40eb-a4a6-de3d59d581f2" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:57:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-9a0c47dc-2357-47fa-aa14-6c0720456e1d tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "cinder-quobyte-c00b79d1-ca93-40eb-a4a6-de3d59d581f2" acquired by "delete_volume" :: waited 0.019s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:57:55 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90dc197-6565-4b2e-9266-f5c0b317cda6]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:57:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9a0c47dc-2357-47fa-aa14-6c0720456e1d tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c00b79d1-ca93-40eb-a4a6-de3d59d581f2 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:55 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c00b79d1-ca93-40eb-a4a6-de3d59d581f2 Jul 10 06:57:55 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:56 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e148e12e-a1ad-4648-9167-b4d5faf54525 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.804s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:56 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-e148e12e-a1ad-4648-9167-b4d5faf54525 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:57:56 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-e148e12e-a1ad-4648-9167-b4d5faf54525 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Deleted volume successfully. Jul 10 06:57:56 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e148e12e-a1ad-4648-9167-b4d5faf54525 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "cinder-b7600aa5-dec8-483f-b940-e186f83716ab-delete_volume" released by "delete_volume" :: held 3.000s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:57:56 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-36f2d0a9-a836-4a06-aee9-886087974177 tempest-CreateVolumesFromSnapshotTest-2117965649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd" returned: 0 in 1.002s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-36f2d0a9-a836-4a06-aee9-886087974177 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:56 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd Jul 10 06:57:56 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:56 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9a0c47dc-2357-47fa-aa14-6c0720456e1d tempest-CreateVolumesFromSourceVolumeTest-650305471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c00b79d1-ca93-40eb-a4a6-de3d59d581f2" returned: 0 in 0.922s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9a0c47dc-2357-47fa-aa14-6c0720456e1d tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c00b79d1-ca93-40eb-a4a6-de3d59d581f2 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:56 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c00b79d1-ca93-40eb-a4a6-de3d59d581f2 Jul 10 06:57:56 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-6d8faeb0-d9e5-4cd8-a808-e0485c06fcc3 tempest-CinderUnicodeTest-636037436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-6d8faeb0-d9e5-4cd8-a808-e0485c06fcc3 tempest-CinderUnicodeTest-636037436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:56 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-6d8faeb0-d9e5-4cd8-a808-e0485c06fcc3 tempest-CinderUnicodeTest-636037436 None] Creating offline snapshot 311228d1-2402-4beb-acce-1484f2edf7ba of volume eb00d3de-1d61-4cfe-8150-9d8ae9a381ee {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:57:56 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f74e9c-bce9-4679-bf94-64ed426dd4a4]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:57:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6d8faeb0-d9e5-4cd8-a808-e0485c06fcc3 tempest-CinderUnicodeTest-636037436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:56 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee Jul 10 06:57:56 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:57 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-36f2d0a9-a836-4a06-aee9-886087974177 tempest-CreateVolumesFromSnapshotTest-2117965649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-090a5e06-3c74-4824-90cb-006cc53a55bd" returned: 0 in 0.804s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:57 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-36f2d0a9-a836-4a06-aee9-886087974177 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "cinder-quobyte-090a5e06-3c74-4824-90cb-006cc53a55bd" released by "delete_volume" :: held 1.890s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:57:57 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-36f2d0a9-a836-4a06-aee9-886087974177 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Created reservations ['489b798a-20d5-4c3a-987e-416ef360f69c', '302c6c43-e262-425a-a549-7320b42f73b6', 'b0ed7bdd-8da2-4f3c-8aed-9c0363b062ea', 'c720276c-9196-49ef-a031-4d2fa2cdcef2'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:57:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-36f2d0a9-a836-4a06-aee9-886087974177 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-36f2d0a9-a836-4a06-aee9-886087974177 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:57 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-36f2d0a9-a836-4a06-aee9-886087974177 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:57:57 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-36f2d0a9-a836-4a06-aee9-886087974177 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:57:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-36f2d0a9-a836-4a06-aee9-886087974177 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-36f2d0a9-a836-4a06-aee9-886087974177 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:57 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:57:57 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:57 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9a0c47dc-2357-47fa-aa14-6c0720456e1d tempest-CreateVolumesFromSourceVolumeTest-650305471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-c00b79d1-ca93-40eb-a4a6-de3d59d581f2" returned: 0 in 0.948s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:57 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-9a0c47dc-2357-47fa-aa14-6c0720456e1d tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "cinder-quobyte-c00b79d1-ca93-40eb-a4a6-de3d59d581f2" released by "delete_volume" :: held 1.962s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:57:57 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-9a0c47dc-2357-47fa-aa14-6c0720456e1d tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Created reservations ['f361401a-7b85-4e4a-b30a-fd894048712a', '182abc46-fd6d-436f-83c7-5f62a2b845f9', '15a97e9d-1000-46db-8107-8a0b8918845e', 'a9e5085d-f122-4c9e-853e-2abf65bac9e2'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:57:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9a0c47dc-2357-47fa-aa14-6c0720456e1d tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:57:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9a0c47dc-2357-47fa-aa14-6c0720456e1d tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:57:57 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9a0c47dc-2357-47fa-aa14-6c0720456e1d tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:57:57 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9a0c47dc-2357-47fa-aa14-6c0720456e1d tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:57:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9a0c47dc-2357-47fa-aa14-6c0720456e1d tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:57:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9a0c47dc-2357-47fa-aa14-6c0720456e1d tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:57 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:57:57 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:57 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a6df6601-648d-4f8e-9826-3454451cbd94 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Acquiring lock "cinder-100e51c0-9bfb-4484-babb-95f1c31641e8-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:57:57 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a6df6601-648d-4f8e-9826-3454451cbd94 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "cinder-100e51c0-9bfb-4484-babb-95f1c31641e8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:57:57 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a6df6601-648d-4f8e-9826-3454451cbd94 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Acquiring lock "cinder-quobyte-100e51c0-9bfb-4484-babb-95f1c31641e8" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:57:57 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a6df6601-648d-4f8e-9826-3454451cbd94 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "cinder-quobyte-100e51c0-9bfb-4484-babb-95f1c31641e8" acquired by "delete_volume" :: waited 0.019s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:57:57 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f79908-f070-4f64-aac1-524c06c74ffc]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:57:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a6df6601-648d-4f8e-9826-3454451cbd94 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-100e51c0-9bfb-4484-babb-95f1c31641e8 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:58 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6d8faeb0-d9e5-4cd8-a808-e0485c06fcc3 tempest-CinderUnicodeTest-636037436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee" returned: 0 in 1.275s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6d8faeb0-d9e5-4cd8-a808-e0485c06fcc3 tempest-CinderUnicodeTest-636037436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee.311228d1-2402-4beb-acce-1484f2edf7ba 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:58 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee.311228d1-2402-4beb-acce-1484f2edf7ba 1G Jul 10 06:57:58 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:58 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-36f2d0a9-a836-4a06-aee9-886087974177 tempest-CreateVolumesFromSnapshotTest-2117965649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.957s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:58 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-36f2d0a9-a836-4a06-aee9-886087974177 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:57:58 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-36f2d0a9-a836-4a06-aee9-886087974177 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Deleted volume successfully. Jul 10 06:57:58 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-36f2d0a9-a836-4a06-aee9-886087974177 tempest-CreateVolumesFromSnapshotTest-2117965649 None] Lock "cinder-090a5e06-3c74-4824-90cb-006cc53a55bd-delete_volume" released by "delete_volume" :: held 3.146s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:57:58 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-100e51c0-9bfb-4484-babb-95f1c31641e8 Jul 10 06:57:58 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:58 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9a0c47dc-2357-47fa-aa14-6c0720456e1d tempest-CreateVolumesFromSourceVolumeTest-650305471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 1.079s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:58 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-9a0c47dc-2357-47fa-aa14-6c0720456e1d tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:57:58 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-9a0c47dc-2357-47fa-aa14-6c0720456e1d tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Deleted volume successfully. Jul 10 06:57:58 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-9a0c47dc-2357-47fa-aa14-6c0720456e1d tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "cinder-c00b79d1-ca93-40eb-a4a6-de3d59d581f2-delete_volume" released by "delete_volume" :: held 3.457s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:57:59 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a6df6601-648d-4f8e-9826-3454451cbd94 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-100e51c0-9bfb-4484-babb-95f1c31641e8" returned: 0 in 1.236s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a6df6601-648d-4f8e-9826-3454451cbd94 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-100e51c0-9bfb-4484-babb-95f1c31641e8 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:59 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-100e51c0-9bfb-4484-babb-95f1c31641e8 Jul 10 06:57:59 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:57:59 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Jul 10 06:57:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6d8faeb0-d9e5-4cd8-a808-e0485c06fcc3 tempest-CinderUnicodeTest-636037436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee.311228d1-2402-4beb-acce-1484f2edf7ba 1G" returned: 0 in 1.252s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:57:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6d8faeb0-d9e5-4cd8-a808-e0485c06fcc3 tempest-CinderUnicodeTest-636037436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee.311228d1-2402-4beb-acce-1484f2edf7ba {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:57:59 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee.311228d1-2402-4beb-acce-1484f2edf7ba Jul 10 06:57:59 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:00 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a6df6601-648d-4f8e-9826-3454451cbd94 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-100e51c0-9bfb-4484-babb-95f1c31641e8" returned: 0 in 0.963s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:00 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a6df6601-648d-4f8e-9826-3454451cbd94 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "cinder-quobyte-100e51c0-9bfb-4484-babb-95f1c31641e8" released by "delete_volume" :: held 2.257s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:00 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-a6df6601-648d-4f8e-9826-3454451cbd94 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Created reservations ['b91e44a9-cdb6-4812-a2a5-b1c0b52c2694', '22bf3f6f-d5fe-4f72-bbed-5bc9cf9ce9da', '1285da1f-1215-4dd9-a076-7e2c9fba9756', '69d6db3c-bea8-4f13-bce0-da9e0211a4ab'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:58:00 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6d8faeb0-d9e5-4cd8-a808-e0485c06fcc3 tempest-CinderUnicodeTest-636037436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee.311228d1-2402-4beb-acce-1484f2edf7ba" returned: 0 in 1.021s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:00 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-6d8faeb0-d9e5-4cd8-a808-e0485c06fcc3 tempest-CinderUnicodeTest-636037436 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee.311228d1-2402-4beb-acce-1484f2edf7ba is being set with open permissions: ugo+rw Jul 10 06:58:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6d8faeb0-d9e5-4cd8-a808-e0485c06fcc3 tempest-CinderUnicodeTest-636037436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee.311228d1-2402-4beb-acce-1484f2edf7ba {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:00 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee.311228d1-2402-4beb-acce-1484f2edf7ba Jul 10 06:58:00 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a6df6601-648d-4f8e-9826-3454451cbd94 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a6df6601-648d-4f8e-9826-3454451cbd94 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:00 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-a6df6601-648d-4f8e-9826-3454451cbd94 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:58:00 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-a6df6601-648d-4f8e-9826-3454451cbd94 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:58:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a6df6601-648d-4f8e-9826-3454451cbd94 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a6df6601-648d-4f8e-9826-3454451cbd94 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:00 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:58:00 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:01 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6d8faeb0-d9e5-4cd8-a808-e0485c06fcc3 tempest-CinderUnicodeTest-636037436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee.311228d1-2402-4beb-acce-1484f2edf7ba" returned: 0 in 0.742s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6d8faeb0-d9e5-4cd8-a808-e0485c06fcc3 tempest-CinderUnicodeTest-636037436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:01 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a6df6601-648d-4f8e-9826-3454451cbd94 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.775s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:01 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-a6df6601-648d-4f8e-9826-3454451cbd94 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:58:01 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee.info Jul 10 06:58:01 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:01 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-a6df6601-648d-4f8e-9826-3454451cbd94 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Deleted volume successfully. Jul 10 06:58:01 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-a6df6601-648d-4f8e-9826-3454451cbd94 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "cinder-100e51c0-9bfb-4484-babb-95f1c31641e8-delete_volume" released by "delete_volume" :: held 3.356s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:01 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-54ecc49f-7496-4d63-924b-6fdc89e81d53 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Acquiring lock "cinder-58f654d7-168f-41b1-aece-618fc2fc077e-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:01 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-54ecc49f-7496-4d63-924b-6fdc89e81d53 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "cinder-58f654d7-168f-41b1-aece-618fc2fc077e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:01 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-54ecc49f-7496-4d63-924b-6fdc89e81d53 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Acquiring lock "cinder-quobyte-58f654d7-168f-41b1-aece-618fc2fc077e" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:01 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-54ecc49f-7496-4d63-924b-6fdc89e81d53 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "cinder-quobyte-58f654d7-168f-41b1-aece-618fc2fc077e" acquired by "delete_volume" :: waited 0.019s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:01 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[77eed040-c5a6-42d7-b7c0-abac4f995b7e]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:58:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-54ecc49f-7496-4d63-924b-6fdc89e81d53 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-58f654d7-168f-41b1-aece-618fc2fc077e {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:01 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-58f654d7-168f-41b1-aece-618fc2fc077e Jul 10 06:58:01 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:01 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6d8faeb0-d9e5-4cd8-a808-e0485c06fcc3 tempest-CinderUnicodeTest-636037436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee.info" returned: 0 in 0.846s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:01 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-6d8faeb0-d9e5-4cd8-a808-e0485c06fcc3 tempest-CinderUnicodeTest-636037436 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee.info is being set with open permissions: ugo+rw Jul 10 06:58:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6d8faeb0-d9e5-4cd8-a808-e0485c06fcc3 tempest-CinderUnicodeTest-636037436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:02 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee.info Jul 10 06:58:02 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:02 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-54ecc49f-7496-4d63-924b-6fdc89e81d53 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-58f654d7-168f-41b1-aece-618fc2fc077e" returned: 0 in 0.903s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-54ecc49f-7496-4d63-924b-6fdc89e81d53 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-58f654d7-168f-41b1-aece-618fc2fc077e {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:02 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-58f654d7-168f-41b1-aece-618fc2fc077e Jul 10 06:58:02 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:02 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6d8faeb0-d9e5-4cd8-a808-e0485c06fcc3 tempest-CinderUnicodeTest-636037436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee.info" returned: 0 in 0.784s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-6d8faeb0-d9e5-4cd8-a808-e0485c06fcc3 tempest-CinderUnicodeTest-636037436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.043s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:02 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-6d8faeb0-d9e5-4cd8-a808-e0485c06fcc3 tempest-CinderUnicodeTest-636037436 None] Create snapshot completed successfully Jul 10 06:58:03 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7b17e625-82c5-406f-8d58-fdc4c271c5c8 tempest-CinderUnicodeTest-636037436 None] Acquiring lock "cinder-311228d1-2402-4beb-acce-1484f2edf7ba-delete_snapshot" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:03 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7b17e625-82c5-406f-8d58-fdc4c271c5c8 tempest-CinderUnicodeTest-636037436 None] Lock "cinder-311228d1-2402-4beb-acce-1484f2edf7ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:03 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7b17e625-82c5-406f-8d58-fdc4c271c5c8 tempest-CinderUnicodeTest-636037436 None] Acquiring lock "cinder-quobyte-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:03 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-54ecc49f-7496-4d63-924b-6fdc89e81d53 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-58f654d7-168f-41b1-aece-618fc2fc077e" returned: 0 in 0.884s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:03 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7b17e625-82c5-406f-8d58-fdc4c271c5c8 tempest-CinderUnicodeTest-636037436 None] Lock "cinder-quobyte-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:03 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7b17e625-82c5-406f-8d58-fdc4c271c5c8 tempest-CinderUnicodeTest-636037436 None] Acquiring lock "cinder-quobyte-311228d1-2402-4beb-acce-1484f2edf7ba" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:03 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-54ecc49f-7496-4d63-924b-6fdc89e81d53 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "cinder-quobyte-58f654d7-168f-41b1-aece-618fc2fc077e" released by "delete_volume" :: held 1.849s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:03 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7b17e625-82c5-406f-8d58-fdc4c271c5c8 tempest-CinderUnicodeTest-636037436 None] Lock "cinder-quobyte-311228d1-2402-4beb-acce-1484f2edf7ba" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:03 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-7b17e625-82c5-406f-8d58-fdc4c271c5c8 tempest-CinderUnicodeTest-636037436 None] Deleting offline snapshot 311228d1-2402-4beb-acce-1484f2edf7ba of volume eb00d3de-1d61-4cfe-8150-9d8ae9a381ee {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:58:03 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-7b17e625-82c5-406f-8d58-fdc4c271c5c8 tempest-CinderUnicodeTest-636037436 None] snapshot_file for this snap is: volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee.311228d1-2402-4beb-acce-1484f2edf7ba {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:58:03 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50f64dd-a1ee-4401-ad94-1f4d42dda9c2]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:58:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7b17e625-82c5-406f-8d58-fdc4c271c5c8 tempest-CinderUnicodeTest-636037436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee.311228d1-2402-4beb-acce-1484f2edf7ba {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:03 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-54ecc49f-7496-4d63-924b-6fdc89e81d53 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Created reservations ['b06d266c-96c4-4f51-ae79-b8c051673d42', '0f4517b8-700d-4deb-91cd-90c4b3a97bb2', 'b8420652-9d1e-4c75-8d22-4357db472796', '925f731d-bf8a-4f05-858e-28ee6dfe83fe'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:58:03 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee.311228d1-2402-4beb-acce-1484f2edf7ba Jul 10 06:58:03 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-54ecc49f-7496-4d63-924b-6fdc89e81d53 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-54ecc49f-7496-4d63-924b-6fdc89e81d53 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:03 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-54ecc49f-7496-4d63-924b-6fdc89e81d53 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:58:03 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-54ecc49f-7496-4d63-924b-6fdc89e81d53 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:58:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-54ecc49f-7496-4d63-924b-6fdc89e81d53 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-54ecc49f-7496-4d63-924b-6fdc89e81d53 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:03 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:58:03 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:03 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6ab4142f-2150-4ec0-84ce-d5d24620b035 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Acquiring lock "cinder-02657582-42b6-409f-9a75-7da96d79f1ff-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:03 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6ab4142f-2150-4ec0-84ce-d5d24620b035 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "cinder-02657582-42b6-409f-9a75-7da96d79f1ff-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:03 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6ab4142f-2150-4ec0-84ce-d5d24620b035 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Acquiring lock "cinder-quobyte-02657582-42b6-409f-9a75-7da96d79f1ff" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:03 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6ab4142f-2150-4ec0-84ce-d5d24620b035 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "cinder-quobyte-02657582-42b6-409f-9a75-7da96d79f1ff" acquired by "delete_volume" :: waited 0.026s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:03 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6faabe-238f-4e94-ad0c-fa8b753e3b98]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:58:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6ab4142f-2150-4ec0-84ce-d5d24620b035 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-02657582-42b6-409f-9a75-7da96d79f1ff {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:03 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-02657582-42b6-409f-9a75-7da96d79f1ff Jul 10 06:58:03 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:04 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7b17e625-82c5-406f-8d58-fdc4c271c5c8 tempest-CinderUnicodeTest-636037436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee.311228d1-2402-4beb-acce-1484f2edf7ba" returned: 0 in 1.096s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:04 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-7b17e625-82c5-406f-8d58-fdc4c271c5c8 tempest-CinderUnicodeTest-636037436 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:58:04 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-54ecc49f-7496-4d63-924b-6fdc89e81d53 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.969s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:04 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-54ecc49f-7496-4d63-924b-6fdc89e81d53 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:58:04 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-54ecc49f-7496-4d63-924b-6fdc89e81d53 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Deleted volume successfully. Jul 10 06:58:04 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb9268e-f2c6-4de8-a719-91556ff36225]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:58:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7b17e625-82c5-406f-8d58-fdc4c271c5c8 tempest-CinderUnicodeTest-636037436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:04 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-54ecc49f-7496-4d63-924b-6fdc89e81d53 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "cinder-58f654d7-168f-41b1-aece-618fc2fc077e-delete_volume" released by "delete_volume" :: held 3.176s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:04 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee Jul 10 06:58:04 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:04 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6ab4142f-2150-4ec0-84ce-d5d24620b035 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-02657582-42b6-409f-9a75-7da96d79f1ff" returned: 0 in 1.126s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6ab4142f-2150-4ec0-84ce-d5d24620b035 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-02657582-42b6-409f-9a75-7da96d79f1ff {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:05 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-02657582-42b6-409f-9a75-7da96d79f1ff Jul 10 06:58:05 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:05 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7b17e625-82c5-406f-8d58-fdc4c271c5c8 tempest-CinderUnicodeTest-636037436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee" returned: 0 in 1.015s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7b17e625-82c5-406f-8d58-fdc4c271c5c8 tempest-CinderUnicodeTest-636037436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee.311228d1-2402-4beb-acce-1484f2edf7ba {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:05 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:58:05 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee.311228d1-2402-4beb-acce-1484f2edf7ba Jul 10 06:58:05 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:05 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Flow 'volume_create_manager' (2bd44928-0dfe-49a0-8d76-b1cd5c455900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:58:05 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6becb99c-7fb6-46c4-95e9-c00f523bfae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:05 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6becb99c-7fb6-46c4-95e9-c00f523bfae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63a2501b-512e-47d5-85ee-678365be094b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80e46c3b554446118943475b04243291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:58:05Z,use_quota=True,user_id='10f5d9bc10d54f99af140b2b1980b481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:05 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a610fd72-96bb-4d63-ab00-51b5a4f69d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:05 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a610fd72-96bb-4d63-ab00-51b5a4f69d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:05 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49b81a3e-bbc8-4530-a7ed-b9662eb29d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:05 devstack cinder-volume[87294]: DEBUG cinder.image.glance [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Creating Keystone auth plugin from conf {{(pid=87294) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 06:58:05 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6ab4142f-2150-4ec0-84ce-d5d24620b035 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-02657582-42b6-409f-9a75-7da96d79f1ff" returned: 0 in 0.814s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:05 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6ab4142f-2150-4ec0-84ce-d5d24620b035 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "cinder-quobyte-02657582-42b6-409f-9a75-7da96d79f1ff" released by "delete_volume" :: held 2.015s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:05 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-6ab4142f-2150-4ec0-84ce-d5d24620b035 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Created reservations ['8929ef37-ce65-4099-a02b-2fe088e2deaf', '5fe3f089-2a67-4a44-bcbb-303e6abd3b2d', 'c3d81cde-7acf-4b4e-b986-7333030817cc', '3131fe2d-ec2d-4d98-be66-94395048ccce'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:58:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-6ab4142f-2150-4ec0-84ce-d5d24620b035 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-6ab4142f-2150-4ec0-84ce-d5d24620b035 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:05 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-6ab4142f-2150-4ec0-84ce-d5d24620b035 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:58:05 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-6ab4142f-2150-4ec0-84ce-d5d24620b035 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:58:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-6ab4142f-2150-4ec0-84ce-d5d24620b035 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6ab4142f-2150-4ec0-84ce-d5d24620b035 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:06 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49b81a3e-bbc8-4530-a7ed-b9662eb29d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '63a2501b-512e-47d5-85ee-678365be094b', 'volume_name': 'volume-63a2501b-512e-47d5-85ee-678365be094b', 'volume_size': 1, 'image_id': '2250729a-9e33-42ab-84a5-a3851d54cb75', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2250729a-9e33-42ab-84a5-a3851d54cb75', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cbe5d55ba6ec4acc52174066e0115c47', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '80e46c3b554446118943475b04243291', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e7f038d637aa9aaddde91bec73968f8aaa90875b342bdc61fca7fa9027929802d3f461899413edcb6b1de93c5e36cc68b5dc1d75af311798c0951ae8ad9af035', 'id': '2250729a-9e33-42ab-84a5-a3851d54cb75', 'created_at': datetime.datetime(2026, 7, 10, 4, 58, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 58, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2250729a-9e33-42ab-84a5-a3851d54cb75/file', 'properties': {}}, 'image_service': }' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:06 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8327aead-2c9f-4cdc-9ce1-71536b612fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:06 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8327aead-2c9f-4cdc-9ce1-71536b612fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:06 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:58:06 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:06 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea704b26-917b-4b74-b77f-104d8f4c12d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:06 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Volume 63a2501b-512e-47d5-85ee-678365be094b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-63a2501b-512e-47d5-85ee-678365be094b', 'volume_size': 1, 'image_id': '2250729a-9e33-42ab-84a5-a3851d54cb75', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2250729a-9e33-42ab-84a5-a3851d54cb75', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cbe5d55ba6ec4acc52174066e0115c47', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '80e46c3b554446118943475b04243291', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e7f038d637aa9aaddde91bec73968f8aaa90875b342bdc61fca7fa9027929802d3f461899413edcb6b1de93c5e36cc68b5dc1d75af311798c0951ae8ad9af035', 'id': '2250729a-9e33-42ab-84a5-a3851d54cb75', 'created_at': datetime.datetime(2026, 7, 10, 4, 58, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 58, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2250729a-9e33-42ab-84a5-a3851d54cb75/file', 'properties': {}}, 'image_service': } Jul 10 06:58:06 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Trying to clone 63a2501b-512e-47d5-85ee-678365be094b from image 2250729a-9e33-42ab-84a5-a3851d54cb75 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2250729a-9e33-42ab-84a5-a3851d54cb75', 'metadata': {}}]). {{(pid=87294) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 06:58:06 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2250729a-9e33-42ab-84a5-a3851d54cb75_tljvhcizdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87294) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 06:58:06 devstack cinder-volume[87294]: INFO cinder.image.image_utils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Image download 0.00 MB at 0.00 MB/s Jul 10 06:58:06 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff7c9b0-8ba8-4bc6-be00-e8cbfb3e2ae3]: (4, 'raw') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:58:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2250729a-9e33-42ab-84a5-a3851d54cb75_tljvhcizdevstack@QuobyteHD {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:06 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2250729a-9e33-42ab-84a5-a3851d54cb75_tljvhcizdevstack@QuobyteHD Jul 10 06:58:06 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:06 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7b17e625-82c5-406f-8d58-fdc4c271c5c8 tempest-CinderUnicodeTest-636037436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee.311228d1-2402-4beb-acce-1484f2edf7ba" returned: 0 in 0.927s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7b17e625-82c5-406f-8d58-fdc4c271c5c8 tempest-CinderUnicodeTest-636037436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee.311228d1-2402-4beb-acce-1484f2edf7ba {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:06 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee.311228d1-2402-4beb-acce-1484f2edf7ba Jul 10 06:58:06 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:06 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6ab4142f-2150-4ec0-84ce-d5d24620b035 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.820s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:06 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-6ab4142f-2150-4ec0-84ce-d5d24620b035 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:58:06 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-6ab4142f-2150-4ec0-84ce-d5d24620b035 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Deleted volume successfully. Jul 10 06:58:06 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6ab4142f-2150-4ec0-84ce-d5d24620b035 tempest-CreateVolumesFromSourceVolumeTest-650305471 None] Lock "cinder-02657582-42b6-409f-9a75-7da96d79f1ff-delete_volume" released by "delete_volume" :: held 3.152s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:06 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2250729a-9e33-42ab-84a5-a3851d54cb75_tljvhcizdevstack@QuobyteHD" returned: 0 in 0.801s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2250729a-9e33-42ab-84a5-a3851d54cb75_tljvhcizdevstack@QuobyteHD {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:07 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7b17e625-82c5-406f-8d58-fdc4c271c5c8 tempest-CinderUnicodeTest-636037436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee.311228d1-2402-4beb-acce-1484f2edf7ba" returned: 0 in 0.773s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:07 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2250729a-9e33-42ab-84a5-a3851d54cb75_tljvhcizdevstack@QuobyteHD Jul 10 06:58:07 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:07 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7b17e625-82c5-406f-8d58-fdc4c271c5c8 tempest-CinderUnicodeTest-636037436 None] Lock "cinder-quobyte-311228d1-2402-4beb-acce-1484f2edf7ba" released by "_delete_snapshot" :: held 3.968s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:07 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7b17e625-82c5-406f-8d58-fdc4c271c5c8 tempest-CinderUnicodeTest-636037436 None] Lock "cinder-quobyte-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee" released by "delete_snapshot" :: held 4.003s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:07 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-7b17e625-82c5-406f-8d58-fdc4c271c5c8 tempest-CinderUnicodeTest-636037436 None] Created reservations ['8e0a4e47-41b3-4c4b-91af-cfe04814dc4a', '35715fb4-9a0a-4f17-9bc9-013b59f35e7c', 'd17d426e-1302-4eef-a3fe-500f8471a994', 'e966f0e4-accf-4902-b3a6-51ab5c887715'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:58:07 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-7b17e625-82c5-406f-8d58-fdc4c271c5c8 tempest-CinderUnicodeTest-636037436 None] Delete snapshot completed successfully. Jul 10 06:58:07 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7b17e625-82c5-406f-8d58-fdc4c271c5c8 tempest-CinderUnicodeTest-636037436 None] Lock "cinder-311228d1-2402-4beb-acce-1484f2edf7ba-delete_snapshot" released by "delete_snapshot" :: held 4.228s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:07 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b5ba6645-2c5e-4145-814b-5cfa762048aa tempest-CinderUnicodeTest-636037436 None] Acquiring lock "cinder-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:07 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b5ba6645-2c5e-4145-814b-5cfa762048aa tempest-CinderUnicodeTest-636037436 None] Lock "cinder-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:07 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b5ba6645-2c5e-4145-814b-5cfa762048aa tempest-CinderUnicodeTest-636037436 None] Acquiring lock "cinder-quobyte-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:07 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b5ba6645-2c5e-4145-814b-5cfa762048aa tempest-CinderUnicodeTest-636037436 None] Lock "cinder-quobyte-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee" acquired by "delete_volume" :: waited 0.028s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:07 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0696b8-cb43-4c92-924d-cfd84a2b380a]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:58:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b5ba6645-2c5e-4145-814b-5cfa762048aa tempest-CinderUnicodeTest-636037436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:07 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee Jul 10 06:58:07 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:07 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2250729a-9e33-42ab-84a5-a3851d54cb75_tljvhcizdevstack@QuobyteHD" returned: 1 in 0.905s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2250729a-9e33-42ab-84a5-a3851d54cb75_tljvhcizdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:58:07 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Temporary image 2250729a-9e33-42ab-84a5-a3851d54cb75 is fetched for user 10f5d9bc10d54f99af140b2b1980b481. {{(pid=87294) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 06:58:07 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[814b7051-80e3-446e-963b-f45ab707936a]: (4, 'raw') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:58:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2250729a-9e33-42ab-84a5-a3851d54cb75_tljvhcizdevstack@QuobyteHD {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:08 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2250729a-9e33-42ab-84a5-a3851d54cb75_tljvhcizdevstack@QuobyteHD Jul 10 06:58:08 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:08 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b5ba6645-2c5e-4145-814b-5cfa762048aa tempest-CinderUnicodeTest-636037436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee" returned: 0 in 0.876s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b5ba6645-2c5e-4145-814b-5cfa762048aa tempest-CinderUnicodeTest-636037436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:08 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee Jul 10 06:58:08 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:08 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2250729a-9e33-42ab-84a5-a3851d54cb75_tljvhcizdevstack@QuobyteHD" returned: 0 in 0.984s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2250729a-9e33-42ab-84a5-a3851d54cb75_tljvhcizdevstack@QuobyteHD {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:09 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2250729a-9e33-42ab-84a5-a3851d54cb75_tljvhcizdevstack@QuobyteHD Jul 10 06:58:09 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:09 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b5ba6645-2c5e-4145-814b-5cfa762048aa tempest-CinderUnicodeTest-636037436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee" returned: 0 in 0.814s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:09 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b5ba6645-2c5e-4145-814b-5cfa762048aa tempest-CinderUnicodeTest-636037436 None] Lock "cinder-quobyte-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee" released by "delete_volume" :: held 1.790s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:09 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-b5ba6645-2c5e-4145-814b-5cfa762048aa tempest-CinderUnicodeTest-636037436 None] Created reservations ['608a0452-b1ea-4d05-a22d-8cbbf5bb7185', '91fe1673-86f8-4db4-be03-b2aa4d12c591', '6dc8349b-eb47-40e6-bf9b-3c7379fde83d', '7c14fe83-142f-4a5b-9386-163acb22f5ef'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:58:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b5ba6645-2c5e-4145-814b-5cfa762048aa tempest-CinderUnicodeTest-636037436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b5ba6645-2c5e-4145-814b-5cfa762048aa tempest-CinderUnicodeTest-636037436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:09 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b5ba6645-2c5e-4145-814b-5cfa762048aa tempest-CinderUnicodeTest-636037436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:58:09 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-b5ba6645-2c5e-4145-814b-5cfa762048aa tempest-CinderUnicodeTest-636037436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:58:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-b5ba6645-2c5e-4145-814b-5cfa762048aa tempest-CinderUnicodeTest-636037436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b5ba6645-2c5e-4145-814b-5cfa762048aa tempest-CinderUnicodeTest-636037436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:09 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:58:09 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:09 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2250729a-9e33-42ab-84a5-a3851d54cb75_tljvhcizdevstack@QuobyteHD" returned: 1 in 0.892s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2250729a-9e33-42ab-84a5-a3851d54cb75_tljvhcizdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:58:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:09 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63a2501b-512e-47d5-85ee-678365be094b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80e46c3b554446118943475b04243291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:58:05Z,use_quota=True,user_id='10f5d9bc10d54f99af140b2b1980b481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:58:09 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Creating volume 63a2501b-512e-47d5-85ee-678365be094b {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:58:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:09 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:58:09 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:58:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:09 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:58:09 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:58:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-63a2501b-512e-47d5-85ee-678365be094b 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:09 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7a992270-9c94-48dd-be2a-4b7991e4c8a3 tempest-CinderUnicodeTest-636037436 None] Acquiring lock "cinder-e937ba51-88ac-4368-8c63-53a858646253-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:09 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-63a2501b-512e-47d5-85ee-678365be094b 1073741824 Jul 10 06:58:09 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:09 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7a992270-9c94-48dd-be2a-4b7991e4c8a3 tempest-CinderUnicodeTest-636037436 None] Lock "cinder-e937ba51-88ac-4368-8c63-53a858646253-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:10 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7a992270-9c94-48dd-be2a-4b7991e4c8a3 tempest-CinderUnicodeTest-636037436 None] Acquiring lock "cinder-quobyte-e937ba51-88ac-4368-8c63-53a858646253" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:10 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7a992270-9c94-48dd-be2a-4b7991e4c8a3 tempest-CinderUnicodeTest-636037436 None] Lock "cinder-quobyte-e937ba51-88ac-4368-8c63-53a858646253" acquired by "delete_volume" :: waited 0.033s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:10 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[f903f851-be19-4d5d-917c-62c913516107]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:58:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7a992270-9c94-48dd-be2a-4b7991e4c8a3 tempest-CinderUnicodeTest-636037436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e937ba51-88ac-4368-8c63-53a858646253 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:10 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e937ba51-88ac-4368-8c63-53a858646253 Jul 10 06:58:10 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:10 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b5ba6645-2c5e-4145-814b-5cfa762048aa tempest-CinderUnicodeTest-636037436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.986s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:10 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-b5ba6645-2c5e-4145-814b-5cfa762048aa tempest-CinderUnicodeTest-636037436 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:58:10 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-b5ba6645-2c5e-4145-814b-5cfa762048aa tempest-CinderUnicodeTest-636037436 None] Deleted volume successfully. Jul 10 06:58:10 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b5ba6645-2c5e-4145-814b-5cfa762048aa tempest-CinderUnicodeTest-636037436 None] Lock "cinder-eb00d3de-1d61-4cfe-8150-9d8ae9a381ee-delete_volume" released by "delete_volume" :: held 3.104s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:10 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-63a2501b-512e-47d5-85ee-678365be094b 1073741824" returned: 0 in 1.079s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-63a2501b-512e-47d5-85ee-678365be094b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:11 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-63a2501b-512e-47d5-85ee-678365be094b Jul 10 06:58:11 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:11 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7a992270-9c94-48dd-be2a-4b7991e4c8a3 tempest-CinderUnicodeTest-636037436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e937ba51-88ac-4368-8c63-53a858646253" returned: 0 in 1.077s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7a992270-9c94-48dd-be2a-4b7991e4c8a3 tempest-CinderUnicodeTest-636037436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e937ba51-88ac-4368-8c63-53a858646253 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:11 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e937ba51-88ac-4368-8c63-53a858646253 Jul 10 06:58:11 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:11 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-63a2501b-512e-47d5-85ee-678365be094b" returned: 0 in 0.866s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:11 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] <== create_volume: return (1999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:58:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:11 devstack cinder-volume[87294]: DEBUG cinder.volume.volume_utils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Attempting download of 2250729a-9e33-42ab-84a5-a3851d54cb75 ((None, [{'url': 'file:///opt/stack/data/glance/images/2250729a-9e33-42ab-84a5-a3851d54cb75', 'metadata': {}}])) to volume 63a2501b-512e-47d5-85ee-678365be094b. {{(pid=87294) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 06:58:11 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf6cfe6-e0e8-4b8e-86cb-e277ce2bd84f]: (4, 'raw') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:58:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2250729a-9e33-42ab-84a5-a3851d54cb75_q7vpibm3 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:12 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7a992270-9c94-48dd-be2a-4b7991e4c8a3 tempest-CinderUnicodeTest-636037436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e937ba51-88ac-4368-8c63-53a858646253" returned: 0 in 0.852s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:12 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7a992270-9c94-48dd-be2a-4b7991e4c8a3 tempest-CinderUnicodeTest-636037436 None] Lock "cinder-quobyte-e937ba51-88ac-4368-8c63-53a858646253" released by "delete_volume" :: held 1.999s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:12 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2250729a-9e33-42ab-84a5-a3851d54cb75_q7vpibm3 Jul 10 06:58:12 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:12 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-7a992270-9c94-48dd-be2a-4b7991e4c8a3 tempest-CinderUnicodeTest-636037436 None] Created reservations ['1df7a397-9a54-469b-b062-fcfdc58d6aa7', 'e1efc6a0-f39e-44c7-95ac-cf1bfe8068d4', '95ceba77-7977-46de-bb8f-8cd365906624', '4e2d1eeb-578b-4475-b674-a40bb7e3ddab'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:58:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7a992270-9c94-48dd-be2a-4b7991e4c8a3 tempest-CinderUnicodeTest-636037436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7a992270-9c94-48dd-be2a-4b7991e4c8a3 tempest-CinderUnicodeTest-636037436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:12 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-7a992270-9c94-48dd-be2a-4b7991e4c8a3 tempest-CinderUnicodeTest-636037436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:58:12 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-7a992270-9c94-48dd-be2a-4b7991e4c8a3 tempest-CinderUnicodeTest-636037436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:58:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7a992270-9c94-48dd-be2a-4b7991e4c8a3 tempest-CinderUnicodeTest-636037436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7a992270-9c94-48dd-be2a-4b7991e4c8a3 tempest-CinderUnicodeTest-636037436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:12 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:58:12 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:12 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2250729a-9e33-42ab-84a5-a3851d54cb75_q7vpibm3" returned: 0 in 0.845s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2250729a-9e33-42ab-84a5-a3851d54cb75_q7vpibm3 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:12 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2250729a-9e33-42ab-84a5-a3851d54cb75_q7vpibm3 Jul 10 06:58:12 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:13 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7a992270-9c94-48dd-be2a-4b7991e4c8a3 tempest-CinderUnicodeTest-636037436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.803s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:13 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-7a992270-9c94-48dd-be2a-4b7991e4c8a3 tempest-CinderUnicodeTest-636037436 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:58:13 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-7a992270-9c94-48dd-be2a-4b7991e4c8a3 tempest-CinderUnicodeTest-636037436 None] Deleted volume successfully. Jul 10 06:58:13 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-7a992270-9c94-48dd-be2a-4b7991e4c8a3 tempest-CinderUnicodeTest-636037436 None] Lock "cinder-e937ba51-88ac-4368-8c63-53a858646253-delete_volume" released by "delete_volume" :: held 3.118s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:13 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2250729a-9e33-42ab-84a5-a3851d54cb75_q7vpibm3" returned: 1 in 0.983s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2250729a-9e33-42ab-84a5-a3851d54cb75_q7vpibm3' failed. Not Retrying. {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:58:13 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[840f71fa-a830-4012-aaf7-85c138e67bfe]: (4, 'raw') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:58:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2250729a-9e33-42ab-84a5-a3851d54cb75_tljvhcizdevstack@QuobyteHD {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:13 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2250729a-9e33-42ab-84a5-a3851d54cb75_tljvhcizdevstack@QuobyteHD Jul 10 06:58:13 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:14 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2250729a-9e33-42ab-84a5-a3851d54cb75_tljvhcizdevstack@QuobyteHD" returned: 0 in 0.810s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2250729a-9e33-42ab-84a5-a3851d54cb75_tljvhcizdevstack@QuobyteHD {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:14 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2250729a-9e33-42ab-84a5-a3851d54cb75_tljvhcizdevstack@QuobyteHD Jul 10 06:58:14 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:15 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2250729a-9e33-42ab-84a5-a3851d54cb75_tljvhcizdevstack@QuobyteHD" returned: 1 in 0.824s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2250729a-9e33-42ab-84a5-a3851d54cb75_tljvhcizdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:58:15 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] 2250729a-9e33-42ab-84a5-a3851d54cb75 was raw, converting to raw {{(pid=87294) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 06:58:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2250729a-9e33-42ab-84a5-a3851d54cb75_tljvhcizdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-63a2501b-512e-47d5-85ee-678365be094b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:15 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2250729a-9e33-42ab-84a5-a3851d54cb75_tljvhcizdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-63a2501b-512e-47d5-85ee-678365be094b Jul 10 06:58:15 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:16 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2250729a-9e33-42ab-84a5-a3851d54cb75_tljvhcizdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-63a2501b-512e-47d5-85ee-678365be094b" returned: 0 in 0.940s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:16 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2250729a-9e33-42ab-84a5-a3851d54cb75_tljvhcizdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-63a2501b-512e-47d5-85ee-678365be094b {{(pid=87294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 06:58:16 devstack cinder-volume[87294]: INFO cinder.image.image_utils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 06:58:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-63a2501b-512e-47d5-85ee-678365be094b 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:16 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-63a2501b-512e-47d5-85ee-678365be094b 1G Jul 10 06:58:16 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:17 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-63a2501b-512e-47d5-85ee-678365be094b 1G" returned: 0 in 0.837s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:17 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc1ad3c-5124-49be-8dde-79ab0d488af1]: (4, 'raw') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:58:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-63a2501b-512e-47d5-85ee-678365be094b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:17 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-63a2501b-512e-47d5-85ee-678365be094b Jul 10 06:58:17 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:17 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-17b690d6-19c2-4607-ba08-4c53e9b062bd tempest-ProjectAdminTests-1460715618 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577095031738, 'free_capacity_gb': 1775.7577095031738, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87294) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 10 06:58:18 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-63a2501b-512e-47d5-85ee-678365be094b" returned: 0 in 1.037s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-63a2501b-512e-47d5-85ee-678365be094b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:18 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-63a2501b-512e-47d5-85ee-678365be094b Jul 10 06:58:18 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:19 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-63a2501b-512e-47d5-85ee-678365be094b" returned: 1 in 1.011s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-63a2501b-512e-47d5-85ee-678365be094b' failed. Not Retrying. {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:58:19 devstack cinder-volume[87294]: DEBUG cinder.volume.volume_utils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Downloaded image 2250729a-9e33-42ab-84a5-a3851d54cb75 ((None, [{'url': 'file:///opt/stack/data/glance/images/2250729a-9e33-42ab-84a5-a3851d54cb75', 'metadata': {}}])) to volume 63a2501b-512e-47d5-85ee-678365be094b successfully. {{(pid=87294) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 06:58:19 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Temporary image 2250729a-9e33-42ab-84a5-a3851d54cb75 for user 10f5d9bc10d54f99af140b2b1980b481 is deleted. {{(pid=87294) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 06:58:19 devstack cinder-volume[87294]: DEBUG cinder.volume.volume_utils [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Marking volume 63a2501b-512e-47d5-85ee-678365be094b as bootable. {{(pid=87294) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 06:58:19 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Copying metadata from image 2250729a-9e33-42ab-84a5-a3851d54cb75 to 63a2501b-512e-47d5-85ee-678365be094b. {{(pid=87294) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 06:58:19 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Creating volume glance metadata for volume 63a2501b-512e-47d5-85ee-678365be094b backed by image 2250729a-9e33-42ab-84a5-a3851d54cb75 with: {'image_id': '2250729a-9e33-42ab-84a5-a3851d54cb75', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'cbe5d55ba6ec4acc52174066e0115c47', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87294) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 06:58:19 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea704b26-917b-4b74-b77f-104d8f4c12d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63a2501b-512e-47d5-85ee-678365be094b', 'volume_size': 1, 'image_id': '2250729a-9e33-42ab-84a5-a3851d54cb75', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2250729a-9e33-42ab-84a5-a3851d54cb75', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cbe5d55ba6ec4acc52174066e0115c47', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '80e46c3b554446118943475b04243291', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e7f038d637aa9aaddde91bec73968f8aaa90875b342bdc61fca7fa9027929802d3f461899413edcb6b1de93c5e36cc68b5dc1d75af311798c0951ae8ad9af035', 'id': '2250729a-9e33-42ab-84a5-a3851d54cb75', 'created_at': datetime.datetime(2026, 7, 10, 4, 58, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 4, 58, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2250729a-9e33-42ab-84a5-a3851d54cb75/file', 'properties': {}}, 'image_service': }' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:19 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd5de2e0-c1d6-4340-8296-6d62fce480fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:19 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Volume volume-63a2501b-512e-47d5-85ee-678365be094b (63a2501b-512e-47d5-85ee-678365be094b): created successfully Jul 10 06:58:19 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd5de2e0-c1d6-4340-8296-6d62fce480fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:19 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Flow 'volume_create_manager' (2bd44928-0dfe-49a0-8d76-b1cd5c455900) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:58:19 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-f1593b79-5c75-4a86-a3ee-655fb22f451b tempest-VolumeImageDependencyTests-1463533245 None] Created volume successfully. Jul 10 06:58:19 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d1ed74af-90fe-4242-af01-dae659e1f3f5 tempest-VolumeImageDependencyTests-1463533245 None] Acquiring lock "cinder-63a2501b-512e-47d5-85ee-678365be094b-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:19 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d1ed74af-90fe-4242-af01-dae659e1f3f5 tempest-VolumeImageDependencyTests-1463533245 None] Lock "cinder-63a2501b-512e-47d5-85ee-678365be094b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:19 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d1ed74af-90fe-4242-af01-dae659e1f3f5 tempest-VolumeImageDependencyTests-1463533245 None] Acquiring lock "cinder-quobyte-63a2501b-512e-47d5-85ee-678365be094b" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:19 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d1ed74af-90fe-4242-af01-dae659e1f3f5 tempest-VolumeImageDependencyTests-1463533245 None] Lock "cinder-quobyte-63a2501b-512e-47d5-85ee-678365be094b" acquired by "delete_volume" :: waited 0.022s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:19 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e22df58-8b54-4ae5-a838-7fd3f8d1d5f2]: (4, 'raw') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:58:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d1ed74af-90fe-4242-af01-dae659e1f3f5 tempest-VolumeImageDependencyTests-1463533245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-63a2501b-512e-47d5-85ee-678365be094b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:20 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-63a2501b-512e-47d5-85ee-678365be094b Jul 10 06:58:20 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:20 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d1ed74af-90fe-4242-af01-dae659e1f3f5 tempest-VolumeImageDependencyTests-1463533245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-63a2501b-512e-47d5-85ee-678365be094b" returned: 0 in 1.012s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d1ed74af-90fe-4242-af01-dae659e1f3f5 tempest-VolumeImageDependencyTests-1463533245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-63a2501b-512e-47d5-85ee-678365be094b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:21 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-63a2501b-512e-47d5-85ee-678365be094b Jul 10 06:58:21 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:21 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d1ed74af-90fe-4242-af01-dae659e1f3f5 tempest-VolumeImageDependencyTests-1463533245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-63a2501b-512e-47d5-85ee-678365be094b" returned: 1 in 0.901s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d1ed74af-90fe-4242-af01-dae659e1f3f5 tempest-VolumeImageDependencyTests-1463533245 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-63a2501b-512e-47d5-85ee-678365be094b' failed. Not Retrying. {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 06:58:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d1ed74af-90fe-4242-af01-dae659e1f3f5 tempest-VolumeImageDependencyTests-1463533245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-63a2501b-512e-47d5-85ee-678365be094b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:21 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-63a2501b-512e-47d5-85ee-678365be094b Jul 10 06:58:21 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:21 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:58:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:58:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:58:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:22 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:58:22 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:22 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.830s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:22 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:58:22 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager._thread_info {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:58:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread count: 28 {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:58:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread info: [<_MainThread(MainThread, started 139245706264704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:58:22 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d1ed74af-90fe-4242-af01-dae659e1f3f5 tempest-VolumeImageDependencyTests-1463533245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-63a2501b-512e-47d5-85ee-678365be094b" returned: 0 in 1.137s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:22 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d1ed74af-90fe-4242-af01-dae659e1f3f5 tempest-VolumeImageDependencyTests-1463533245 None] Lock "cinder-quobyte-63a2501b-512e-47d5-85ee-678365be094b" released by "delete_volume" :: held 3.136s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:23 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-d1ed74af-90fe-4242-af01-dae659e1f3f5 tempest-VolumeImageDependencyTests-1463533245 None] Created reservations ['f3f7a55c-c259-4b49-afec-f8e8778d6723', 'a90268b2-3615-406b-b361-e477d23a8197', 'a6bcb285-c5ab-4261-ba2f-35d977d21759', '6ff55a9b-2503-4d26-a272-ca0d0cbf9c60'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:58:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d1ed74af-90fe-4242-af01-dae659e1f3f5 tempest-VolumeImageDependencyTests-1463533245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d1ed74af-90fe-4242-af01-dae659e1f3f5 tempest-VolumeImageDependencyTests-1463533245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:23 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-d1ed74af-90fe-4242-af01-dae659e1f3f5 tempest-VolumeImageDependencyTests-1463533245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:58:23 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-d1ed74af-90fe-4242-af01-dae659e1f3f5 tempest-VolumeImageDependencyTests-1463533245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:58:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d1ed74af-90fe-4242-af01-dae659e1f3f5 tempest-VolumeImageDependencyTests-1463533245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d1ed74af-90fe-4242-af01-dae659e1f3f5 tempest-VolumeImageDependencyTests-1463533245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:23 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:58:23 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:23 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d1ed74af-90fe-4242-af01-dae659e1f3f5 tempest-VolumeImageDependencyTests-1463533245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.740s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:23 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-d1ed74af-90fe-4242-af01-dae659e1f3f5 tempest-VolumeImageDependencyTests-1463533245 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:58:24 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-d1ed74af-90fe-4242-af01-dae659e1f3f5 tempest-VolumeImageDependencyTests-1463533245 None] Deleted volume successfully. Jul 10 06:58:24 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-d1ed74af-90fe-4242-af01-dae659e1f3f5 tempest-VolumeImageDependencyTests-1463533245 None] Lock "cinder-63a2501b-512e-47d5-85ee-678365be094b-delete_volume" released by "delete_volume" :: held 4.299s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:24 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-47897b5b-a402-4656-87ba-4847c594b783 tempest-ProjectReaderTests-1842964388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:58:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-47897b5b-a402-4656-87ba-4847c594b783 tempest-ProjectReaderTests-1842964388 None] Flow 'volume_create_manager' (bd8fc6e8-e627-4d3f-bd7d-792eef054924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:58:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-47897b5b-a402-4656-87ba-4847c594b783 tempest-ProjectReaderTests-1842964388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbdeed8e-3192-479e-b916-9bcfa7f42960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-47897b5b-a402-4656-87ba-4847c594b783 tempest-ProjectReaderTests-1842964388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbdeed8e-3192-479e-b916-9bcfa7f42960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:58:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-592100272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b5a6dcb-f1d2-4283-9b3d-977758802a6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7edba59ec544ef19403306586f4dc37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:58:25Z,use_quota=True,user_id='22a4130618e148c084c2754183b492f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-47897b5b-a402-4656-87ba-4847c594b783 tempest-ProjectReaderTests-1842964388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b73da1e-8893-4f16-9a87-0505a48002ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-47897b5b-a402-4656-87ba-4847c594b783 tempest-ProjectReaderTests-1842964388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b73da1e-8893-4f16-9a87-0505a48002ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-47897b5b-a402-4656-87ba-4847c594b783 tempest-ProjectReaderTests-1842964388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6790c256-e7b5-44e1-a088-f7ad95c17481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-47897b5b-a402-4656-87ba-4847c594b783 tempest-ProjectReaderTests-1842964388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6790c256-e7b5-44e1-a088-f7ad95c17481) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b5a6dcb-f1d2-4283-9b3d-977758802a6c', 'volume_name': 'volume-2b5a6dcb-f1d2-4283-9b3d-977758802a6c', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-47897b5b-a402-4656-87ba-4847c594b783 tempest-ProjectReaderTests-1842964388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51e96ead-6f59-4d6b-a35f-be9495babee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-47897b5b-a402-4656-87ba-4847c594b783 tempest-ProjectReaderTests-1842964388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51e96ead-6f59-4d6b-a35f-be9495babee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:24 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-47897b5b-a402-4656-87ba-4847c594b783 tempest-ProjectReaderTests-1842964388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fab8e3e-5049-486b-b8ce-a357f615297e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:24 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-47897b5b-a402-4656-87ba-4847c594b783 tempest-ProjectReaderTests-1842964388 None] Volume 2b5a6dcb-f1d2-4283-9b3d-977758802a6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b5a6dcb-f1d2-4283-9b3d-977758802a6c', 'volume_size': 1} Jul 10 06:58:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-47897b5b-a402-4656-87ba-4847c594b783 tempest-ProjectReaderTests-1842964388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-47897b5b-a402-4656-87ba-4847c594b783 tempest-ProjectReaderTests-1842964388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:24 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-47897b5b-a402-4656-87ba-4847c594b783 tempest-ProjectReaderTests-1842964388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:58:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-592100272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b5a6dcb-f1d2-4283-9b3d-977758802a6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7edba59ec544ef19403306586f4dc37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:58:25Z,use_quota=True,user_id='22a4130618e148c084c2754183b492f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:58:24 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-47897b5b-a402-4656-87ba-4847c594b783 tempest-ProjectReaderTests-1842964388 None] Creating volume 2b5a6dcb-f1d2-4283-9b3d-977758802a6c {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:58:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-47897b5b-a402-4656-87ba-4847c594b783 tempest-ProjectReaderTests-1842964388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-47897b5b-a402-4656-87ba-4847c594b783 tempest-ProjectReaderTests-1842964388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:24 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-47897b5b-a402-4656-87ba-4847c594b783 tempest-ProjectReaderTests-1842964388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:58:24 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-47897b5b-a402-4656-87ba-4847c594b783 tempest-ProjectReaderTests-1842964388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:58:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-47897b5b-a402-4656-87ba-4847c594b783 tempest-ProjectReaderTests-1842964388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:24 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-47897b5b-a402-4656-87ba-4847c594b783 tempest-ProjectReaderTests-1842964388 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:58:24 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-47897b5b-a402-4656-87ba-4847c594b783 tempest-ProjectReaderTests-1842964388 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:58:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-47897b5b-a402-4656-87ba-4847c594b783 tempest-ProjectReaderTests-1842964388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b5a6dcb-f1d2-4283-9b3d-977758802a6c 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:24 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b5a6dcb-f1d2-4283-9b3d-977758802a6c 1073741824 Jul 10 06:58:24 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:25 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-19458253-7505-49a8-8862-c6fa0a34bd96 tempest-ProjectMemberTests-1458770269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:58:25 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-19458253-7505-49a8-8862-c6fa0a34bd96 tempest-ProjectMemberTests-1458770269 None] Flow 'volume_create_manager' (bc201b65-2230-400e-b23f-f36bf0340856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:58:25 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-19458253-7505-49a8-8862-c6fa0a34bd96 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17320196-1374-432e-a473-d56801ef5a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:25 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-19458253-7505-49a8-8862-c6fa0a34bd96 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17320196-1374-432e-a473-d56801ef5a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1815898241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74eaa648-a59d-4418-b534-c37bae5a1894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='215e832b6dbe42b49605af7a497c8dda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:58:25Z,use_quota=True,user_id='b5b28624cb0741588f7cc21f3c76f8e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:25 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-19458253-7505-49a8-8862-c6fa0a34bd96 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5513c9bd-e23d-4578-b044-1059a1ef5310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:25 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-19458253-7505-49a8-8862-c6fa0a34bd96 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5513c9bd-e23d-4578-b044-1059a1ef5310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:25 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-19458253-7505-49a8-8862-c6fa0a34bd96 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0bad50a-60a3-4a88-9b21-ba25e7abf289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:25 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-19458253-7505-49a8-8862-c6fa0a34bd96 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0bad50a-60a3-4a88-9b21-ba25e7abf289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74eaa648-a59d-4418-b534-c37bae5a1894', 'volume_name': 'volume-74eaa648-a59d-4418-b534-c37bae5a1894', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:25 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-19458253-7505-49a8-8862-c6fa0a34bd96 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28dc5c54-84c3-48a6-9db6-6f8705d1bbc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:25 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-19458253-7505-49a8-8862-c6fa0a34bd96 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28dc5c54-84c3-48a6-9db6-6f8705d1bbc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:25 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-19458253-7505-49a8-8862-c6fa0a34bd96 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56e7f812-cde9-4947-b0f8-46275272f4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:25 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-19458253-7505-49a8-8862-c6fa0a34bd96 tempest-ProjectMemberTests-1458770269 None] Volume 74eaa648-a59d-4418-b534-c37bae5a1894: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74eaa648-a59d-4418-b534-c37bae5a1894', 'volume_size': 1} Jul 10 06:58:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-19458253-7505-49a8-8862-c6fa0a34bd96 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:26 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-47897b5b-a402-4656-87ba-4847c594b783 tempest-ProjectReaderTests-1842964388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b5a6dcb-f1d2-4283-9b3d-977758802a6c 1073741824" returned: 0 in 1.244s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-47897b5b-a402-4656-87ba-4847c594b783 tempest-ProjectReaderTests-1842964388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b5a6dcb-f1d2-4283-9b3d-977758802a6c {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:26 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b5a6dcb-f1d2-4283-9b3d-977758802a6c Jul 10 06:58:26 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:26 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-47897b5b-a402-4656-87ba-4847c594b783 tempest-ProjectReaderTests-1842964388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b5a6dcb-f1d2-4283-9b3d-977758802a6c" returned: 0 in 0.763s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:26 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-47897b5b-a402-4656-87ba-4847c594b783 tempest-ProjectReaderTests-1842964388 None] <== create_volume: return (2072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:58:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-47897b5b-a402-4656-87ba-4847c594b783 tempest-ProjectReaderTests-1842964388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.075s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-19458253-7505-49a8-8862-c6fa0a34bd96 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.655s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:26 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-19458253-7505-49a8-8862-c6fa0a34bd96 tempest-ProjectMemberTests-1458770269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1815898241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74eaa648-a59d-4418-b534-c37bae5a1894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='215e832b6dbe42b49605af7a497c8dda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:58:25Z,use_quota=True,user_id='b5b28624cb0741588f7cc21f3c76f8e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:58:26 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-19458253-7505-49a8-8862-c6fa0a34bd96 tempest-ProjectMemberTests-1458770269 None] Creating volume 74eaa648-a59d-4418-b534-c37bae5a1894 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:58:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-19458253-7505-49a8-8862-c6fa0a34bd96 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-19458253-7505-49a8-8862-c6fa0a34bd96 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:26 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-19458253-7505-49a8-8862-c6fa0a34bd96 tempest-ProjectMemberTests-1458770269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:58:26 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-19458253-7505-49a8-8862-c6fa0a34bd96 tempest-ProjectMemberTests-1458770269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:58:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-19458253-7505-49a8-8862-c6fa0a34bd96 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:26 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-19458253-7505-49a8-8862-c6fa0a34bd96 tempest-ProjectMemberTests-1458770269 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:58:26 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-19458253-7505-49a8-8862-c6fa0a34bd96 tempest-ProjectMemberTests-1458770269 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:58:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-19458253-7505-49a8-8862-c6fa0a34bd96 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-47897b5b-a402-4656-87ba-4847c594b783 tempest-ProjectReaderTests-1842964388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fab8e3e-5049-486b-b8ce-a357f615297e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b5a6dcb-f1d2-4283-9b3d-977758802a6c', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:26 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894 1073741824 Jul 10 06:58:26 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-47897b5b-a402-4656-87ba-4847c594b783 tempest-ProjectReaderTests-1842964388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93dd2cd3-299c-482f-b8b4-295212def009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:26 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:27 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-47897b5b-a402-4656-87ba-4847c594b783 tempest-ProjectReaderTests-1842964388 None] Volume volume-2b5a6dcb-f1d2-4283-9b3d-977758802a6c (2b5a6dcb-f1d2-4283-9b3d-977758802a6c): created successfully Jul 10 06:58:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-47897b5b-a402-4656-87ba-4847c594b783 tempest-ProjectReaderTests-1842964388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93dd2cd3-299c-482f-b8b4-295212def009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-47897b5b-a402-4656-87ba-4847c594b783 tempest-ProjectReaderTests-1842964388 None] Flow 'volume_create_manager' (bd8fc6e8-e627-4d3f-bd7d-792eef054924) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:58:27 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-47897b5b-a402-4656-87ba-4847c594b783 tempest-ProjectReaderTests-1842964388 None] Created volume successfully. Jul 10 06:58:27 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-19458253-7505-49a8-8862-c6fa0a34bd96 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894 1073741824" returned: 0 in 1.013s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-19458253-7505-49a8-8862-c6fa0a34bd96 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:28 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894 Jul 10 06:58:28 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:28 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-324ca6cd-4aa9-4e1d-8989-3a372e80b289 tempest-ProjectReaderTests-1842964388 None] Acquiring lock "cinder-2b5a6dcb-f1d2-4283-9b3d-977758802a6c-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:28 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-324ca6cd-4aa9-4e1d-8989-3a372e80b289 tempest-ProjectReaderTests-1842964388 None] Lock "cinder-2b5a6dcb-f1d2-4283-9b3d-977758802a6c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:28 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-324ca6cd-4aa9-4e1d-8989-3a372e80b289 tempest-ProjectReaderTests-1842964388 None] Acquiring lock "cinder-quobyte-2b5a6dcb-f1d2-4283-9b3d-977758802a6c" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:28 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-324ca6cd-4aa9-4e1d-8989-3a372e80b289 tempest-ProjectReaderTests-1842964388 None] Lock "cinder-quobyte-2b5a6dcb-f1d2-4283-9b3d-977758802a6c" acquired by "delete_volume" :: waited 0.022s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:28 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[871052c7-9bdd-479e-ac87-b9d0ae10ef9d]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:58:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-324ca6cd-4aa9-4e1d-8989-3a372e80b289 tempest-ProjectReaderTests-1842964388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b5a6dcb-f1d2-4283-9b3d-977758802a6c {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:28 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b5a6dcb-f1d2-4283-9b3d-977758802a6c Jul 10 06:58:28 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:28 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-19458253-7505-49a8-8862-c6fa0a34bd96 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894" returned: 0 in 0.985s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:28 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-19458253-7505-49a8-8862-c6fa0a34bd96 tempest-ProjectMemberTests-1458770269 None] <== create_volume: return (2065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:58:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-19458253-7505-49a8-8862-c6fa0a34bd96 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.069s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:29 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-19458253-7505-49a8-8862-c6fa0a34bd96 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56e7f812-cde9-4947-b0f8-46275272f4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74eaa648-a59d-4418-b534-c37bae5a1894', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:29 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-19458253-7505-49a8-8862-c6fa0a34bd96 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (796d5310-06bb-4d4b-9699-74ecbb1bdfb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:29 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-19458253-7505-49a8-8862-c6fa0a34bd96 tempest-ProjectMemberTests-1458770269 None] Volume volume-74eaa648-a59d-4418-b534-c37bae5a1894 (74eaa648-a59d-4418-b534-c37bae5a1894): created successfully Jul 10 06:58:29 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-19458253-7505-49a8-8862-c6fa0a34bd96 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (796d5310-06bb-4d4b-9699-74ecbb1bdfb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:29 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-19458253-7505-49a8-8862-c6fa0a34bd96 tempest-ProjectMemberTests-1458770269 None] Flow 'volume_create_manager' (bc201b65-2230-400e-b23f-f36bf0340856) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:58:29 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-19458253-7505-49a8-8862-c6fa0a34bd96 tempest-ProjectMemberTests-1458770269 None] Created volume successfully. Jul 10 06:58:29 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-324ca6cd-4aa9-4e1d-8989-3a372e80b289 tempest-ProjectReaderTests-1842964388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b5a6dcb-f1d2-4283-9b3d-977758802a6c" returned: 0 in 0.935s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-324ca6cd-4aa9-4e1d-8989-3a372e80b289 tempest-ProjectReaderTests-1842964388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b5a6dcb-f1d2-4283-9b3d-977758802a6c {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:29 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b5a6dcb-f1d2-4283-9b3d-977758802a6c Jul 10 06:58:29 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-1a92c39a-03d7-4b7a-9866-be052380eadf tempest-ProjectMemberTests-1458770269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-1a92c39a-03d7-4b7a-9866-be052380eadf tempest-ProjectMemberTests-1458770269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:29 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-1a92c39a-03d7-4b7a-9866-be052380eadf tempest-ProjectMemberTests-1458770269 None] Creating offline snapshot a9e1f24e-666a-4f94-b9b9-a87f6036414d of volume 74eaa648-a59d-4418-b534-c37bae5a1894 {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:58:29 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[784f3590-6d27-4048-85e9-311535302b59]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:58:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1a92c39a-03d7-4b7a-9866-be052380eadf tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:30 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894 Jul 10 06:58:30 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:30 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-324ca6cd-4aa9-4e1d-8989-3a372e80b289 tempest-ProjectReaderTests-1842964388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2b5a6dcb-f1d2-4283-9b3d-977758802a6c" returned: 0 in 0.948s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:30 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-324ca6cd-4aa9-4e1d-8989-3a372e80b289 tempest-ProjectReaderTests-1842964388 None] Lock "cinder-quobyte-2b5a6dcb-f1d2-4283-9b3d-977758802a6c" released by "delete_volume" :: held 1.961s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:30 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-324ca6cd-4aa9-4e1d-8989-3a372e80b289 tempest-ProjectReaderTests-1842964388 None] Created reservations ['c53a467c-9346-404b-aee9-2ca5426e3707', '6f741117-b4e4-4653-89aa-ef5f1420388e', '262d93a3-aa3e-4713-add4-ee01ed4632c2', '5864be47-d5c6-413e-bf8d-c3ef584fc74e'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:58:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-324ca6cd-4aa9-4e1d-8989-3a372e80b289 tempest-ProjectReaderTests-1842964388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-324ca6cd-4aa9-4e1d-8989-3a372e80b289 tempest-ProjectReaderTests-1842964388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:30 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-324ca6cd-4aa9-4e1d-8989-3a372e80b289 tempest-ProjectReaderTests-1842964388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:58:30 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-324ca6cd-4aa9-4e1d-8989-3a372e80b289 tempest-ProjectReaderTests-1842964388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:58:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-324ca6cd-4aa9-4e1d-8989-3a372e80b289 tempest-ProjectReaderTests-1842964388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-324ca6cd-4aa9-4e1d-8989-3a372e80b289 tempest-ProjectReaderTests-1842964388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:30 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:58:30 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:31 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1a92c39a-03d7-4b7a-9866-be052380eadf tempest-ProjectMemberTests-1458770269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894" returned: 0 in 1.303s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1a92c39a-03d7-4b7a-9866-be052380eadf tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894.a9e1f24e-666a-4f94-b9b9-a87f6036414d 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:31 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894.a9e1f24e-666a-4f94-b9b9-a87f6036414d 1G Jul 10 06:58:31 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:31 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-324ca6cd-4aa9-4e1d-8989-3a372e80b289 tempest-ProjectReaderTests-1842964388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.868s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:31 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-324ca6cd-4aa9-4e1d-8989-3a372e80b289 tempest-ProjectReaderTests-1842964388 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:58:31 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-324ca6cd-4aa9-4e1d-8989-3a372e80b289 tempest-ProjectReaderTests-1842964388 None] Deleted volume successfully. Jul 10 06:58:31 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-324ca6cd-4aa9-4e1d-8989-3a372e80b289 tempest-ProjectReaderTests-1842964388 None] Lock "cinder-2b5a6dcb-f1d2-4283-9b3d-977758802a6c-delete_volume" released by "delete_volume" :: held 3.191s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:31 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcb62803-a145-40d8-92c8-6eaeba8bddc1 tempest-ProjectReaderTests-1842964388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:58:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bcb62803-a145-40d8-92c8-6eaeba8bddc1 tempest-ProjectReaderTests-1842964388 None] Flow 'volume_create_manager' (5c4e37a9-62aa-4f98-8015-b5113017d65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:58:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bcb62803-a145-40d8-92c8-6eaeba8bddc1 tempest-ProjectReaderTests-1842964388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b826c039-e5e1-4148-9b90-e6358ac121fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bcb62803-a145-40d8-92c8-6eaeba8bddc1 tempest-ProjectReaderTests-1842964388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b826c039-e5e1-4148-9b90-e6358ac121fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-365637596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8377a1d2-b86a-4fb6-92d0-df81eb9cb680,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7edba59ec544ef19403306586f4dc37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:58:32Z,use_quota=True,user_id='22a4130618e148c084c2754183b492f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bcb62803-a145-40d8-92c8-6eaeba8bddc1 tempest-ProjectReaderTests-1842964388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a8bccb-6275-47b9-bfa8-c6273d41f8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bcb62803-a145-40d8-92c8-6eaeba8bddc1 tempest-ProjectReaderTests-1842964388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a8bccb-6275-47b9-bfa8-c6273d41f8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bcb62803-a145-40d8-92c8-6eaeba8bddc1 tempest-ProjectReaderTests-1842964388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (215e41ad-a6ca-4201-b6d1-821ea327d0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bcb62803-a145-40d8-92c8-6eaeba8bddc1 tempest-ProjectReaderTests-1842964388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (215e41ad-a6ca-4201-b6d1-821ea327d0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8377a1d2-b86a-4fb6-92d0-df81eb9cb680', 'volume_name': 'volume-8377a1d2-b86a-4fb6-92d0-df81eb9cb680', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bcb62803-a145-40d8-92c8-6eaeba8bddc1 tempest-ProjectReaderTests-1842964388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (221a6446-243c-4f94-a7d6-6a8491a767f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bcb62803-a145-40d8-92c8-6eaeba8bddc1 tempest-ProjectReaderTests-1842964388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (221a6446-243c-4f94-a7d6-6a8491a767f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:31 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bcb62803-a145-40d8-92c8-6eaeba8bddc1 tempest-ProjectReaderTests-1842964388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce3882d5-5c42-460f-b8b1-74238a24826d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:31 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-bcb62803-a145-40d8-92c8-6eaeba8bddc1 tempest-ProjectReaderTests-1842964388 None] Volume 8377a1d2-b86a-4fb6-92d0-df81eb9cb680: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8377a1d2-b86a-4fb6-92d0-df81eb9cb680', 'volume_size': 1} Jul 10 06:58:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-bcb62803-a145-40d8-92c8-6eaeba8bddc1 tempest-ProjectReaderTests-1842964388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:32 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1a92c39a-03d7-4b7a-9866-be052380eadf tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894.a9e1f24e-666a-4f94-b9b9-a87f6036414d 1G" returned: 0 in 1.185s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1a92c39a-03d7-4b7a-9866-be052380eadf tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74eaa648-a59d-4418-b534-c37bae5a1894 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894.a9e1f24e-666a-4f94-b9b9-a87f6036414d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:32 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74eaa648-a59d-4418-b534-c37bae5a1894 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894.a9e1f24e-666a-4f94-b9b9-a87f6036414d Jul 10 06:58:32 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:33 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1a92c39a-03d7-4b7a-9866-be052380eadf tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74eaa648-a59d-4418-b534-c37bae5a1894 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894.a9e1f24e-666a-4f94-b9b9-a87f6036414d" returned: 0 in 0.882s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:33 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-1a92c39a-03d7-4b7a-9866-be052380eadf tempest-ProjectMemberTests-1458770269 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894.a9e1f24e-666a-4f94-b9b9-a87f6036414d is being set with open permissions: ugo+rw Jul 10 06:58:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1a92c39a-03d7-4b7a-9866-be052380eadf tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894.a9e1f24e-666a-4f94-b9b9-a87f6036414d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:33 devstack sudo[106749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894.a9e1f24e-666a-4f94-b9b9-a87f6036414d Jul 10 06:58:33 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:34 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1a92c39a-03d7-4b7a-9866-be052380eadf tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894.a9e1f24e-666a-4f94-b9b9-a87f6036414d" returned: 0 in 0.942s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1a92c39a-03d7-4b7a-9866-be052380eadf tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:34 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894.info Jul 10 06:58:34 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:34 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1a92c39a-03d7-4b7a-9866-be052380eadf tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894.info" returned: 0 in 0.756s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:34 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-1a92c39a-03d7-4b7a-9866-be052380eadf tempest-ProjectMemberTests-1458770269 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894.info is being set with open permissions: ugo+rw Jul 10 06:58:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1a92c39a-03d7-4b7a-9866-be052380eadf tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:35 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894.info Jul 10 06:58:35 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:35 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1a92c39a-03d7-4b7a-9866-be052380eadf tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894.info" returned: 0 in 0.742s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-1a92c39a-03d7-4b7a-9866-be052380eadf tempest-ProjectMemberTests-1458770269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.942s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-bcb62803-a145-40d8-92c8-6eaeba8bddc1 tempest-ProjectReaderTests-1842964388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.807s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:35 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-bcb62803-a145-40d8-92c8-6eaeba8bddc1 tempest-ProjectReaderTests-1842964388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-365637596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8377a1d2-b86a-4fb6-92d0-df81eb9cb680,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7edba59ec544ef19403306586f4dc37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:58:32Z,use_quota=True,user_id='22a4130618e148c084c2754183b492f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:58:35 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-bcb62803-a145-40d8-92c8-6eaeba8bddc1 tempest-ProjectReaderTests-1842964388 None] Creating volume 8377a1d2-b86a-4fb6-92d0-df81eb9cb680 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:58:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-bcb62803-a145-40d8-92c8-6eaeba8bddc1 tempest-ProjectReaderTests-1842964388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-bcb62803-a145-40d8-92c8-6eaeba8bddc1 tempest-ProjectReaderTests-1842964388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:35 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-bcb62803-a145-40d8-92c8-6eaeba8bddc1 tempest-ProjectReaderTests-1842964388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:58:35 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-bcb62803-a145-40d8-92c8-6eaeba8bddc1 tempest-ProjectReaderTests-1842964388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:58:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-bcb62803-a145-40d8-92c8-6eaeba8bddc1 tempest-ProjectReaderTests-1842964388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:35 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-bcb62803-a145-40d8-92c8-6eaeba8bddc1 tempest-ProjectReaderTests-1842964388 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:58:35 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-bcb62803-a145-40d8-92c8-6eaeba8bddc1 tempest-ProjectReaderTests-1842964388 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:58:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bcb62803-a145-40d8-92c8-6eaeba8bddc1 tempest-ProjectReaderTests-1842964388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8377a1d2-b86a-4fb6-92d0-df81eb9cb680 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:35 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8377a1d2-b86a-4fb6-92d0-df81eb9cb680 1073741824 Jul 10 06:58:35 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:35 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-1a92c39a-03d7-4b7a-9866-be052380eadf tempest-ProjectMemberTests-1458770269 None] Create snapshot completed successfully Jul 10 06:58:36 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e0ee41a4-1706-4745-a7a7-aa0787fa37c3 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "cinder-a9e1f24e-666a-4f94-b9b9-a87f6036414d-delete_snapshot" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:36 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e0ee41a4-1706-4745-a7a7-aa0787fa37c3 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-a9e1f24e-666a-4f94-b9b9-a87f6036414d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:36 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e0ee41a4-1706-4745-a7a7-aa0787fa37c3 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "cinder-quobyte-74eaa648-a59d-4418-b534-c37bae5a1894" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:36 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e0ee41a4-1706-4745-a7a7-aa0787fa37c3 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-74eaa648-a59d-4418-b534-c37bae5a1894" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:36 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e0ee41a4-1706-4745-a7a7-aa0787fa37c3 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "cinder-quobyte-a9e1f24e-666a-4f94-b9b9-a87f6036414d" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:36 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e0ee41a4-1706-4745-a7a7-aa0787fa37c3 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-a9e1f24e-666a-4f94-b9b9-a87f6036414d" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:36 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-e0ee41a4-1706-4745-a7a7-aa0787fa37c3 tempest-ProjectMemberTests-1458770269 None] Deleting offline snapshot a9e1f24e-666a-4f94-b9b9-a87f6036414d of volume 74eaa648-a59d-4418-b534-c37bae5a1894 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:58:36 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-e0ee41a4-1706-4745-a7a7-aa0787fa37c3 tempest-ProjectMemberTests-1458770269 None] snapshot_file for this snap is: volume-74eaa648-a59d-4418-b534-c37bae5a1894.a9e1f24e-666a-4f94-b9b9-a87f6036414d {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:58:36 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[539ea815-c6f7-4cc0-b36a-a05e6fced840]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:58:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e0ee41a4-1706-4745-a7a7-aa0787fa37c3 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894.a9e1f24e-666a-4f94-b9b9-a87f6036414d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:36 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894.a9e1f24e-666a-4f94-b9b9-a87f6036414d Jul 10 06:58:36 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:36 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bcb62803-a145-40d8-92c8-6eaeba8bddc1 tempest-ProjectReaderTests-1842964388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8377a1d2-b86a-4fb6-92d0-df81eb9cb680 1073741824" returned: 0 in 1.115s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bcb62803-a145-40d8-92c8-6eaeba8bddc1 tempest-ProjectReaderTests-1842964388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8377a1d2-b86a-4fb6-92d0-df81eb9cb680 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:36 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8377a1d2-b86a-4fb6-92d0-df81eb9cb680 Jul 10 06:58:36 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:37 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-f61e2846-0cfc-47ad-b67b-a7190a6153b4 tempest-SnapshotDependencyTests-399565570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:58:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f61e2846-0cfc-47ad-b67b-a7190a6153b4 tempest-SnapshotDependencyTests-399565570 None] Flow 'volume_create_manager' (76b2e64a-3151-4ded-b003-97feeb963dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:58:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f61e2846-0cfc-47ad-b67b-a7190a6153b4 tempest-SnapshotDependencyTests-399565570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4af50c8-8179-47f6-bc27-eea877e7e8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f61e2846-0cfc-47ad-b67b-a7190a6153b4 tempest-SnapshotDependencyTests-399565570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4af50c8-8179-47f6-bc27-eea877e7e8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-585137691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b06f4cbf-0de5-4472-b99f-323cbe5f7a6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c8cc5e7520b46998763c41276400b6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:58:37Z,use_quota=True,user_id='d026572f2c33442083e8cba3f68f6663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f61e2846-0cfc-47ad-b67b-a7190a6153b4 tempest-SnapshotDependencyTests-399565570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7b45936-53d9-46fb-87f2-3815a884a182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f61e2846-0cfc-47ad-b67b-a7190a6153b4 tempest-SnapshotDependencyTests-399565570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7b45936-53d9-46fb-87f2-3815a884a182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f61e2846-0cfc-47ad-b67b-a7190a6153b4 tempest-SnapshotDependencyTests-399565570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4f6099c-cc5c-4a6f-98f6-e533cda422a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f61e2846-0cfc-47ad-b67b-a7190a6153b4 tempest-SnapshotDependencyTests-399565570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4f6099c-cc5c-4a6f-98f6-e533cda422a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b06f4cbf-0de5-4472-b99f-323cbe5f7a6f', 'volume_name': 'volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f61e2846-0cfc-47ad-b67b-a7190a6153b4 tempest-SnapshotDependencyTests-399565570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29003557-a5a5-4d11-a444-04cb042d2b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f61e2846-0cfc-47ad-b67b-a7190a6153b4 tempest-SnapshotDependencyTests-399565570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29003557-a5a5-4d11-a444-04cb042d2b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f61e2846-0cfc-47ad-b67b-a7190a6153b4 tempest-SnapshotDependencyTests-399565570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c383f857-e8fb-4f2a-bc31-894c04885337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:37 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-f61e2846-0cfc-47ad-b67b-a7190a6153b4 tempest-SnapshotDependencyTests-399565570 None] Volume b06f4cbf-0de5-4472-b99f-323cbe5f7a6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f', 'volume_size': 1} Jul 10 06:58:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f61e2846-0cfc-47ad-b67b-a7190a6153b4 tempest-SnapshotDependencyTests-399565570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:37 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e0ee41a4-1706-4745-a7a7-aa0787fa37c3 tempest-ProjectMemberTests-1458770269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894.a9e1f24e-666a-4f94-b9b9-a87f6036414d" returned: 0 in 0.780s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:37 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-e0ee41a4-1706-4745-a7a7-aa0787fa37c3 tempest-ProjectMemberTests-1458770269 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74eaa648-a59d-4418-b534-c37bae5a1894(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:58:37 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc83113b-7939-4261-a924-283e15fa4da3]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:58:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e0ee41a4-1706-4745-a7a7-aa0787fa37c3 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:37 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894 Jul 10 06:58:37 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:37 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bcb62803-a145-40d8-92c8-6eaeba8bddc1 tempest-ProjectReaderTests-1842964388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8377a1d2-b86a-4fb6-92d0-df81eb9cb680" returned: 0 in 0.736s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:37 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-bcb62803-a145-40d8-92c8-6eaeba8bddc1 tempest-ProjectReaderTests-1842964388 None] <== create_volume: return (1896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:58:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-bcb62803-a145-40d8-92c8-6eaeba8bddc1 tempest-ProjectReaderTests-1842964388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.903s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f61e2846-0cfc-47ad-b67b-a7190a6153b4 tempest-SnapshotDependencyTests-399565570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.554s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:37 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f61e2846-0cfc-47ad-b67b-a7190a6153b4 tempest-SnapshotDependencyTests-399565570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-585137691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b06f4cbf-0de5-4472-b99f-323cbe5f7a6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c8cc5e7520b46998763c41276400b6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:58:37Z,use_quota=True,user_id='d026572f2c33442083e8cba3f68f6663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:58:37 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-f61e2846-0cfc-47ad-b67b-a7190a6153b4 tempest-SnapshotDependencyTests-399565570 None] Creating volume b06f4cbf-0de5-4472-b99f-323cbe5f7a6f {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:58:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f61e2846-0cfc-47ad-b67b-a7190a6153b4 tempest-SnapshotDependencyTests-399565570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f61e2846-0cfc-47ad-b67b-a7190a6153b4 tempest-SnapshotDependencyTests-399565570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:37 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f61e2846-0cfc-47ad-b67b-a7190a6153b4 tempest-SnapshotDependencyTests-399565570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:58:37 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f61e2846-0cfc-47ad-b67b-a7190a6153b4 tempest-SnapshotDependencyTests-399565570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:58:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f61e2846-0cfc-47ad-b67b-a7190a6153b4 tempest-SnapshotDependencyTests-399565570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:37 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f61e2846-0cfc-47ad-b67b-a7190a6153b4 tempest-SnapshotDependencyTests-399565570 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:58:37 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-f61e2846-0cfc-47ad-b67b-a7190a6153b4 tempest-SnapshotDependencyTests-399565570 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:58:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f61e2846-0cfc-47ad-b67b-a7190a6153b4 tempest-SnapshotDependencyTests-399565570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:37 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f 1073741824 Jul 10 06:58:37 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bcb62803-a145-40d8-92c8-6eaeba8bddc1 tempest-ProjectReaderTests-1842964388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce3882d5-5c42-460f-b8b1-74238a24826d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8377a1d2-b86a-4fb6-92d0-df81eb9cb680', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bcb62803-a145-40d8-92c8-6eaeba8bddc1 tempest-ProjectReaderTests-1842964388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cc939ca-fcad-4b46-b2a4-1dd73e7c2046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:37 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-bcb62803-a145-40d8-92c8-6eaeba8bddc1 tempest-ProjectReaderTests-1842964388 None] Volume volume-8377a1d2-b86a-4fb6-92d0-df81eb9cb680 (8377a1d2-b86a-4fb6-92d0-df81eb9cb680): created successfully Jul 10 06:58:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bcb62803-a145-40d8-92c8-6eaeba8bddc1 tempest-ProjectReaderTests-1842964388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cc939ca-fcad-4b46-b2a4-1dd73e7c2046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-bcb62803-a145-40d8-92c8-6eaeba8bddc1 tempest-ProjectReaderTests-1842964388 None] Flow 'volume_create_manager' (5c4e37a9-62aa-4f98-8015-b5113017d65e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:58:37 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-bcb62803-a145-40d8-92c8-6eaeba8bddc1 tempest-ProjectReaderTests-1842964388 None] Created volume successfully. Jul 10 06:58:38 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-83822940-f1c5-49ca-a4d6-8db9a44205c1 tempest-ProjectReaderTests-1842964388 None] Acquiring lock "cinder-8377a1d2-b86a-4fb6-92d0-df81eb9cb680-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:38 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-83822940-f1c5-49ca-a4d6-8db9a44205c1 tempest-ProjectReaderTests-1842964388 None] Lock "cinder-8377a1d2-b86a-4fb6-92d0-df81eb9cb680-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:38 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-83822940-f1c5-49ca-a4d6-8db9a44205c1 tempest-ProjectReaderTests-1842964388 None] Acquiring lock "cinder-quobyte-8377a1d2-b86a-4fb6-92d0-df81eb9cb680" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:38 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-83822940-f1c5-49ca-a4d6-8db9a44205c1 tempest-ProjectReaderTests-1842964388 None] Lock "cinder-quobyte-8377a1d2-b86a-4fb6-92d0-df81eb9cb680" acquired by "delete_volume" :: waited 0.016s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:38 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a99ba7-353c-41cc-a687-720d1828f093]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:58:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-83822940-f1c5-49ca-a4d6-8db9a44205c1 tempest-ProjectReaderTests-1842964388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8377a1d2-b86a-4fb6-92d0-df81eb9cb680 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:38 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e0ee41a4-1706-4745-a7a7-aa0787fa37c3 tempest-ProjectMemberTests-1458770269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894" returned: 0 in 0.963s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e0ee41a4-1706-4745-a7a7-aa0787fa37c3 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894.a9e1f24e-666a-4f94-b9b9-a87f6036414d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:38 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8377a1d2-b86a-4fb6-92d0-df81eb9cb680 Jul 10 06:58:38 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:38 devstack sudo[106784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894.a9e1f24e-666a-4f94-b9b9-a87f6036414d Jul 10 06:58:38 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:38 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f61e2846-0cfc-47ad-b67b-a7190a6153b4 tempest-SnapshotDependencyTests-399565570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f 1073741824" returned: 0 in 0.978s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f61e2846-0cfc-47ad-b67b-a7190a6153b4 tempest-SnapshotDependencyTests-399565570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:38 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f Jul 10 06:58:38 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:39 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-83822940-f1c5-49ca-a4d6-8db9a44205c1 tempest-ProjectReaderTests-1842964388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8377a1d2-b86a-4fb6-92d0-df81eb9cb680" returned: 0 in 0.894s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-83822940-f1c5-49ca-a4d6-8db9a44205c1 tempest-ProjectReaderTests-1842964388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8377a1d2-b86a-4fb6-92d0-df81eb9cb680 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:39 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8377a1d2-b86a-4fb6-92d0-df81eb9cb680 Jul 10 06:58:39 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:39 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:39 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f61e2846-0cfc-47ad-b67b-a7190a6153b4 tempest-SnapshotDependencyTests-399565570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f" returned: 0 in 0.730s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:39 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f61e2846-0cfc-47ad-b67b-a7190a6153b4 tempest-SnapshotDependencyTests-399565570 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:58:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f61e2846-0cfc-47ad-b67b-a7190a6153b4 tempest-SnapshotDependencyTests-399565570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.765s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e0ee41a4-1706-4745-a7a7-aa0787fa37c3 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894.a9e1f24e-666a-4f94-b9b9-a87f6036414d" returned: 0 in 0.931s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e0ee41a4-1706-4745-a7a7-aa0787fa37c3 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894.a9e1f24e-666a-4f94-b9b9-a87f6036414d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f61e2846-0cfc-47ad-b67b-a7190a6153b4 tempest-SnapshotDependencyTests-399565570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c383f857-e8fb-4f2a-bc31-894c04885337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:39 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894.a9e1f24e-666a-4f94-b9b9-a87f6036414d Jul 10 06:58:39 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f61e2846-0cfc-47ad-b67b-a7190a6153b4 tempest-SnapshotDependencyTests-399565570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84398c31-b703-4d45-83d3-d45d94760609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:39 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-f61e2846-0cfc-47ad-b67b-a7190a6153b4 tempest-SnapshotDependencyTests-399565570 None] Volume volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f (b06f4cbf-0de5-4472-b99f-323cbe5f7a6f): created successfully Jul 10 06:58:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f61e2846-0cfc-47ad-b67b-a7190a6153b4 tempest-SnapshotDependencyTests-399565570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84398c31-b703-4d45-83d3-d45d94760609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:39 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f61e2846-0cfc-47ad-b67b-a7190a6153b4 tempest-SnapshotDependencyTests-399565570 None] Flow 'volume_create_manager' (76b2e64a-3151-4ded-b003-97feeb963dfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:58:39 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-f61e2846-0cfc-47ad-b67b-a7190a6153b4 tempest-SnapshotDependencyTests-399565570 None] Created volume successfully. Jul 10 06:58:39 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-83822940-f1c5-49ca-a4d6-8db9a44205c1 tempest-ProjectReaderTests-1842964388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-8377a1d2-b86a-4fb6-92d0-df81eb9cb680" returned: 0 in 0.673s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:39 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-83822940-f1c5-49ca-a4d6-8db9a44205c1 tempest-ProjectReaderTests-1842964388 None] Lock "cinder-quobyte-8377a1d2-b86a-4fb6-92d0-df81eb9cb680" released by "delete_volume" :: held 1.614s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:40 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-83822940-f1c5-49ca-a4d6-8db9a44205c1 tempest-ProjectReaderTests-1842964388 None] Created reservations ['4987189a-1888-4a80-b0f9-4e94fa83b4a3', 'c0821993-d279-4bdc-8942-413c64e2b37a', 'b426a97f-14cc-4550-ae7f-32e1c37250c6', '50be6726-c626-4700-a8c4-4700d9155c18'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:58:40 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-83822940-f1c5-49ca-a4d6-8db9a44205c1 tempest-ProjectReaderTests-1842964388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-83822940-f1c5-49ca-a4d6-8db9a44205c1 tempest-ProjectReaderTests-1842964388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:40 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-83822940-f1c5-49ca-a4d6-8db9a44205c1 tempest-ProjectReaderTests-1842964388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:58:40 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-83822940-f1c5-49ca-a4d6-8db9a44205c1 tempest-ProjectReaderTests-1842964388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:58:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-83822940-f1c5-49ca-a4d6-8db9a44205c1 tempest-ProjectReaderTests-1842964388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-83822940-f1c5-49ca-a4d6-8db9a44205c1 tempest-ProjectReaderTests-1842964388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e0ee41a4-1706-4745-a7a7-aa0787fa37c3 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894.a9e1f24e-666a-4f94-b9b9-a87f6036414d" returned: 0 in 0.697s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:40 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:58:40 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:40 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e0ee41a4-1706-4745-a7a7-aa0787fa37c3 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-a9e1f24e-666a-4f94-b9b9-a87f6036414d" released by "_delete_snapshot" :: held 3.524s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:40 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e0ee41a4-1706-4745-a7a7-aa0787fa37c3 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-74eaa648-a59d-4418-b534-c37bae5a1894" released by "delete_snapshot" :: held 3.588s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:40 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-e0ee41a4-1706-4745-a7a7-aa0787fa37c3 tempest-ProjectMemberTests-1458770269 None] Created reservations ['7a62836d-4964-4117-b8a8-18b954a84508', '3be70c62-595f-4886-bcdf-fb4439f278b7', '5a772775-4823-4310-94b1-c3d837351431', 'a9772ee7-bd48-4621-9d67-c97db4e5fea6'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:58:40 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-e0ee41a4-1706-4745-a7a7-aa0787fa37c3 tempest-ProjectMemberTests-1458770269 None] Delete snapshot completed successfully. Jul 10 06:58:40 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e0ee41a4-1706-4745-a7a7-aa0787fa37c3 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-a9e1f24e-666a-4f94-b9b9-a87f6036414d-delete_snapshot" released by "delete_snapshot" :: held 3.880s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9785e468-55e6-419e-adb9-6fe53972ad92 tempest-SnapshotDependencyTests-399565570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9785e468-55e6-419e-adb9-6fe53972ad92 tempest-SnapshotDependencyTests-399565570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:40 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-9785e468-55e6-419e-adb9-6fe53972ad92 tempest-SnapshotDependencyTests-399565570 None] Creating offline snapshot 69285312-e76d-4ae0-8525-526208f9e199 of volume b06f4cbf-0de5-4472-b99f-323cbe5f7a6f {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:58:40 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[3323de5b-2909-4415-b456-31a0aae2ad34]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:58:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9785e468-55e6-419e-adb9-6fe53972ad92 tempest-SnapshotDependencyTests-399565570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:40 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f Jul 10 06:58:40 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:40 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e853b1f6-116f-4009-aac1-599ff30f999c tempest-ProjectMemberTests-1458770269 None] Acquiring lock "cinder-74eaa648-a59d-4418-b534-c37bae5a1894-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:40 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-83822940-f1c5-49ca-a4d6-8db9a44205c1 tempest-ProjectReaderTests-1842964388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.833s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:40 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-83822940-f1c5-49ca-a4d6-8db9a44205c1 tempest-ProjectReaderTests-1842964388 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:58:40 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-83822940-f1c5-49ca-a4d6-8db9a44205c1 tempest-ProjectReaderTests-1842964388 None] Deleted volume successfully. Jul 10 06:58:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e853b1f6-116f-4009-aac1-599ff30f999c tempest-ProjectMemberTests-1458770269 None] Lock "cinder-74eaa648-a59d-4418-b534-c37bae5a1894-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-83822940-f1c5-49ca-a4d6-8db9a44205c1 tempest-ProjectReaderTests-1842964388 None] Lock "cinder-8377a1d2-b86a-4fb6-92d0-df81eb9cb680-delete_volume" released by "delete_volume" :: held 2.727s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e853b1f6-116f-4009-aac1-599ff30f999c tempest-ProjectMemberTests-1458770269 None] Acquiring lock "cinder-quobyte-74eaa648-a59d-4418-b534-c37bae5a1894" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:41 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e853b1f6-116f-4009-aac1-599ff30f999c tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-74eaa648-a59d-4418-b534-c37bae5a1894" acquired by "delete_volume" :: waited 0.036s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:41 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[489779b2-f780-435c-912f-7bab71412795]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:58:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e853b1f6-116f-4009-aac1-599ff30f999c tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:41 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894 Jul 10 06:58:41 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:41 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9785e468-55e6-419e-adb9-6fe53972ad92 tempest-SnapshotDependencyTests-399565570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f" returned: 0 in 1.046s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9785e468-55e6-419e-adb9-6fe53972ad92 tempest-SnapshotDependencyTests-399565570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f.69285312-e76d-4ae0-8525-526208f9e199 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:41 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f.69285312-e76d-4ae0-8525-526208f9e199 1G Jul 10 06:58:41 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:42 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e853b1f6-116f-4009-aac1-599ff30f999c tempest-ProjectMemberTests-1458770269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894" returned: 0 in 0.920s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e853b1f6-116f-4009-aac1-599ff30f999c tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:42 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894 Jul 10 06:58:42 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:42 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9785e468-55e6-419e-adb9-6fe53972ad92 tempest-SnapshotDependencyTests-399565570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f.69285312-e76d-4ae0-8525-526208f9e199 1G" returned: 0 in 1.092s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9785e468-55e6-419e-adb9-6fe53972ad92 tempest-SnapshotDependencyTests-399565570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f.69285312-e76d-4ae0-8525-526208f9e199 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:42 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f.69285312-e76d-4ae0-8525-526208f9e199 Jul 10 06:58:42 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:42 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e853b1f6-116f-4009-aac1-599ff30f999c tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-74eaa648-a59d-4418-b534-c37bae5a1894" returned: 0 in 0.865s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e853b1f6-116f-4009-aac1-599ff30f999c tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-74eaa648-a59d-4418-b534-c37bae5a1894" released by "delete_volume" :: held 1.872s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:43 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-e853b1f6-116f-4009-aac1-599ff30f999c tempest-ProjectMemberTests-1458770269 None] Created reservations ['7eefdeb3-767d-49d3-ab1b-3c1681c32b43', 'f392432f-cf75-4cb2-8ecc-eb0a61b21015', '1f232507-59e4-46cc-9a06-71ce36db77fd', 'a4b3ce42-26a7-44a6-9dac-7a6fca879f71'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:58:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e853b1f6-116f-4009-aac1-599ff30f999c tempest-ProjectMemberTests-1458770269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e853b1f6-116f-4009-aac1-599ff30f999c tempest-ProjectMemberTests-1458770269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:43 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-e853b1f6-116f-4009-aac1-599ff30f999c tempest-ProjectMemberTests-1458770269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:58:43 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-e853b1f6-116f-4009-aac1-599ff30f999c tempest-ProjectMemberTests-1458770269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:58:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-e853b1f6-116f-4009-aac1-599ff30f999c tempest-ProjectMemberTests-1458770269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e853b1f6-116f-4009-aac1-599ff30f999c tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:43 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:58:43 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:43 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9785e468-55e6-419e-adb9-6fe53972ad92 tempest-SnapshotDependencyTests-399565570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f.69285312-e76d-4ae0-8525-526208f9e199" returned: 0 in 0.779s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:43 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-9785e468-55e6-419e-adb9-6fe53972ad92 tempest-SnapshotDependencyTests-399565570 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f.69285312-e76d-4ae0-8525-526208f9e199 is being set with open permissions: ugo+rw Jul 10 06:58:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9785e468-55e6-419e-adb9-6fe53972ad92 tempest-SnapshotDependencyTests-399565570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f.69285312-e76d-4ae0-8525-526208f9e199 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:43 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f.69285312-e76d-4ae0-8525-526208f9e199 Jul 10 06:58:43 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:43 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e853b1f6-116f-4009-aac1-599ff30f999c tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.709s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:43 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-e853b1f6-116f-4009-aac1-599ff30f999c tempest-ProjectMemberTests-1458770269 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:58:43 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-e853b1f6-116f-4009-aac1-599ff30f999c tempest-ProjectMemberTests-1458770269 None] Deleted volume successfully. Jul 10 06:58:43 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e853b1f6-116f-4009-aac1-599ff30f999c tempest-ProjectMemberTests-1458770269 None] Lock "cinder-74eaa648-a59d-4418-b534-c37bae5a1894-delete_volume" released by "delete_volume" :: held 2.871s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:43 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d765a41-70c8-426e-a60a-073c85b3eab0 tempest-ProjectMemberTests-1458770269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:58:43 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6d765a41-70c8-426e-a60a-073c85b3eab0 tempest-ProjectMemberTests-1458770269 None] Flow 'volume_create_manager' (86f07834-6d3e-4737-b7f8-0aada1fbce77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:58:43 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6d765a41-70c8-426e-a60a-073c85b3eab0 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69685bbe-9818-4c70-823e-7e8a6d1498d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:43 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6d765a41-70c8-426e-a60a-073c85b3eab0 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69685bbe-9818-4c70-823e-7e8a6d1498d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1994897920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d166b401-e6a2-49d8-a21a-973ca7e62337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='215e832b6dbe42b49605af7a497c8dda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:58:44Z,use_quota=True,user_id='b5b28624cb0741588f7cc21f3c76f8e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:43 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6d765a41-70c8-426e-a60a-073c85b3eab0 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86ac5496-ae20-4104-a517-ca4a241688d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:44 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6d765a41-70c8-426e-a60a-073c85b3eab0 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86ac5496-ae20-4104-a517-ca4a241688d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:44 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6d765a41-70c8-426e-a60a-073c85b3eab0 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30d8ff43-c97c-45dd-8c9f-77612b684cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:44 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6d765a41-70c8-426e-a60a-073c85b3eab0 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30d8ff43-c97c-45dd-8c9f-77612b684cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd166b401-e6a2-49d8-a21a-973ca7e62337', 'volume_name': 'volume-d166b401-e6a2-49d8-a21a-973ca7e62337', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:44 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6d765a41-70c8-426e-a60a-073c85b3eab0 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b33f1a55-f4ad-4e06-9ad4-4e305595cb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:44 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6d765a41-70c8-426e-a60a-073c85b3eab0 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b33f1a55-f4ad-4e06-9ad4-4e305595cb0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:44 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6d765a41-70c8-426e-a60a-073c85b3eab0 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4498c7f-883a-44fc-9f32-b14da6afc466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:44 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-6d765a41-70c8-426e-a60a-073c85b3eab0 tempest-ProjectMemberTests-1458770269 None] Volume d166b401-e6a2-49d8-a21a-973ca7e62337: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d166b401-e6a2-49d8-a21a-973ca7e62337', 'volume_size': 1} Jul 10 06:58:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-6d765a41-70c8-426e-a60a-073c85b3eab0 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:44 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9785e468-55e6-419e-adb9-6fe53972ad92 tempest-SnapshotDependencyTests-399565570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f.69285312-e76d-4ae0-8525-526208f9e199" returned: 0 in 0.698s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9785e468-55e6-419e-adb9-6fe53972ad92 tempest-SnapshotDependencyTests-399565570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:44 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f.info Jul 10 06:58:44 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:44 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9785e468-55e6-419e-adb9-6fe53972ad92 tempest-SnapshotDependencyTests-399565570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f.info" returned: 0 in 0.651s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:44 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-9785e468-55e6-419e-adb9-6fe53972ad92 tempest-SnapshotDependencyTests-399565570 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f.info is being set with open permissions: ugo+rw Jul 10 06:58:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9785e468-55e6-419e-adb9-6fe53972ad92 tempest-SnapshotDependencyTests-399565570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:44 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f.info Jul 10 06:58:44 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:45 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9785e468-55e6-419e-adb9-6fe53972ad92 tempest-SnapshotDependencyTests-399565570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f.info" returned: 0 in 0.606s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9785e468-55e6-419e-adb9-6fe53972ad92 tempest-SnapshotDependencyTests-399565570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.967s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-6d765a41-70c8-426e-a60a-073c85b3eab0 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.486s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:45 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-6d765a41-70c8-426e-a60a-073c85b3eab0 tempest-ProjectMemberTests-1458770269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1994897920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d166b401-e6a2-49d8-a21a-973ca7e62337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='215e832b6dbe42b49605af7a497c8dda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:58:44Z,use_quota=True,user_id='b5b28624cb0741588f7cc21f3c76f8e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:58:45 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-6d765a41-70c8-426e-a60a-073c85b3eab0 tempest-ProjectMemberTests-1458770269 None] Creating volume d166b401-e6a2-49d8-a21a-973ca7e62337 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:58:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-6d765a41-70c8-426e-a60a-073c85b3eab0 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-6d765a41-70c8-426e-a60a-073c85b3eab0 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:45 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-6d765a41-70c8-426e-a60a-073c85b3eab0 tempest-ProjectMemberTests-1458770269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:58:45 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-6d765a41-70c8-426e-a60a-073c85b3eab0 tempest-ProjectMemberTests-1458770269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:58:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-6d765a41-70c8-426e-a60a-073c85b3eab0 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:45 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-6d765a41-70c8-426e-a60a-073c85b3eab0 tempest-ProjectMemberTests-1458770269 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:58:45 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-6d765a41-70c8-426e-a60a-073c85b3eab0 tempest-ProjectMemberTests-1458770269 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:58:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6d765a41-70c8-426e-a60a-073c85b3eab0 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:45 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337 1073741824 Jul 10 06:58:45 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:45 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-9785e468-55e6-419e-adb9-6fe53972ad92 tempest-SnapshotDependencyTests-399565570 None] Create snapshot completed successfully Jul 10 06:58:46 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:58:46 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Flow 'volume_create_manager' (ebe72034-b6f9-4f19-ac4e-41c5b0adf095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:58:46 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b68590d-1e88-4630-80ad-e3695de3d4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:46 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b68590d-1e88-4630-80ad-e3695de3d4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=420b5d2c-075d-4f24-a352-618ef88d5a2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c8cc5e7520b46998763c41276400b6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=69285312-e76d-4ae0-8525-526208f9e199,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:58:46Z,use_quota=True,user_id='d026572f2c33442083e8cba3f68f6663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:46 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a19907a-b068-4701-8946-978933777526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:46 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a19907a-b068-4701-8946-978933777526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:46 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cf2fc80-1f21-45c8-8fe7-75432bb42017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:46 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cf2fc80-1f21-45c8-8fe7-75432bb42017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '420b5d2c-075d-4f24-a352-618ef88d5a2c', 'volume_name': 'volume-420b5d2c-075d-4f24-a352-618ef88d5a2c', 'volume_size': 1, 'snapshot_id': '69285312-e76d-4ae0-8525-526208f9e199'}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:46 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b41d03d3-742b-4a88-8f10-6810cf90561c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:46 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b41d03d3-742b-4a88-8f10-6810cf90561c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:46 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8856d1fd-1bb8-44da-a9f0-c47e5a8e399b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:46 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Volume 420b5d2c-075d-4f24-a352-618ef88d5a2c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-420b5d2c-075d-4f24-a352-618ef88d5a2c', 'volume_size': 1, 'snapshot_id': '69285312-e76d-4ae0-8525-526208f9e199'} Jul 10 06:58:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:46 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6d765a41-70c8-426e-a60a-073c85b3eab0 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337 1073741824" returned: 0 in 0.953s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6d765a41-70c8-426e-a60a-073c85b3eab0 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:46 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337 Jul 10 06:58:46 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:47 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6d765a41-70c8-426e-a60a-073c85b3eab0 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337" returned: 0 in 0.624s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:47 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-6d765a41-70c8-426e-a60a-073c85b3eab0 tempest-ProjectMemberTests-1458770269 None] <== create_volume: return (1615ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:58:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-6d765a41-70c8-426e-a60a-073c85b3eab0 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.689s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:47 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Acquiring lock "cinder-quobyte-69285312-e76d-4ae0-8525-526208f9e199-420b5d2c-075d-4f24-a352-618ef88d5a2c" by "_create_volume_from_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:47 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6d765a41-70c8-426e-a60a-073c85b3eab0 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4498c7f-883a-44fc-9f32-b14da6afc466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d166b401-e6a2-49d8-a21a-973ca7e62337', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:47 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6d765a41-70c8-426e-a60a-073c85b3eab0 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa75dd79-6840-4e75-b866-b6a222f6365e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:47 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Lock "cinder-quobyte-69285312-e76d-4ae0-8525-526208f9e199-420b5d2c-075d-4f24-a352-618ef88d5a2c" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:47 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Creating volume 420b5d2c-075d-4f24-a352-618ef88d5a2c from snapshot 69285312-e76d-4ae0-8525-526208f9e199 {{(pid=87294) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 06:58:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:47 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:58:47 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:58:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:47 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:58:47 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Acquiring lock "cinder-quobyte-420b5d2c-075d-4f24-a352-618ef88d5a2c" by "_copy_volume_from_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:47 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-6d765a41-70c8-426e-a60a-073c85b3eab0 tempest-ProjectMemberTests-1458770269 None] Volume volume-d166b401-e6a2-49d8-a21a-973ca7e62337 (d166b401-e6a2-49d8-a21a-973ca7e62337): created successfully Jul 10 06:58:47 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6d765a41-70c8-426e-a60a-073c85b3eab0 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa75dd79-6840-4e75-b866-b6a222f6365e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:47 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-6d765a41-70c8-426e-a60a-073c85b3eab0 tempest-ProjectMemberTests-1458770269 None] Flow 'volume_create_manager' (86f07834-6d3e-4737-b7f8-0aada1fbce77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:58:47 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Lock "cinder-quobyte-420b5d2c-075d-4f24-a352-618ef88d5a2c" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:47 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] snapshot: 69285312-e76d-4ae0-8525-526208f9e199, volume: 420b5d2c-075d-4f24-a352-618ef88d5a2c, {{(pid=87294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 06:58:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:47 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:58:47 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:58:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:47 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-6d765a41-70c8-426e-a60a-073c85b3eab0 tempest-ProjectMemberTests-1458770269 None] Created volume successfully. Jul 10 06:58:47 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c03b87-b518-4f7b-9dfe-c9aa41846c05]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:58:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f.69285312-e76d-4ae0-8525-526208f9e199 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:47 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f.69285312-e76d-4ae0-8525-526208f9e199 Jul 10 06:58:47 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:48 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f.69285312-e76d-4ae0-8525-526208f9e199" returned: 0 in 0.816s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:48 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:58:48 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f {{(pid=87294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 06:58:48 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Creating direct copy from snapshot {{(pid=87294) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 06:58:48 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b997d3b-701d-413f-8968-bc8035d36dd6]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:58:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:48 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f Jul 10 06:58:48 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a1d4c2b5-48bb-4725-910b-c8d051f1c413 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:58:48 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f" returned: 0 in 0.889s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:48 devstack cinder-volume[87294]: DEBUG cinder.utils [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Path /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-420b5d2c-075d-4f24-a352-618ef88d5a2c not found in is_blk_device check {{(pid=87294) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 06:58:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-420b5d2c-075d-4f24-a352-618ef88d5a2c {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:49 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-420b5d2c-075d-4f24-a352-618ef88d5a2c Jul 10 06:58:49 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:53 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-420b5d2c-075d-4f24-a352-618ef88d5a2c" returned: 0 in 4.502s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:53 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c848d85-266c-4469-babc-b0bb16d6c065]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:58:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:53 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f Jul 10 06:58:53 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:54 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f" returned: 0 in 0.904s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:54 devstack cinder-volume[87294]: DEBUG cinder.image.image_utils [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Image conversion details: src /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f, size 1024.00 MB, duration 4.50 sec, destination /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-420b5d2c-075d-4f24-a352-618ef88d5a2c {{(pid=87294) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 06:58:54 devstack cinder-volume[87294]: INFO cinder.image.image_utils [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Converted 1024.00 MB image at 227.38 MB/s Jul 10 06:58:54 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-420b5d2c-075d-4f24-a352-618ef88d5a2c is being set with open permissions: ugo+rw Jul 10 06:58:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-420b5d2c-075d-4f24-a352-618ef88d5a2c {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:54 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-420b5d2c-075d-4f24-a352-618ef88d5a2c Jul 10 06:58:54 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:55 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-420b5d2c-075d-4f24-a352-618ef88d5a2c" returned: 0 in 0.695s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Lock "cinder-quobyte-420b5d2c-075d-4f24-a352-618ef88d5a2c" released by "_copy_volume_from_snapshot" :: held 7.916s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Lock "cinder-quobyte-69285312-e76d-4ae0-8525-526208f9e199-420b5d2c-075d-4f24-a352-618ef88d5a2c" released by "_create_volume_from_snapshot" :: held 7.959s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.988s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a1d4c2b5-48bb-4725-910b-c8d051f1c413 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.876s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:58:55 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:UPDATE=136,cinder:SELECT=111,cinder:INSERT=42,cinder:DELETE=14 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:58:55 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:SELECT=105,cinder:INSERT=37,cinder:UPDATE=144,cinder:DELETE=8 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:58:55 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-a1d4c2b5-48bb-4725-910b-c8d051f1c413 tempest-ProjectMemberTests-1458770269 None] Creating offline snapshot df8df2df-3f37-4b37-98da-211f9d9e1592 of volume d166b401-e6a2-49d8-a21a-973ca7e62337 {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:58:55 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2a6616-e377-4a21-a3ee-7820c09fe33e]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:58:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a1d4c2b5-48bb-4725-910b-c8d051f1c413 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8856d1fd-1bb8-44da-a9f0-c47e5a8e399b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-420b5d2c-075d-4f24-a352-618ef88d5a2c', 'volume_size': 1, 'snapshot_id': '69285312-e76d-4ae0-8525-526208f9e199'}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e9299a-5881-4ba8-b9bb-519ab086bd96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:58:55 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Volume volume-420b5d2c-075d-4f24-a352-618ef88d5a2c (420b5d2c-075d-4f24-a352-618ef88d5a2c): created successfully Jul 10 06:58:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e9299a-5881-4ba8-b9bb-519ab086bd96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:58:55 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Flow 'volume_create_manager' (ebe72034-b6f9-4f19-ac4e-41c5b0adf095) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:58:55 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-fbaebe86-db8f-470f-bc73-84945ca9a631 tempest-SnapshotDependencyTests-399565570 None] Created volume successfully. Jul 10 06:58:55 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337 Jul 10 06:58:55 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b1d51b11-f00c-4d0e-b535-c7fd454a3ac1 tempest-SnapshotDependencyTests-399565570 None] Acquiring lock "cinder-69285312-e76d-4ae0-8525-526208f9e199-delete_snapshot" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b1d51b11-f00c-4d0e-b535-c7fd454a3ac1 tempest-SnapshotDependencyTests-399565570 None] Lock "cinder-69285312-e76d-4ae0-8525-526208f9e199-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:55 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b1d51b11-f00c-4d0e-b535-c7fd454a3ac1 tempest-SnapshotDependencyTests-399565570 None] Acquiring lock "cinder-quobyte-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a1d4c2b5-48bb-4725-910b-c8d051f1c413 tempest-ProjectMemberTests-1458770269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337" returned: 0 in 0.833s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a1d4c2b5-48bb-4725-910b-c8d051f1c413 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337.df8df2df-3f37-4b37-98da-211f9d9e1592 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:56 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b1d51b11-f00c-4d0e-b535-c7fd454a3ac1 tempest-SnapshotDependencyTests-399565570 None] Lock "cinder-quobyte-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:56 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b1d51b11-f00c-4d0e-b535-c7fd454a3ac1 tempest-SnapshotDependencyTests-399565570 None] Acquiring lock "cinder-quobyte-69285312-e76d-4ae0-8525-526208f9e199" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:56 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337.df8df2df-3f37-4b37-98da-211f9d9e1592 1G Jul 10 06:58:56 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:56 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b1d51b11-f00c-4d0e-b535-c7fd454a3ac1 tempest-SnapshotDependencyTests-399565570 None] Lock "cinder-quobyte-69285312-e76d-4ae0-8525-526208f9e199" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:56 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-b1d51b11-f00c-4d0e-b535-c7fd454a3ac1 tempest-SnapshotDependencyTests-399565570 None] Deleting offline snapshot 69285312-e76d-4ae0-8525-526208f9e199 of volume b06f4cbf-0de5-4472-b99f-323cbe5f7a6f {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:58:56 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-b1d51b11-f00c-4d0e-b535-c7fd454a3ac1 tempest-SnapshotDependencyTests-399565570 None] snapshot_file for this snap is: volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f.69285312-e76d-4ae0-8525-526208f9e199 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:58:56 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf05060-eafa-433a-bad7-9294991147c2]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:58:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b1d51b11-f00c-4d0e-b535-c7fd454a3ac1 tempest-SnapshotDependencyTests-399565570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f.69285312-e76d-4ae0-8525-526208f9e199 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:56 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f.69285312-e76d-4ae0-8525-526208f9e199 Jul 10 06:58:56 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:56 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a1d4c2b5-48bb-4725-910b-c8d051f1c413 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337.df8df2df-3f37-4b37-98da-211f9d9e1592 1G" returned: 0 in 0.780s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a1d4c2b5-48bb-4725-910b-c8d051f1c413 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d166b401-e6a2-49d8-a21a-973ca7e62337 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337.df8df2df-3f37-4b37-98da-211f9d9e1592 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:56 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d166b401-e6a2-49d8-a21a-973ca7e62337 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337.df8df2df-3f37-4b37-98da-211f9d9e1592 Jul 10 06:58:56 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:56 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b1d51b11-f00c-4d0e-b535-c7fd454a3ac1 tempest-SnapshotDependencyTests-399565570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f.69285312-e76d-4ae0-8525-526208f9e199" returned: 0 in 0.872s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:56 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-b1d51b11-f00c-4d0e-b535-c7fd454a3ac1 tempest-SnapshotDependencyTests-399565570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:58:56 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[29146a14-95dc-41d5-b66a-e2e1068180f6]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:58:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b1d51b11-f00c-4d0e-b535-c7fd454a3ac1 tempest-SnapshotDependencyTests-399565570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:57 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f Jul 10 06:58:57 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:57 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a1d4c2b5-48bb-4725-910b-c8d051f1c413 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d166b401-e6a2-49d8-a21a-973ca7e62337 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337.df8df2df-3f37-4b37-98da-211f9d9e1592" returned: 0 in 0.697s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:57 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-a1d4c2b5-48bb-4725-910b-c8d051f1c413 tempest-ProjectMemberTests-1458770269 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337.df8df2df-3f37-4b37-98da-211f9d9e1592 is being set with open permissions: ugo+rw Jul 10 06:58:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a1d4c2b5-48bb-4725-910b-c8d051f1c413 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337.df8df2df-3f37-4b37-98da-211f9d9e1592 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:57 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337.df8df2df-3f37-4b37-98da-211f9d9e1592 Jul 10 06:58:57 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:57 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b1d51b11-f00c-4d0e-b535-c7fd454a3ac1 tempest-SnapshotDependencyTests-399565570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f" returned: 0 in 0.775s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b1d51b11-f00c-4d0e-b535-c7fd454a3ac1 tempest-SnapshotDependencyTests-399565570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f.69285312-e76d-4ae0-8525-526208f9e199 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:57 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f.69285312-e76d-4ae0-8525-526208f9e199 Jul 10 06:58:57 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:58 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a1d4c2b5-48bb-4725-910b-c8d051f1c413 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337.df8df2df-3f37-4b37-98da-211f9d9e1592" returned: 0 in 0.763s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a1d4c2b5-48bb-4725-910b-c8d051f1c413 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:58 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337.info Jul 10 06:58:58 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:58 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b1d51b11-f00c-4d0e-b535-c7fd454a3ac1 tempest-SnapshotDependencyTests-399565570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f.69285312-e76d-4ae0-8525-526208f9e199" returned: 0 in 0.703s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b1d51b11-f00c-4d0e-b535-c7fd454a3ac1 tempest-SnapshotDependencyTests-399565570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f.69285312-e76d-4ae0-8525-526208f9e199 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:58 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f.69285312-e76d-4ae0-8525-526208f9e199 Jul 10 06:58:58 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:58 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a1d4c2b5-48bb-4725-910b-c8d051f1c413 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337.info" returned: 0 in 0.634s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:58 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-a1d4c2b5-48bb-4725-910b-c8d051f1c413 tempest-ProjectMemberTests-1458770269 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337.info is being set with open permissions: ugo+rw Jul 10 06:58:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a1d4c2b5-48bb-4725-910b-c8d051f1c413 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:58 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337.info Jul 10 06:58:58 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:58:59 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b1d51b11-f00c-4d0e-b535-c7fd454a3ac1 tempest-SnapshotDependencyTests-399565570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f.69285312-e76d-4ae0-8525-526208f9e199" returned: 0 in 0.647s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:59 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b1d51b11-f00c-4d0e-b535-c7fd454a3ac1 tempest-SnapshotDependencyTests-399565570 None] Lock "cinder-quobyte-69285312-e76d-4ae0-8525-526208f9e199" released by "_delete_snapshot" :: held 3.093s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:59 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b1d51b11-f00c-4d0e-b535-c7fd454a3ac1 tempest-SnapshotDependencyTests-399565570 None] Lock "cinder-quobyte-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f" released by "delete_snapshot" :: held 3.122s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:59 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-b1d51b11-f00c-4d0e-b535-c7fd454a3ac1 tempest-SnapshotDependencyTests-399565570 None] Created reservations ['c5629a44-c38e-48fc-8d7d-1651d8302fc8', 'd449a875-36c0-468c-97ce-a630981870d5', '13693a1c-8d4b-480d-b17d-bfd745df3bf3', '26046fc9-0f23-4c51-a16e-0db93208c95e'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:58:59 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-b1d51b11-f00c-4d0e-b535-c7fd454a3ac1 tempest-SnapshotDependencyTests-399565570 None] Delete snapshot completed successfully. Jul 10 06:58:59 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b1d51b11-f00c-4d0e-b535-c7fd454a3ac1 tempest-SnapshotDependencyTests-399565570 None] Lock "cinder-69285312-e76d-4ae0-8525-526208f9e199-delete_snapshot" released by "delete_snapshot" :: held 3.275s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:58:59 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Jul 10 06:58:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-a1d4c2b5-48bb-4725-910b-c8d051f1c413 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337.info" returned: 0 in 0.661s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:58:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-a1d4c2b5-48bb-4725-910b-c8d051f1c413 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.455s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:58:59 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-a1d4c2b5-48bb-4725-910b-c8d051f1c413 tempest-ProjectMemberTests-1458770269 None] Create snapshot completed successfully Jul 10 06:58:59 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-46fb1bdc-165c-4d4f-a78b-2ce66be9f98b tempest-ProjectMemberTests-1458770269 None] Acquiring lock "cinder-df8df2df-3f37-4b37-98da-211f9d9e1592-delete_snapshot" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:59 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-46fb1bdc-165c-4d4f-a78b-2ce66be9f98b tempest-ProjectMemberTests-1458770269 None] Lock "cinder-df8df2df-3f37-4b37-98da-211f9d9e1592-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:59 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-46fb1bdc-165c-4d4f-a78b-2ce66be9f98b tempest-ProjectMemberTests-1458770269 None] Acquiring lock "cinder-quobyte-d166b401-e6a2-49d8-a21a-973ca7e62337" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:59 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-46fb1bdc-165c-4d4f-a78b-2ce66be9f98b tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-d166b401-e6a2-49d8-a21a-973ca7e62337" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:59 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-46fb1bdc-165c-4d4f-a78b-2ce66be9f98b tempest-ProjectMemberTests-1458770269 None] Acquiring lock "cinder-quobyte-df8df2df-3f37-4b37-98da-211f9d9e1592" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:58:59 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-46fb1bdc-165c-4d4f-a78b-2ce66be9f98b tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-df8df2df-3f37-4b37-98da-211f9d9e1592" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:58:59 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-46fb1bdc-165c-4d4f-a78b-2ce66be9f98b tempest-ProjectMemberTests-1458770269 None] Deleting offline snapshot df8df2df-3f37-4b37-98da-211f9d9e1592 of volume d166b401-e6a2-49d8-a21a-973ca7e62337 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:58:59 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-46fb1bdc-165c-4d4f-a78b-2ce66be9f98b tempest-ProjectMemberTests-1458770269 None] snapshot_file for this snap is: volume-d166b401-e6a2-49d8-a21a-973ca7e62337.df8df2df-3f37-4b37-98da-211f9d9e1592 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:58:59 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ced3fd-f9f7-447e-8c01-094e28ae2072]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:58:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-46fb1bdc-165c-4d4f-a78b-2ce66be9f98b tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337.df8df2df-3f37-4b37-98da-211f9d9e1592 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:58:59 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337.df8df2df-3f37-4b37-98da-211f9d9e1592 Jul 10 06:58:59 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:00 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-948089b8-82cd-46fb-b1cf-1d90f6cd7806 tempest-SnapshotDependencyTests-399565570 None] Acquiring lock "cinder-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:59:00 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-948089b8-82cd-46fb-b1cf-1d90f6cd7806 tempest-SnapshotDependencyTests-399565570 None] Lock "cinder-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:59:00 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-948089b8-82cd-46fb-b1cf-1d90f6cd7806 tempest-SnapshotDependencyTests-399565570 None] Acquiring lock "cinder-quobyte-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:59:00 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-948089b8-82cd-46fb-b1cf-1d90f6cd7806 tempest-SnapshotDependencyTests-399565570 None] Lock "cinder-quobyte-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f" acquired by "delete_volume" :: waited 0.014s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:59:00 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[89acbb2c-f999-429c-b528-1793d50da077]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:59:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-948089b8-82cd-46fb-b1cf-1d90f6cd7806 tempest-SnapshotDependencyTests-399565570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:00 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f Jul 10 06:59:00 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:00 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-46fb1bdc-165c-4d4f-a78b-2ce66be9f98b tempest-ProjectMemberTests-1458770269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337.df8df2df-3f37-4b37-98da-211f9d9e1592" returned: 0 in 0.749s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:00 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-46fb1bdc-165c-4d4f-a78b-2ce66be9f98b tempest-ProjectMemberTests-1458770269 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d166b401-e6a2-49d8-a21a-973ca7e62337(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:59:00 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6eaf60d-5c5d-4dd6-b90a-89c459ffc073]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:59:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-46fb1bdc-165c-4d4f-a78b-2ce66be9f98b tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:00 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337 Jul 10 06:59:00 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:01 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-948089b8-82cd-46fb-b1cf-1d90f6cd7806 tempest-SnapshotDependencyTests-399565570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f" returned: 0 in 0.745s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-948089b8-82cd-46fb-b1cf-1d90f6cd7806 tempest-SnapshotDependencyTests-399565570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:01 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f Jul 10 06:59:01 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:01 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-46fb1bdc-165c-4d4f-a78b-2ce66be9f98b tempest-ProjectMemberTests-1458770269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337" returned: 0 in 0.737s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-46fb1bdc-165c-4d4f-a78b-2ce66be9f98b tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337.df8df2df-3f37-4b37-98da-211f9d9e1592 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:01 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337.df8df2df-3f37-4b37-98da-211f9d9e1592 Jul 10 06:59:01 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:01 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-948089b8-82cd-46fb-b1cf-1d90f6cd7806 tempest-SnapshotDependencyTests-399565570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f" returned: 0 in 0.654s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:01 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-948089b8-82cd-46fb-b1cf-1d90f6cd7806 tempest-SnapshotDependencyTests-399565570 None] Lock "cinder-quobyte-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f" released by "delete_volume" :: held 1.461s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:01 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-948089b8-82cd-46fb-b1cf-1d90f6cd7806 tempest-SnapshotDependencyTests-399565570 None] Created reservations ['0c50e355-d734-4116-91ff-0d18fd5d1a39', '44d438f1-0efa-4a6d-a3a2-55101bc0c6f2', 'd0a63a4b-9804-47de-9f0e-a595a189c7cb', '408131f0-d133-4946-8806-4458082b1c92'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:59:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-948089b8-82cd-46fb-b1cf-1d90f6cd7806 tempest-SnapshotDependencyTests-399565570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:59:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-948089b8-82cd-46fb-b1cf-1d90f6cd7806 tempest-SnapshotDependencyTests-399565570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:59:01 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-948089b8-82cd-46fb-b1cf-1d90f6cd7806 tempest-SnapshotDependencyTests-399565570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:59:01 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-948089b8-82cd-46fb-b1cf-1d90f6cd7806 tempest-SnapshotDependencyTests-399565570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:59:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-948089b8-82cd-46fb-b1cf-1d90f6cd7806 tempest-SnapshotDependencyTests-399565570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:59:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-948089b8-82cd-46fb-b1cf-1d90f6cd7806 tempest-SnapshotDependencyTests-399565570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:01 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:59:01 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:02 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-46fb1bdc-165c-4d4f-a78b-2ce66be9f98b tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337.df8df2df-3f37-4b37-98da-211f9d9e1592" returned: 0 in 0.733s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-46fb1bdc-165c-4d4f-a78b-2ce66be9f98b tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337.df8df2df-3f37-4b37-98da-211f9d9e1592 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:02 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337.df8df2df-3f37-4b37-98da-211f9d9e1592 Jul 10 06:59:02 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:02 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-3d037f1b-95d5-4806-bb2a-9230bc2e90f4 tempest-SnapshotDependencyTests-399565570 None] Acquiring lock "cinder-420b5d2c-075d-4f24-a352-618ef88d5a2c-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:59:02 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-3d037f1b-95d5-4806-bb2a-9230bc2e90f4 tempest-SnapshotDependencyTests-399565570 None] Lock "cinder-420b5d2c-075d-4f24-a352-618ef88d5a2c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:59:02 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-948089b8-82cd-46fb-b1cf-1d90f6cd7806 tempest-SnapshotDependencyTests-399565570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.639s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:02 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-948089b8-82cd-46fb-b1cf-1d90f6cd7806 tempest-SnapshotDependencyTests-399565570 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:59:02 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-3d037f1b-95d5-4806-bb2a-9230bc2e90f4 tempest-SnapshotDependencyTests-399565570 None] Acquiring lock "cinder-quobyte-420b5d2c-075d-4f24-a352-618ef88d5a2c" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:59:02 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-948089b8-82cd-46fb-b1cf-1d90f6cd7806 tempest-SnapshotDependencyTests-399565570 None] Deleted volume successfully. Jul 10 06:59:02 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-948089b8-82cd-46fb-b1cf-1d90f6cd7806 tempest-SnapshotDependencyTests-399565570 None] Lock "cinder-b06f4cbf-0de5-4472-b99f-323cbe5f7a6f-delete_volume" released by "delete_volume" :: held 2.327s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:02 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-3d037f1b-95d5-4806-bb2a-9230bc2e90f4 tempest-SnapshotDependencyTests-399565570 None] Lock "cinder-quobyte-420b5d2c-075d-4f24-a352-618ef88d5a2c" acquired by "delete_volume" :: waited 0.025s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:59:02 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08388fa-2080-4bee-bd2c-eeb4747a7074]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:59:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3d037f1b-95d5-4806-bb2a-9230bc2e90f4 tempest-SnapshotDependencyTests-399565570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-420b5d2c-075d-4f24-a352-618ef88d5a2c {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:02 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-420b5d2c-075d-4f24-a352-618ef88d5a2c Jul 10 06:59:02 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:02 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-46fb1bdc-165c-4d4f-a78b-2ce66be9f98b tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337.df8df2df-3f37-4b37-98da-211f9d9e1592" returned: 0 in 0.657s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:02 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-46fb1bdc-165c-4d4f-a78b-2ce66be9f98b tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-df8df2df-3f37-4b37-98da-211f9d9e1592" released by "_delete_snapshot" :: held 2.974s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:02 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-46fb1bdc-165c-4d4f-a78b-2ce66be9f98b tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-d166b401-e6a2-49d8-a21a-973ca7e62337" released by "delete_snapshot" :: held 2.995s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:02 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-46fb1bdc-165c-4d4f-a78b-2ce66be9f98b tempest-ProjectMemberTests-1458770269 None] Created reservations ['575c8645-0362-4fd2-9034-7b13f0e60f25', '331e9e30-6de6-45bc-8ceb-5e186740db2f', 'd9c6a4c0-4203-40b2-8441-0b8f79386bd4', 'a22a8cfe-8bf2-4475-aaa3-636b27a4260b'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:59:02 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-46fb1bdc-165c-4d4f-a78b-2ce66be9f98b tempest-ProjectMemberTests-1458770269 None] Delete snapshot completed successfully. Jul 10 06:59:02 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-46fb1bdc-165c-4d4f-a78b-2ce66be9f98b tempest-ProjectMemberTests-1458770269 None] Lock "cinder-df8df2df-3f37-4b37-98da-211f9d9e1592-delete_snapshot" released by "delete_snapshot" :: held 3.137s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:02 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-ebec8d20-7696-4102-88ee-470d9c069340 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "cinder-d166b401-e6a2-49d8-a21a-973ca7e62337-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:59:02 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-ebec8d20-7696-4102-88ee-470d9c069340 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-d166b401-e6a2-49d8-a21a-973ca7e62337-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:59:03 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-ebec8d20-7696-4102-88ee-470d9c069340 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "cinder-quobyte-d166b401-e6a2-49d8-a21a-973ca7e62337" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:59:03 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-ebec8d20-7696-4102-88ee-470d9c069340 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-d166b401-e6a2-49d8-a21a-973ca7e62337" acquired by "delete_volume" :: waited 0.017s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:59:03 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[f407c4d0-2713-4c7c-8142-80e2831e7142]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:59:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ebec8d20-7696-4102-88ee-470d9c069340 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:03 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337 Jul 10 06:59:03 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:03 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3d037f1b-95d5-4806-bb2a-9230bc2e90f4 tempest-SnapshotDependencyTests-399565570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-420b5d2c-075d-4f24-a352-618ef88d5a2c" returned: 0 in 0.760s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3d037f1b-95d5-4806-bb2a-9230bc2e90f4 tempest-SnapshotDependencyTests-399565570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-420b5d2c-075d-4f24-a352-618ef88d5a2c {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:03 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-420b5d2c-075d-4f24-a352-618ef88d5a2c Jul 10 06:59:03 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:03 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ebec8d20-7696-4102-88ee-470d9c069340 tempest-ProjectMemberTests-1458770269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337" returned: 0 in 0.729s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ebec8d20-7696-4102-88ee-470d9c069340 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:03 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337 Jul 10 06:59:03 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:03 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3d037f1b-95d5-4806-bb2a-9230bc2e90f4 tempest-SnapshotDependencyTests-399565570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-420b5d2c-075d-4f24-a352-618ef88d5a2c" returned: 0 in 0.606s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:03 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-3d037f1b-95d5-4806-bb2a-9230bc2e90f4 tempest-SnapshotDependencyTests-399565570 None] Lock "cinder-quobyte-420b5d2c-075d-4f24-a352-618ef88d5a2c" released by "delete_volume" :: held 1.408s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:03 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-3d037f1b-95d5-4806-bb2a-9230bc2e90f4 tempest-SnapshotDependencyTests-399565570 None] Created reservations ['bfbca452-db1d-4e64-9f48-77257f97e9a0', '513955e3-7279-46bf-a2d6-3856b200b4c5', '789c2b97-f240-4731-9bd7-e4756ac074f7', 'c9a2de6a-c8d1-42d3-8685-356e39e2936d'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:59:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-3d037f1b-95d5-4806-bb2a-9230bc2e90f4 tempest-SnapshotDependencyTests-399565570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:59:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-3d037f1b-95d5-4806-bb2a-9230bc2e90f4 tempest-SnapshotDependencyTests-399565570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:59:04 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-3d037f1b-95d5-4806-bb2a-9230bc2e90f4 tempest-SnapshotDependencyTests-399565570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:59:04 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-3d037f1b-95d5-4806-bb2a-9230bc2e90f4 tempest-SnapshotDependencyTests-399565570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:59:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-3d037f1b-95d5-4806-bb2a-9230bc2e90f4 tempest-SnapshotDependencyTests-399565570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:59:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3d037f1b-95d5-4806-bb2a-9230bc2e90f4 tempest-SnapshotDependencyTests-399565570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:04 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:59:04 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:04 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ebec8d20-7696-4102-88ee-470d9c069340 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-d166b401-e6a2-49d8-a21a-973ca7e62337" returned: 0 in 0.632s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:04 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-ebec8d20-7696-4102-88ee-470d9c069340 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-d166b401-e6a2-49d8-a21a-973ca7e62337" released by "delete_volume" :: held 1.413s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:04 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-ebec8d20-7696-4102-88ee-470d9c069340 tempest-ProjectMemberTests-1458770269 None] Created reservations ['0dfe336d-69a7-4570-b11f-78fd0d8c21e3', '842a1c88-14bb-43d1-a5ef-e0ddb0be7d13', '42c8d676-9299-40be-988d-d6c57878f450', '3688510f-750a-4700-98bf-99b73a7622a8'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:59:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ebec8d20-7696-4102-88ee-470d9c069340 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:59:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ebec8d20-7696-4102-88ee-470d9c069340 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:59:04 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-ebec8d20-7696-4102-88ee-470d9c069340 tempest-ProjectMemberTests-1458770269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:59:04 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-ebec8d20-7696-4102-88ee-470d9c069340 tempest-ProjectMemberTests-1458770269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:59:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ebec8d20-7696-4102-88ee-470d9c069340 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:59:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ebec8d20-7696-4102-88ee-470d9c069340 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:04 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:59:04 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:04 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3d037f1b-95d5-4806-bb2a-9230bc2e90f4 tempest-SnapshotDependencyTests-399565570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.664s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:04 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-3d037f1b-95d5-4806-bb2a-9230bc2e90f4 tempest-SnapshotDependencyTests-399565570 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:59:04 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-3d037f1b-95d5-4806-bb2a-9230bc2e90f4 tempest-SnapshotDependencyTests-399565570 None] Deleted volume successfully. Jul 10 06:59:04 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-3d037f1b-95d5-4806-bb2a-9230bc2e90f4 tempest-SnapshotDependencyTests-399565570 None] Lock "cinder-420b5d2c-075d-4f24-a352-618ef88d5a2c-delete_volume" released by "delete_volume" :: held 2.314s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:05 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ebec8d20-7696-4102-88ee-470d9c069340 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.642s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:05 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-ebec8d20-7696-4102-88ee-470d9c069340 tempest-ProjectMemberTests-1458770269 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:59:05 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-ebec8d20-7696-4102-88ee-470d9c069340 tempest-ProjectMemberTests-1458770269 None] Deleted volume successfully. Jul 10 06:59:05 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-ebec8d20-7696-4102-88ee-470d9c069340 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-d166b401-e6a2-49d8-a21a-973ca7e62337-delete_volume" released by "delete_volume" :: held 2.256s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:05 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-31bfac84-afa4-4ad1-a273-122512202173 tempest-ProjectMemberTests-1458770269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:59:05 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-31bfac84-afa4-4ad1-a273-122512202173 tempest-ProjectMemberTests-1458770269 None] Flow 'volume_create_manager' (ef87f26b-72fd-462f-b97c-077034fc4680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:59:05 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-31bfac84-afa4-4ad1-a273-122512202173 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4337648-f1f8-42e4-a9a8-3701a8a70a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:05 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-31bfac84-afa4-4ad1-a273-122512202173 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4337648-f1f8-42e4-a9a8-3701a8a70a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1996067139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a60c377f-5bcb-4dbb-a71b-056694494ef3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='215e832b6dbe42b49605af7a497c8dda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:59:06Z,use_quota=True,user_id='b5b28624cb0741588f7cc21f3c76f8e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:05 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-31bfac84-afa4-4ad1-a273-122512202173 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1047538-ac13-4249-992f-52353d0baa5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:05 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-31bfac84-afa4-4ad1-a273-122512202173 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1047538-ac13-4249-992f-52353d0baa5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:05 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-31bfac84-afa4-4ad1-a273-122512202173 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a0db77c-5025-483e-a9d2-2adfbde0522c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:05 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-31bfac84-afa4-4ad1-a273-122512202173 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a0db77c-5025-483e-a9d2-2adfbde0522c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a60c377f-5bcb-4dbb-a71b-056694494ef3', 'volume_name': 'volume-a60c377f-5bcb-4dbb-a71b-056694494ef3', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:05 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-31bfac84-afa4-4ad1-a273-122512202173 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce6309c1-fec1-4921-9cf1-912c3fac6e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:05 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-31bfac84-afa4-4ad1-a273-122512202173 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce6309c1-fec1-4921-9cf1-912c3fac6e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:05 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-31bfac84-afa4-4ad1-a273-122512202173 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1105eeb5-0253-4b6b-8747-a9f6e1f1cb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:05 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-31bfac84-afa4-4ad1-a273-122512202173 tempest-ProjectMemberTests-1458770269 None] Volume a60c377f-5bcb-4dbb-a71b-056694494ef3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a60c377f-5bcb-4dbb-a71b-056694494ef3', 'volume_size': 1} Jul 10 06:59:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-31bfac84-afa4-4ad1-a273-122512202173 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:59:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-31bfac84-afa4-4ad1-a273-122512202173 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:59:05 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-31bfac84-afa4-4ad1-a273-122512202173 tempest-ProjectMemberTests-1458770269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1996067139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a60c377f-5bcb-4dbb-a71b-056694494ef3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='215e832b6dbe42b49605af7a497c8dda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:59:06Z,use_quota=True,user_id='b5b28624cb0741588f7cc21f3c76f8e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:59:05 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-31bfac84-afa4-4ad1-a273-122512202173 tempest-ProjectMemberTests-1458770269 None] Creating volume a60c377f-5bcb-4dbb-a71b-056694494ef3 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:59:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-31bfac84-afa4-4ad1-a273-122512202173 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:59:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-31bfac84-afa4-4ad1-a273-122512202173 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:59:05 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-31bfac84-afa4-4ad1-a273-122512202173 tempest-ProjectMemberTests-1458770269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:59:05 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-31bfac84-afa4-4ad1-a273-122512202173 tempest-ProjectMemberTests-1458770269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:59:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-31bfac84-afa4-4ad1-a273-122512202173 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:59:05 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-31bfac84-afa4-4ad1-a273-122512202173 tempest-ProjectMemberTests-1458770269 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:59:05 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-31bfac84-afa4-4ad1-a273-122512202173 tempest-ProjectMemberTests-1458770269 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:59:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-31bfac84-afa4-4ad1-a273-122512202173 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:05 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3 1073741824 Jul 10 06:59:05 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:06 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-31bfac84-afa4-4ad1-a273-122512202173 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3 1073741824" returned: 0 in 0.832s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-31bfac84-afa4-4ad1-a273-122512202173 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:06 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3 Jul 10 06:59:06 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:07 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-31bfac84-afa4-4ad1-a273-122512202173 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3" returned: 0 in 0.705s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:07 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-31bfac84-afa4-4ad1-a273-122512202173 tempest-ProjectMemberTests-1458770269 None] <== create_volume: return (1585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:59:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-31bfac84-afa4-4ad1-a273-122512202173 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:59:07 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-31bfac84-afa4-4ad1-a273-122512202173 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1105eeb5-0253-4b6b-8747-a9f6e1f1cb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a60c377f-5bcb-4dbb-a71b-056694494ef3', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:07 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-31bfac84-afa4-4ad1-a273-122512202173 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c21efd78-6887-40e0-ad82-afd03c95a89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:07 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-31bfac84-afa4-4ad1-a273-122512202173 tempest-ProjectMemberTests-1458770269 None] Volume volume-a60c377f-5bcb-4dbb-a71b-056694494ef3 (a60c377f-5bcb-4dbb-a71b-056694494ef3): created successfully Jul 10 06:59:07 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-31bfac84-afa4-4ad1-a273-122512202173 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c21efd78-6887-40e0-ad82-afd03c95a89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:07 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-31bfac84-afa4-4ad1-a273-122512202173 tempest-ProjectMemberTests-1458770269 None] Flow 'volume_create_manager' (ef87f26b-72fd-462f-b97c-077034fc4680) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:59:07 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-31bfac84-afa4-4ad1-a273-122512202173 tempest-ProjectMemberTests-1458770269 None] Created volume successfully. Jul 10 06:59:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-05427527-67c8-4640-8989-fbbb74a31a73 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:59:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-05427527-67c8-4640-8989-fbbb74a31a73 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:59:07 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-05427527-67c8-4640-8989-fbbb74a31a73 tempest-ProjectMemberTests-1458770269 None] Creating offline snapshot 75fd5b7d-bb69-48a6-b083-36dcecffdba9 of volume a60c377f-5bcb-4dbb-a71b-056694494ef3 {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:59:07 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[02bd8990-e748-4328-b6ff-e5f04f86f893]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:59:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-05427527-67c8-4640-8989-fbbb74a31a73 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:08 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3 Jul 10 06:59:08 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:08 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-05427527-67c8-4640-8989-fbbb74a31a73 tempest-ProjectMemberTests-1458770269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3" returned: 0 in 0.780s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-05427527-67c8-4640-8989-fbbb74a31a73 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3.75fd5b7d-bb69-48a6-b083-36dcecffdba9 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:08 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3.75fd5b7d-bb69-48a6-b083-36dcecffdba9 1G Jul 10 06:59:08 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:09 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-05427527-67c8-4640-8989-fbbb74a31a73 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3.75fd5b7d-bb69-48a6-b083-36dcecffdba9 1G" returned: 0 in 0.857s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-05427527-67c8-4640-8989-fbbb74a31a73 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a60c377f-5bcb-4dbb-a71b-056694494ef3 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3.75fd5b7d-bb69-48a6-b083-36dcecffdba9 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:09 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a60c377f-5bcb-4dbb-a71b-056694494ef3 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3.75fd5b7d-bb69-48a6-b083-36dcecffdba9 Jul 10 06:59:09 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:10 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-05427527-67c8-4640-8989-fbbb74a31a73 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a60c377f-5bcb-4dbb-a71b-056694494ef3 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3.75fd5b7d-bb69-48a6-b083-36dcecffdba9" returned: 0 in 0.708s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:10 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-05427527-67c8-4640-8989-fbbb74a31a73 tempest-ProjectMemberTests-1458770269 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3.75fd5b7d-bb69-48a6-b083-36dcecffdba9 is being set with open permissions: ugo+rw Jul 10 06:59:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-05427527-67c8-4640-8989-fbbb74a31a73 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3.75fd5b7d-bb69-48a6-b083-36dcecffdba9 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:10 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3.75fd5b7d-bb69-48a6-b083-36dcecffdba9 Jul 10 06:59:10 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:10 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-05427527-67c8-4640-8989-fbbb74a31a73 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3.75fd5b7d-bb69-48a6-b083-36dcecffdba9" returned: 0 in 0.670s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-05427527-67c8-4640-8989-fbbb74a31a73 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:11 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3.info Jul 10 06:59:11 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:11 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-05427527-67c8-4640-8989-fbbb74a31a73 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3.info" returned: 0 in 0.737s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:11 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-05427527-67c8-4640-8989-fbbb74a31a73 tempest-ProjectMemberTests-1458770269 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3.info is being set with open permissions: ugo+rw Jul 10 06:59:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-05427527-67c8-4640-8989-fbbb74a31a73 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:11 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3.info Jul 10 06:59:11 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:12 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-05427527-67c8-4640-8989-fbbb74a31a73 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3.info" returned: 0 in 0.738s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-05427527-67c8-4640-8989-fbbb74a31a73 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.589s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:59:12 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-05427527-67c8-4640-8989-fbbb74a31a73 tempest-ProjectMemberTests-1458770269 None] Create snapshot completed successfully Jul 10 06:59:13 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-24443d82-5a55-41ca-9a45-12ba00c7344b tempest-ProjectMemberTests-1458770269 None] Acquiring lock "cinder-75fd5b7d-bb69-48a6-b083-36dcecffdba9-delete_snapshot" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:59:13 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-24443d82-5a55-41ca-9a45-12ba00c7344b tempest-ProjectMemberTests-1458770269 None] Lock "cinder-75fd5b7d-bb69-48a6-b083-36dcecffdba9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:59:13 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-24443d82-5a55-41ca-9a45-12ba00c7344b tempest-ProjectMemberTests-1458770269 None] Acquiring lock "cinder-quobyte-a60c377f-5bcb-4dbb-a71b-056694494ef3" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:59:13 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-24443d82-5a55-41ca-9a45-12ba00c7344b tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-a60c377f-5bcb-4dbb-a71b-056694494ef3" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:59:13 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-24443d82-5a55-41ca-9a45-12ba00c7344b tempest-ProjectMemberTests-1458770269 None] Acquiring lock "cinder-quobyte-75fd5b7d-bb69-48a6-b083-36dcecffdba9" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:59:13 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-24443d82-5a55-41ca-9a45-12ba00c7344b tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-75fd5b7d-bb69-48a6-b083-36dcecffdba9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:59:13 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-24443d82-5a55-41ca-9a45-12ba00c7344b tempest-ProjectMemberTests-1458770269 None] Deleting offline snapshot 75fd5b7d-bb69-48a6-b083-36dcecffdba9 of volume a60c377f-5bcb-4dbb-a71b-056694494ef3 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:59:13 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-24443d82-5a55-41ca-9a45-12ba00c7344b tempest-ProjectMemberTests-1458770269 None] snapshot_file for this snap is: volume-a60c377f-5bcb-4dbb-a71b-056694494ef3.75fd5b7d-bb69-48a6-b083-36dcecffdba9 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:59:13 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe9f585-b939-4aea-8556-763ce866e596]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:59:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-24443d82-5a55-41ca-9a45-12ba00c7344b tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3.75fd5b7d-bb69-48a6-b083-36dcecffdba9 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:13 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3.75fd5b7d-bb69-48a6-b083-36dcecffdba9 Jul 10 06:59:13 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:14 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-24443d82-5a55-41ca-9a45-12ba00c7344b tempest-ProjectMemberTests-1458770269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3.75fd5b7d-bb69-48a6-b083-36dcecffdba9" returned: 0 in 0.792s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:14 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-24443d82-5a55-41ca-9a45-12ba00c7344b tempest-ProjectMemberTests-1458770269 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a60c377f-5bcb-4dbb-a71b-056694494ef3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:59:14 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e32534-e571-4375-88f4-7641622d7d21]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:59:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-24443d82-5a55-41ca-9a45-12ba00c7344b tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:14 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3 Jul 10 06:59:14 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:14 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-24443d82-5a55-41ca-9a45-12ba00c7344b tempest-ProjectMemberTests-1458770269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3" returned: 0 in 0.733s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-24443d82-5a55-41ca-9a45-12ba00c7344b tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3.75fd5b7d-bb69-48a6-b083-36dcecffdba9 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:14 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3.75fd5b7d-bb69-48a6-b083-36dcecffdba9 Jul 10 06:59:14 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:15 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-24443d82-5a55-41ca-9a45-12ba00c7344b tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3.75fd5b7d-bb69-48a6-b083-36dcecffdba9" returned: 0 in 0.689s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-24443d82-5a55-41ca-9a45-12ba00c7344b tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3.75fd5b7d-bb69-48a6-b083-36dcecffdba9 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:15 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3.75fd5b7d-bb69-48a6-b083-36dcecffdba9 Jul 10 06:59:15 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:16 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-24443d82-5a55-41ca-9a45-12ba00c7344b tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3.75fd5b7d-bb69-48a6-b083-36dcecffdba9" returned: 0 in 0.600s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:16 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-24443d82-5a55-41ca-9a45-12ba00c7344b tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-75fd5b7d-bb69-48a6-b083-36dcecffdba9" released by "_delete_snapshot" :: held 2.906s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:16 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-24443d82-5a55-41ca-9a45-12ba00c7344b tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-a60c377f-5bcb-4dbb-a71b-056694494ef3" released by "delete_snapshot" :: held 2.929s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:16 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-24443d82-5a55-41ca-9a45-12ba00c7344b tempest-ProjectMemberTests-1458770269 None] Created reservations ['793965e0-719a-4240-bcd5-9fff26623a04', '5d263c7e-e4da-4339-af6f-17f836b94644', 'b1b2ea01-edb0-45d2-acef-98f4d5eb669f', '8e4bbc1a-3d5e-4b3e-9298-2f56d3d16fab'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:59:16 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-24443d82-5a55-41ca-9a45-12ba00c7344b tempest-ProjectMemberTests-1458770269 None] Delete snapshot completed successfully. Jul 10 06:59:16 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-24443d82-5a55-41ca-9a45-12ba00c7344b tempest-ProjectMemberTests-1458770269 None] Lock "cinder-75fd5b7d-bb69-48a6-b083-36dcecffdba9-delete_snapshot" released by "delete_snapshot" :: held 3.059s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:16 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-729379cc-4268-4ea2-87e6-8c2751e0c507 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "cinder-a60c377f-5bcb-4dbb-a71b-056694494ef3-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:59:16 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-729379cc-4268-4ea2-87e6-8c2751e0c507 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-a60c377f-5bcb-4dbb-a71b-056694494ef3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:59:16 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-729379cc-4268-4ea2-87e6-8c2751e0c507 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "cinder-quobyte-a60c377f-5bcb-4dbb-a71b-056694494ef3" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:59:16 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-729379cc-4268-4ea2-87e6-8c2751e0c507 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-a60c377f-5bcb-4dbb-a71b-056694494ef3" acquired by "delete_volume" :: waited 0.016s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:59:16 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5bebfc0-5564-4a02-96f1-cbb56db6f1e6]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:59:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-729379cc-4268-4ea2-87e6-8c2751e0c507 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:16 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3 Jul 10 06:59:16 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:17 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-729379cc-4268-4ea2-87e6-8c2751e0c507 tempest-ProjectMemberTests-1458770269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3" returned: 0 in 0.709s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-729379cc-4268-4ea2-87e6-8c2751e0c507 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:17 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3 Jul 10 06:59:17 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:17 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-729379cc-4268-4ea2-87e6-8c2751e0c507 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a60c377f-5bcb-4dbb-a71b-056694494ef3" returned: 0 in 0.635s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:17 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-729379cc-4268-4ea2-87e6-8c2751e0c507 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-a60c377f-5bcb-4dbb-a71b-056694494ef3" released by "delete_volume" :: held 1.397s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:17 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-729379cc-4268-4ea2-87e6-8c2751e0c507 tempest-ProjectMemberTests-1458770269 None] Created reservations ['79186ac8-e629-4d66-8ba5-bfb1645cefdc', '51337025-517d-4982-9f87-c0db2a01bb12', 'f94b382f-313f-4af6-883d-1bd5b6d9a84c', '1a0e1f5e-0a00-4ee7-9f32-46745b2d7652'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:59:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-729379cc-4268-4ea2-87e6-8c2751e0c507 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:59:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-729379cc-4268-4ea2-87e6-8c2751e0c507 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:59:17 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-729379cc-4268-4ea2-87e6-8c2751e0c507 tempest-ProjectMemberTests-1458770269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:59:17 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-729379cc-4268-4ea2-87e6-8c2751e0c507 tempest-ProjectMemberTests-1458770269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:59:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-729379cc-4268-4ea2-87e6-8c2751e0c507 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:59:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-729379cc-4268-4ea2-87e6-8c2751e0c507 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:17 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:59:17 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:18 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-729379cc-4268-4ea2-87e6-8c2751e0c507 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.623s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:18 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-729379cc-4268-4ea2-87e6-8c2751e0c507 tempest-ProjectMemberTests-1458770269 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:59:18 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-729379cc-4268-4ea2-87e6-8c2751e0c507 tempest-ProjectMemberTests-1458770269 None] Deleted volume successfully. Jul 10 06:59:18 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-729379cc-4268-4ea2-87e6-8c2751e0c507 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-a60c377f-5bcb-4dbb-a71b-056694494ef3-delete_volume" released by "delete_volume" :: held 2.207s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:19 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d74754e-a6aa-4661-bb82-d60f0b3ad965 tempest-ProjectMemberTests-1458770269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:59:19 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2d74754e-a6aa-4661-bb82-d60f0b3ad965 tempest-ProjectMemberTests-1458770269 None] Flow 'volume_create_manager' (0926650b-5770-4305-accd-e1fed337b5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:59:19 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2d74754e-a6aa-4661-bb82-d60f0b3ad965 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb2bcc1d-d343-478c-bbd4-09873eb3413b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:19 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2d74754e-a6aa-4661-bb82-d60f0b3ad965 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb2bcc1d-d343-478c-bbd4-09873eb3413b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1217587478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1582f0e-f8cd-4b64-91da-353307f27f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='215e832b6dbe42b49605af7a497c8dda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:59:19Z,use_quota=True,user_id='b5b28624cb0741588f7cc21f3c76f8e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:19 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2d74754e-a6aa-4661-bb82-d60f0b3ad965 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49416f00-41d9-424a-9514-0c9770d6180d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:19 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2d74754e-a6aa-4661-bb82-d60f0b3ad965 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49416f00-41d9-424a-9514-0c9770d6180d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:19 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2d74754e-a6aa-4661-bb82-d60f0b3ad965 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb5323a0-f44f-49ac-b50f-96d68cf9030e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:19 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2d74754e-a6aa-4661-bb82-d60f0b3ad965 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb5323a0-f44f-49ac-b50f-96d68cf9030e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1582f0e-f8cd-4b64-91da-353307f27f7e', 'volume_name': 'volume-f1582f0e-f8cd-4b64-91da-353307f27f7e', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:19 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2d74754e-a6aa-4661-bb82-d60f0b3ad965 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d103460-5f4a-4e42-bc61-aaa5ed7394d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:19 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2d74754e-a6aa-4661-bb82-d60f0b3ad965 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d103460-5f4a-4e42-bc61-aaa5ed7394d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:19 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2d74754e-a6aa-4661-bb82-d60f0b3ad965 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de3fdcf9-c72f-4350-b955-b69c2091be18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:19 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-2d74754e-a6aa-4661-bb82-d60f0b3ad965 tempest-ProjectMemberTests-1458770269 None] Volume f1582f0e-f8cd-4b64-91da-353307f27f7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1582f0e-f8cd-4b64-91da-353307f27f7e', 'volume_size': 1} Jul 10 06:59:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2d74754e-a6aa-4661-bb82-d60f0b3ad965 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:59:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2d74754e-a6aa-4661-bb82-d60f0b3ad965 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:59:19 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-2d74754e-a6aa-4661-bb82-d60f0b3ad965 tempest-ProjectMemberTests-1458770269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1217587478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1582f0e-f8cd-4b64-91da-353307f27f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='215e832b6dbe42b49605af7a497c8dda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:59:19Z,use_quota=True,user_id='b5b28624cb0741588f7cc21f3c76f8e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:59:19 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-2d74754e-a6aa-4661-bb82-d60f0b3ad965 tempest-ProjectMemberTests-1458770269 None] Creating volume f1582f0e-f8cd-4b64-91da-353307f27f7e {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:59:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2d74754e-a6aa-4661-bb82-d60f0b3ad965 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:59:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2d74754e-a6aa-4661-bb82-d60f0b3ad965 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:59:19 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-2d74754e-a6aa-4661-bb82-d60f0b3ad965 tempest-ProjectMemberTests-1458770269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:59:19 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-2d74754e-a6aa-4661-bb82-d60f0b3ad965 tempest-ProjectMemberTests-1458770269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:59:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2d74754e-a6aa-4661-bb82-d60f0b3ad965 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:59:19 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-2d74754e-a6aa-4661-bb82-d60f0b3ad965 tempest-ProjectMemberTests-1458770269 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:59:19 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-2d74754e-a6aa-4661-bb82-d60f0b3ad965 tempest-ProjectMemberTests-1458770269 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:59:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2d74754e-a6aa-4661-bb82-d60f0b3ad965 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:19 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e 1073741824 Jul 10 06:59:19 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:19 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2d74754e-a6aa-4661-bb82-d60f0b3ad965 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e 1073741824" returned: 0 in 0.774s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2d74754e-a6aa-4661-bb82-d60f0b3ad965 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:19 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e Jul 10 06:59:19 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:20 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-2d74754e-a6aa-4661-bb82-d60f0b3ad965 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e" returned: 0 in 0.604s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:20 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-2d74754e-a6aa-4661-bb82-d60f0b3ad965 tempest-ProjectMemberTests-1458770269 None] <== create_volume: return (1415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:59:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-2d74754e-a6aa-4661-bb82-d60f0b3ad965 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.418s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:59:20 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2d74754e-a6aa-4661-bb82-d60f0b3ad965 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de3fdcf9-c72f-4350-b955-b69c2091be18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1582f0e-f8cd-4b64-91da-353307f27f7e', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:20 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2d74754e-a6aa-4661-bb82-d60f0b3ad965 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b40261e-607e-45ee-8f3c-8df0c7314810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:20 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-2d74754e-a6aa-4661-bb82-d60f0b3ad965 tempest-ProjectMemberTests-1458770269 None] Volume volume-f1582f0e-f8cd-4b64-91da-353307f27f7e (f1582f0e-f8cd-4b64-91da-353307f27f7e): created successfully Jul 10 06:59:20 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2d74754e-a6aa-4661-bb82-d60f0b3ad965 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b40261e-607e-45ee-8f3c-8df0c7314810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:20 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-2d74754e-a6aa-4661-bb82-d60f0b3ad965 tempest-ProjectMemberTests-1458770269 None] Flow 'volume_create_manager' (0926650b-5770-4305-accd-e1fed337b5d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:59:20 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-2d74754e-a6aa-4661-bb82-d60f0b3ad965 tempest-ProjectMemberTests-1458770269 None] Created volume successfully. Jul 10 06:59:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9ed31c18-fd41-46b7-aba0-8c0799ef1eee tempest-ProjectMemberTests-1458770269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:59:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9ed31c18-fd41-46b7-aba0-8c0799ef1eee tempest-ProjectMemberTests-1458770269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:59:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-9ed31c18-fd41-46b7-aba0-8c0799ef1eee tempest-ProjectMemberTests-1458770269 None] Creating offline snapshot d587a135-f1e3-4918-9415-7d1993d3d800 of volume f1582f0e-f8cd-4b64-91da-353307f27f7e {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:59:21 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d101c8f-7486-4547-b825-ac07c3f320f0]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:59:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9ed31c18-fd41-46b7-aba0-8c0799ef1eee tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:21 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e Jul 10 06:59:21 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:21 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:59:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:59:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:59:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:59:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:59:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:59:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:21 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:59:21 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:22 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9ed31c18-fd41-46b7-aba0-8c0799ef1eee tempest-ProjectMemberTests-1458770269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e" returned: 0 in 0.737s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9ed31c18-fd41-46b7-aba0-8c0799ef1eee tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e.d587a135-f1e3-4918-9415-7d1993d3d800 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:22 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e.d587a135-f1e3-4918-9415-7d1993d3d800 1G Jul 10 06:59:22 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:22 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.643s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:22 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:59:22 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager._thread_info {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 06:59:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread count: 28 {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 06:59:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread info: [<_MainThread(MainThread, started 139245706264704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 06:59:22 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9ed31c18-fd41-46b7-aba0-8c0799ef1eee tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e.d587a135-f1e3-4918-9415-7d1993d3d800 1G" returned: 0 in 0.758s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9ed31c18-fd41-46b7-aba0-8c0799ef1eee tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1582f0e-f8cd-4b64-91da-353307f27f7e -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e.d587a135-f1e3-4918-9415-7d1993d3d800 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:22 devstack sudo[107081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1582f0e-f8cd-4b64-91da-353307f27f7e -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e.d587a135-f1e3-4918-9415-7d1993d3d800 Jul 10 06:59:22 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:23 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9ed31c18-fd41-46b7-aba0-8c0799ef1eee tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1582f0e-f8cd-4b64-91da-353307f27f7e -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e.d587a135-f1e3-4918-9415-7d1993d3d800" returned: 0 in 0.678s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:23 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-9ed31c18-fd41-46b7-aba0-8c0799ef1eee tempest-ProjectMemberTests-1458770269 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e.d587a135-f1e3-4918-9415-7d1993d3d800 is being set with open permissions: ugo+rw Jul 10 06:59:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9ed31c18-fd41-46b7-aba0-8c0799ef1eee tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e.d587a135-f1e3-4918-9415-7d1993d3d800 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:23 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e.d587a135-f1e3-4918-9415-7d1993d3d800 Jul 10 06:59:23 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:24 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9ed31c18-fd41-46b7-aba0-8c0799ef1eee tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e.d587a135-f1e3-4918-9415-7d1993d3d800" returned: 0 in 0.618s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9ed31c18-fd41-46b7-aba0-8c0799ef1eee tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:24 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e.info Jul 10 06:59:24 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:24 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9ed31c18-fd41-46b7-aba0-8c0799ef1eee tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e.info" returned: 0 in 0.603s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:24 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-9ed31c18-fd41-46b7-aba0-8c0799ef1eee tempest-ProjectMemberTests-1458770269 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e.info is being set with open permissions: ugo+rw Jul 10 06:59:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9ed31c18-fd41-46b7-aba0-8c0799ef1eee tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:24 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e.info Jul 10 06:59:24 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:25 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9ed31c18-fd41-46b7-aba0-8c0799ef1eee tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e.info" returned: 0 in 0.613s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9ed31c18-fd41-46b7-aba0-8c0799ef1eee tempest-ProjectMemberTests-1458770269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.087s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:59:25 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-9ed31c18-fd41-46b7-aba0-8c0799ef1eee tempest-ProjectMemberTests-1458770269 None] Create snapshot completed successfully Jul 10 06:59:26 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1843e8bc-974b-4007-bbed-2529dff08d56 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "cinder-d587a135-f1e3-4918-9415-7d1993d3d800-delete_snapshot" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:59:26 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1843e8bc-974b-4007-bbed-2529dff08d56 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-d587a135-f1e3-4918-9415-7d1993d3d800-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:59:26 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1843e8bc-974b-4007-bbed-2529dff08d56 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "cinder-quobyte-f1582f0e-f8cd-4b64-91da-353307f27f7e" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:59:26 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1843e8bc-974b-4007-bbed-2529dff08d56 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-f1582f0e-f8cd-4b64-91da-353307f27f7e" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:59:26 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1843e8bc-974b-4007-bbed-2529dff08d56 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "cinder-quobyte-d587a135-f1e3-4918-9415-7d1993d3d800" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:59:26 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1843e8bc-974b-4007-bbed-2529dff08d56 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-d587a135-f1e3-4918-9415-7d1993d3d800" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:59:26 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-1843e8bc-974b-4007-bbed-2529dff08d56 tempest-ProjectMemberTests-1458770269 None] Deleting offline snapshot d587a135-f1e3-4918-9415-7d1993d3d800 of volume f1582f0e-f8cd-4b64-91da-353307f27f7e {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:59:26 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-1843e8bc-974b-4007-bbed-2529dff08d56 tempest-ProjectMemberTests-1458770269 None] snapshot_file for this snap is: volume-f1582f0e-f8cd-4b64-91da-353307f27f7e.d587a135-f1e3-4918-9415-7d1993d3d800 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:59:26 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[f962ee50-b0b8-4daa-88f5-adacb93790f7]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:59:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1843e8bc-974b-4007-bbed-2529dff08d56 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e.d587a135-f1e3-4918-9415-7d1993d3d800 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:26 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e.d587a135-f1e3-4918-9415-7d1993d3d800 Jul 10 06:59:26 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:27 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1843e8bc-974b-4007-bbed-2529dff08d56 tempest-ProjectMemberTests-1458770269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e.d587a135-f1e3-4918-9415-7d1993d3d800" returned: 0 in 0.715s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:27 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-1843e8bc-974b-4007-bbed-2529dff08d56 tempest-ProjectMemberTests-1458770269 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1582f0e-f8cd-4b64-91da-353307f27f7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:59:27 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[18273efb-fb5f-4d7a-a5f3-4e108c3ea755]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:59:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1843e8bc-974b-4007-bbed-2529dff08d56 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:27 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e Jul 10 06:59:27 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:28 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1843e8bc-974b-4007-bbed-2529dff08d56 tempest-ProjectMemberTests-1458770269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e" returned: 0 in 0.710s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1843e8bc-974b-4007-bbed-2529dff08d56 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e.d587a135-f1e3-4918-9415-7d1993d3d800 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:28 devstack sudo[107142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e.d587a135-f1e3-4918-9415-7d1993d3d800 Jul 10 06:59:28 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:28 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1843e8bc-974b-4007-bbed-2529dff08d56 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e.d587a135-f1e3-4918-9415-7d1993d3d800" returned: 0 in 0.690s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1843e8bc-974b-4007-bbed-2529dff08d56 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e.d587a135-f1e3-4918-9415-7d1993d3d800 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:28 devstack sudo[107147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e.d587a135-f1e3-4918-9415-7d1993d3d800 Jul 10 06:59:28 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:29 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1843e8bc-974b-4007-bbed-2529dff08d56 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e.d587a135-f1e3-4918-9415-7d1993d3d800" returned: 0 in 0.600s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:29 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1843e8bc-974b-4007-bbed-2529dff08d56 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-d587a135-f1e3-4918-9415-7d1993d3d800" released by "_delete_snapshot" :: held 2.796s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:29 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1843e8bc-974b-4007-bbed-2529dff08d56 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-f1582f0e-f8cd-4b64-91da-353307f27f7e" released by "delete_snapshot" :: held 2.815s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:29 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-1843e8bc-974b-4007-bbed-2529dff08d56 tempest-ProjectMemberTests-1458770269 None] Created reservations ['578a54ed-add6-43eb-9b59-b875b6073242', 'dbe81142-a76a-49dc-b0a7-e7567ef54fae', 'b8fc0c37-a846-49ad-86d6-1b1d46114579', 'de1c669f-d20d-41a9-89aa-68a62387db2f'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:59:29 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-1843e8bc-974b-4007-bbed-2529dff08d56 tempest-ProjectMemberTests-1458770269 None] Delete snapshot completed successfully. Jul 10 06:59:29 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1843e8bc-974b-4007-bbed-2529dff08d56 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-d587a135-f1e3-4918-9415-7d1993d3d800-delete_snapshot" released by "delete_snapshot" :: held 2.933s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:29 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f6122a47-7301-441a-b75c-717490fc8225 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "cinder-f1582f0e-f8cd-4b64-91da-353307f27f7e-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:59:29 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f6122a47-7301-441a-b75c-717490fc8225 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-f1582f0e-f8cd-4b64-91da-353307f27f7e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:59:29 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f6122a47-7301-441a-b75c-717490fc8225 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "cinder-quobyte-f1582f0e-f8cd-4b64-91da-353307f27f7e" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:59:29 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f6122a47-7301-441a-b75c-717490fc8225 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-f1582f0e-f8cd-4b64-91da-353307f27f7e" acquired by "delete_volume" :: waited 0.014s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:59:29 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f9e6ef-1cf6-4aad-8bb3-0a683e0853d1]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:59:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f6122a47-7301-441a-b75c-717490fc8225 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:29 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e Jul 10 06:59:29 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:30 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f6122a47-7301-441a-b75c-717490fc8225 tempest-ProjectMemberTests-1458770269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e" returned: 0 in 0.712s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f6122a47-7301-441a-b75c-717490fc8225 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:30 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e Jul 10 06:59:30 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:31 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f6122a47-7301-441a-b75c-717490fc8225 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-f1582f0e-f8cd-4b64-91da-353307f27f7e" returned: 0 in 0.608s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:31 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f6122a47-7301-441a-b75c-717490fc8225 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-f1582f0e-f8cd-4b64-91da-353307f27f7e" released by "delete_volume" :: held 1.375s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:31 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-f6122a47-7301-441a-b75c-717490fc8225 tempest-ProjectMemberTests-1458770269 None] Created reservations ['6f6d4541-6ce6-41b1-91a3-cb80410a64d3', 'eedf80a5-ea2e-4be1-854a-17f6cb6db79d', '071645f0-dcae-470e-8026-3b2717df1f88', '80b3438d-8978-42e6-979f-c8f2a91c45c6'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:59:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f6122a47-7301-441a-b75c-717490fc8225 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:59:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f6122a47-7301-441a-b75c-717490fc8225 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:59:31 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f6122a47-7301-441a-b75c-717490fc8225 tempest-ProjectMemberTests-1458770269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:59:31 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f6122a47-7301-441a-b75c-717490fc8225 tempest-ProjectMemberTests-1458770269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:59:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f6122a47-7301-441a-b75c-717490fc8225 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:59:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f6122a47-7301-441a-b75c-717490fc8225 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:31 devstack sudo[107159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:59:31 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:31 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f6122a47-7301-441a-b75c-717490fc8225 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.622s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:31 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-f6122a47-7301-441a-b75c-717490fc8225 tempest-ProjectMemberTests-1458770269 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:59:31 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-f6122a47-7301-441a-b75c-717490fc8225 tempest-ProjectMemberTests-1458770269 None] Deleted volume successfully. Jul 10 06:59:31 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-f6122a47-7301-441a-b75c-717490fc8225 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-f1582f0e-f8cd-4b64-91da-353307f27f7e-delete_volume" released by "delete_volume" :: held 2.173s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:32 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-73a17d58-08db-4d28-a267-e6dc90286ea2 tempest-ProjectMemberTests-1458770269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:59:32 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-73a17d58-08db-4d28-a267-e6dc90286ea2 tempest-ProjectMemberTests-1458770269 None] Flow 'volume_create_manager' (6faf1aa2-4118-4fa1-9eca-950c668f096d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:59:32 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-73a17d58-08db-4d28-a267-e6dc90286ea2 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21be2bc9-013e-4155-b4a4-7d586b84d5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:32 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-73a17d58-08db-4d28-a267-e6dc90286ea2 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21be2bc9-013e-4155-b4a4-7d586b84d5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:59:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-426255362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b2cc397-60de-4822-8162-a15e04fd13f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='215e832b6dbe42b49605af7a497c8dda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:59:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:59:32Z,use_quota=True,user_id='b5b28624cb0741588f7cc21f3c76f8e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:32 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-73a17d58-08db-4d28-a267-e6dc90286ea2 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef953296-8e36-44e2-97ad-614c479ff8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:32 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-73a17d58-08db-4d28-a267-e6dc90286ea2 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef953296-8e36-44e2-97ad-614c479ff8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:32 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-73a17d58-08db-4d28-a267-e6dc90286ea2 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c54d2d0-df90-49f6-8c82-0e918ed3f6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:32 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-73a17d58-08db-4d28-a267-e6dc90286ea2 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c54d2d0-df90-49f6-8c82-0e918ed3f6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b2cc397-60de-4822-8162-a15e04fd13f6', 'volume_name': 'volume-0b2cc397-60de-4822-8162-a15e04fd13f6', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:32 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-73a17d58-08db-4d28-a267-e6dc90286ea2 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3029c89-2c78-4d82-a092-dd8a8b71de13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:32 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-73a17d58-08db-4d28-a267-e6dc90286ea2 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3029c89-2c78-4d82-a092-dd8a8b71de13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:32 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-73a17d58-08db-4d28-a267-e6dc90286ea2 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f6f54d0-f89b-4afb-a956-961265ee72c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:32 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-73a17d58-08db-4d28-a267-e6dc90286ea2 tempest-ProjectMemberTests-1458770269 None] Volume 0b2cc397-60de-4822-8162-a15e04fd13f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b2cc397-60de-4822-8162-a15e04fd13f6', 'volume_size': 1} Jul 10 06:59:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-73a17d58-08db-4d28-a267-e6dc90286ea2 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:59:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-73a17d58-08db-4d28-a267-e6dc90286ea2 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:59:32 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-73a17d58-08db-4d28-a267-e6dc90286ea2 tempest-ProjectMemberTests-1458770269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:59:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-426255362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b2cc397-60de-4822-8162-a15e04fd13f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='215e832b6dbe42b49605af7a497c8dda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:59:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:59:32Z,use_quota=True,user_id='b5b28624cb0741588f7cc21f3c76f8e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:59:32 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-73a17d58-08db-4d28-a267-e6dc90286ea2 tempest-ProjectMemberTests-1458770269 None] Creating volume 0b2cc397-60de-4822-8162-a15e04fd13f6 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:59:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-73a17d58-08db-4d28-a267-e6dc90286ea2 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:59:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-73a17d58-08db-4d28-a267-e6dc90286ea2 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:59:32 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-73a17d58-08db-4d28-a267-e6dc90286ea2 tempest-ProjectMemberTests-1458770269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:59:32 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-73a17d58-08db-4d28-a267-e6dc90286ea2 tempest-ProjectMemberTests-1458770269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:59:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-73a17d58-08db-4d28-a267-e6dc90286ea2 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:59:32 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-73a17d58-08db-4d28-a267-e6dc90286ea2 tempest-ProjectMemberTests-1458770269 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:59:32 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-73a17d58-08db-4d28-a267-e6dc90286ea2 tempest-ProjectMemberTests-1458770269 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:59:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-73a17d58-08db-4d28-a267-e6dc90286ea2 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:32 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6 1073741824 Jul 10 06:59:32 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:33 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-73a17d58-08db-4d28-a267-e6dc90286ea2 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6 1073741824" returned: 0 in 0.752s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-73a17d58-08db-4d28-a267-e6dc90286ea2 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:33 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6 Jul 10 06:59:33 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:33 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-73a17d58-08db-4d28-a267-e6dc90286ea2 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6" returned: 0 in 0.601s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:33 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-73a17d58-08db-4d28-a267-e6dc90286ea2 tempest-ProjectMemberTests-1458770269 None] <== create_volume: return (1389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:59:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-73a17d58-08db-4d28-a267-e6dc90286ea2 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:59:33 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-73a17d58-08db-4d28-a267-e6dc90286ea2 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f6f54d0-f89b-4afb-a956-961265ee72c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b2cc397-60de-4822-8162-a15e04fd13f6', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:33 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-73a17d58-08db-4d28-a267-e6dc90286ea2 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (773cbeac-2def-44ef-ad4e-61cbe0727160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:33 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-73a17d58-08db-4d28-a267-e6dc90286ea2 tempest-ProjectMemberTests-1458770269 None] Volume volume-0b2cc397-60de-4822-8162-a15e04fd13f6 (0b2cc397-60de-4822-8162-a15e04fd13f6): created successfully Jul 10 06:59:33 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-73a17d58-08db-4d28-a267-e6dc90286ea2 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (773cbeac-2def-44ef-ad4e-61cbe0727160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:33 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-73a17d58-08db-4d28-a267-e6dc90286ea2 tempest-ProjectMemberTests-1458770269 None] Flow 'volume_create_manager' (6faf1aa2-4118-4fa1-9eca-950c668f096d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:59:33 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-73a17d58-08db-4d28-a267-e6dc90286ea2 tempest-ProjectMemberTests-1458770269 None] Created volume successfully. Jul 10 06:59:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-15466d7b-1a1d-4398-9021-db4130b1564b tempest-ProjectMemberTests-1458770269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:59:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-15466d7b-1a1d-4398-9021-db4130b1564b tempest-ProjectMemberTests-1458770269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:59:34 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-15466d7b-1a1d-4398-9021-db4130b1564b tempest-ProjectMemberTests-1458770269 None] Creating offline snapshot 20cc9926-3180-4815-93c0-4db2e2b4769e of volume 0b2cc397-60de-4822-8162-a15e04fd13f6 {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:59:34 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f2ecd0-17e9-4bb1-a14f-a46d1c23db5d]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:59:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-15466d7b-1a1d-4398-9021-db4130b1564b tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:34 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6 Jul 10 06:59:34 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:35 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-15466d7b-1a1d-4398-9021-db4130b1564b tempest-ProjectMemberTests-1458770269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6" returned: 0 in 0.743s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-15466d7b-1a1d-4398-9021-db4130b1564b tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6.20cc9926-3180-4815-93c0-4db2e2b4769e 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:35 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6.20cc9926-3180-4815-93c0-4db2e2b4769e 1G Jul 10 06:59:35 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:36 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-15466d7b-1a1d-4398-9021-db4130b1564b tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6.20cc9926-3180-4815-93c0-4db2e2b4769e 1G" returned: 0 in 0.781s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-15466d7b-1a1d-4398-9021-db4130b1564b tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b2cc397-60de-4822-8162-a15e04fd13f6 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6.20cc9926-3180-4815-93c0-4db2e2b4769e {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:36 devstack sudo[107187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b2cc397-60de-4822-8162-a15e04fd13f6 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6.20cc9926-3180-4815-93c0-4db2e2b4769e Jul 10 06:59:36 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:36 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-15466d7b-1a1d-4398-9021-db4130b1564b tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b2cc397-60de-4822-8162-a15e04fd13f6 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6.20cc9926-3180-4815-93c0-4db2e2b4769e" returned: 0 in 0.643s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:36 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-15466d7b-1a1d-4398-9021-db4130b1564b tempest-ProjectMemberTests-1458770269 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6.20cc9926-3180-4815-93c0-4db2e2b4769e is being set with open permissions: ugo+rw Jul 10 06:59:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-15466d7b-1a1d-4398-9021-db4130b1564b tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6.20cc9926-3180-4815-93c0-4db2e2b4769e {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:36 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6.20cc9926-3180-4815-93c0-4db2e2b4769e Jul 10 06:59:36 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:37 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-15466d7b-1a1d-4398-9021-db4130b1564b tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6.20cc9926-3180-4815-93c0-4db2e2b4769e" returned: 0 in 0.615s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-15466d7b-1a1d-4398-9021-db4130b1564b tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:37 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6.info Jul 10 06:59:37 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:37 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-15466d7b-1a1d-4398-9021-db4130b1564b tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6.info" returned: 0 in 0.616s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:37 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-15466d7b-1a1d-4398-9021-db4130b1564b tempest-ProjectMemberTests-1458770269 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6.info is being set with open permissions: ugo+rw Jul 10 06:59:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-15466d7b-1a1d-4398-9021-db4130b1564b tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:37 devstack sudo[107198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6.info Jul 10 06:59:37 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:38 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-15466d7b-1a1d-4398-9021-db4130b1564b tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6.info" returned: 0 in 0.625s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-15466d7b-1a1d-4398-9021-db4130b1564b tempest-ProjectMemberTests-1458770269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.099s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:59:38 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-15466d7b-1a1d-4398-9021-db4130b1564b tempest-ProjectMemberTests-1458770269 None] Create snapshot completed successfully Jul 10 06:59:39 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-413fa230-f1b1-4d51-8a9c-c9fc79547099 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "cinder-20cc9926-3180-4815-93c0-4db2e2b4769e-delete_snapshot" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:59:39 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-413fa230-f1b1-4d51-8a9c-c9fc79547099 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-20cc9926-3180-4815-93c0-4db2e2b4769e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:59:39 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-413fa230-f1b1-4d51-8a9c-c9fc79547099 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "cinder-quobyte-0b2cc397-60de-4822-8162-a15e04fd13f6" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:59:39 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-413fa230-f1b1-4d51-8a9c-c9fc79547099 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-0b2cc397-60de-4822-8162-a15e04fd13f6" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:59:39 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-413fa230-f1b1-4d51-8a9c-c9fc79547099 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "cinder-quobyte-20cc9926-3180-4815-93c0-4db2e2b4769e" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:59:39 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-413fa230-f1b1-4d51-8a9c-c9fc79547099 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-20cc9926-3180-4815-93c0-4db2e2b4769e" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:59:39 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-413fa230-f1b1-4d51-8a9c-c9fc79547099 tempest-ProjectMemberTests-1458770269 None] Deleting offline snapshot 20cc9926-3180-4815-93c0-4db2e2b4769e of volume 0b2cc397-60de-4822-8162-a15e04fd13f6 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:59:39 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-413fa230-f1b1-4d51-8a9c-c9fc79547099 tempest-ProjectMemberTests-1458770269 None] snapshot_file for this snap is: volume-0b2cc397-60de-4822-8162-a15e04fd13f6.20cc9926-3180-4815-93c0-4db2e2b4769e {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:59:39 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ccf1b8-fe80-4793-9b46-a2f301d918dc]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:59:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-413fa230-f1b1-4d51-8a9c-c9fc79547099 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6.20cc9926-3180-4815-93c0-4db2e2b4769e {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:39 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6.20cc9926-3180-4815-93c0-4db2e2b4769e Jul 10 06:59:39 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:40 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-413fa230-f1b1-4d51-8a9c-c9fc79547099 tempest-ProjectMemberTests-1458770269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6.20cc9926-3180-4815-93c0-4db2e2b4769e" returned: 0 in 0.746s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:40 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-413fa230-f1b1-4d51-8a9c-c9fc79547099 tempest-ProjectMemberTests-1458770269 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b2cc397-60de-4822-8162-a15e04fd13f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:59:40 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[75939462-3e70-4f79-8e46-f699172d16a9]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:59:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-413fa230-f1b1-4d51-8a9c-c9fc79547099 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:40 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6 Jul 10 06:59:40 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:41 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-413fa230-f1b1-4d51-8a9c-c9fc79547099 tempest-ProjectMemberTests-1458770269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6" returned: 0 in 0.716s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-413fa230-f1b1-4d51-8a9c-c9fc79547099 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6.20cc9926-3180-4815-93c0-4db2e2b4769e {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:41 devstack sudo[107213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6.20cc9926-3180-4815-93c0-4db2e2b4769e Jul 10 06:59:41 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:41 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-413fa230-f1b1-4d51-8a9c-c9fc79547099 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6.20cc9926-3180-4815-93c0-4db2e2b4769e" returned: 0 in 0.687s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-413fa230-f1b1-4d51-8a9c-c9fc79547099 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6.20cc9926-3180-4815-93c0-4db2e2b4769e {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:41 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6.20cc9926-3180-4815-93c0-4db2e2b4769e Jul 10 06:59:41 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:42 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-413fa230-f1b1-4d51-8a9c-c9fc79547099 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6.20cc9926-3180-4815-93c0-4db2e2b4769e" returned: 0 in 0.610s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-413fa230-f1b1-4d51-8a9c-c9fc79547099 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-20cc9926-3180-4815-93c0-4db2e2b4769e" released by "_delete_snapshot" :: held 2.841s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-413fa230-f1b1-4d51-8a9c-c9fc79547099 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-0b2cc397-60de-4822-8162-a15e04fd13f6" released by "delete_snapshot" :: held 2.860s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:42 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-413fa230-f1b1-4d51-8a9c-c9fc79547099 tempest-ProjectMemberTests-1458770269 None] Created reservations ['b0911b54-ed68-472e-8916-464c3518ce39', '3d2692b1-340a-42b8-8a38-58ac5c3aa61c', 'a4ee77cb-6b48-4bda-a3e7-a53bc120eccf', 'ec57e84e-6fb7-4d5a-9633-118a8fae54d3'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:59:42 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-413fa230-f1b1-4d51-8a9c-c9fc79547099 tempest-ProjectMemberTests-1458770269 None] Delete snapshot completed successfully. Jul 10 06:59:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-413fa230-f1b1-4d51-8a9c-c9fc79547099 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-20cc9926-3180-4815-93c0-4db2e2b4769e-delete_snapshot" released by "delete_snapshot" :: held 2.984s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6a065a83-809d-411c-8d40-4c1212ff0055 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "cinder-0b2cc397-60de-4822-8162-a15e04fd13f6-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:59:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6a065a83-809d-411c-8d40-4c1212ff0055 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-0b2cc397-60de-4822-8162-a15e04fd13f6-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:59:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6a065a83-809d-411c-8d40-4c1212ff0055 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "cinder-quobyte-0b2cc397-60de-4822-8162-a15e04fd13f6" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:59:42 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6a065a83-809d-411c-8d40-4c1212ff0055 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-0b2cc397-60de-4822-8162-a15e04fd13f6" acquired by "delete_volume" :: waited 0.015s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:59:42 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[e644c0fc-f592-41a4-99c2-848fd35e8ce6]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:59:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6a065a83-809d-411c-8d40-4c1212ff0055 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:43 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6 Jul 10 06:59:43 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:43 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6a065a83-809d-411c-8d40-4c1212ff0055 tempest-ProjectMemberTests-1458770269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6" returned: 0 in 0.737s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6a065a83-809d-411c-8d40-4c1212ff0055 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:43 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6 Jul 10 06:59:43 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:44 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6a065a83-809d-411c-8d40-4c1212ff0055 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0b2cc397-60de-4822-8162-a15e04fd13f6" returned: 0 in 0.604s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:44 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6a065a83-809d-411c-8d40-4c1212ff0055 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-0b2cc397-60de-4822-8162-a15e04fd13f6" released by "delete_volume" :: held 1.391s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:44 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-6a065a83-809d-411c-8d40-4c1212ff0055 tempest-ProjectMemberTests-1458770269 None] Created reservations ['88a5bd3a-528f-416e-bf41-104f0e96efb8', 'ffff02b8-86cb-4a68-a976-a1a702cdf10d', 'e88d1598-0f2c-4586-ad43-837a1661ff6f', '367b16dd-54c1-440d-a5e8-2b4a37aea39f'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:59:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-6a065a83-809d-411c-8d40-4c1212ff0055 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:59:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-6a065a83-809d-411c-8d40-4c1212ff0055 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:59:44 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-6a065a83-809d-411c-8d40-4c1212ff0055 tempest-ProjectMemberTests-1458770269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:59:44 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-6a065a83-809d-411c-8d40-4c1212ff0055 tempest-ProjectMemberTests-1458770269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:59:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-6a065a83-809d-411c-8d40-4c1212ff0055 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:59:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6a065a83-809d-411c-8d40-4c1212ff0055 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:44 devstack sudo[107229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:59:44 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:45 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-6a065a83-809d-411c-8d40-4c1212ff0055 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.610s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:45 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-6a065a83-809d-411c-8d40-4c1212ff0055 tempest-ProjectMemberTests-1458770269 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:59:45 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-6a065a83-809d-411c-8d40-4c1212ff0055 tempest-ProjectMemberTests-1458770269 None] Deleted volume successfully. Jul 10 06:59:45 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-6a065a83-809d-411c-8d40-4c1212ff0055 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-0b2cc397-60de-4822-8162-a15e04fd13f6-delete_volume" released by "delete_volume" :: held 2.182s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:45 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-262b3805-3d06-450d-b7e9-f04ac2682441 tempest-ProjectMemberTests-1458770269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:59:45 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-262b3805-3d06-450d-b7e9-f04ac2682441 tempest-ProjectMemberTests-1458770269 None] Flow 'volume_create_manager' (ef1751a7-413a-4266-bd2f-184d72c51cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:59:45 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-262b3805-3d06-450d-b7e9-f04ac2682441 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d68e5b9e-03a8-41ad-8a09-8afafd77ded6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:45 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-262b3805-3d06-450d-b7e9-f04ac2682441 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d68e5b9e-03a8-41ad-8a09-8afafd77ded6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:59:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-546987921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e765aede-d157-473a-a226-0ef891dc0bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='215e832b6dbe42b49605af7a497c8dda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:59:45Z,use_quota=True,user_id='b5b28624cb0741588f7cc21f3c76f8e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:45 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-262b3805-3d06-450d-b7e9-f04ac2682441 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (676dcb28-fbc4-4a3e-a843-c53074b51acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:45 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-262b3805-3d06-450d-b7e9-f04ac2682441 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (676dcb28-fbc4-4a3e-a843-c53074b51acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:45 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-262b3805-3d06-450d-b7e9-f04ac2682441 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c6ed429-4ff7-483f-8e5e-82f5ea0ea3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:45 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-262b3805-3d06-450d-b7e9-f04ac2682441 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c6ed429-4ff7-483f-8e5e-82f5ea0ea3f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e765aede-d157-473a-a226-0ef891dc0bc1', 'volume_name': 'volume-e765aede-d157-473a-a226-0ef891dc0bc1', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:45 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-262b3805-3d06-450d-b7e9-f04ac2682441 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (891b8bde-324d-4b6b-aedd-69a2642f8bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:45 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-262b3805-3d06-450d-b7e9-f04ac2682441 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (891b8bde-324d-4b6b-aedd-69a2642f8bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:45 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-262b3805-3d06-450d-b7e9-f04ac2682441 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b6205b-022c-44e2-863b-793e6ba2ecc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:45 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-262b3805-3d06-450d-b7e9-f04ac2682441 tempest-ProjectMemberTests-1458770269 None] Volume e765aede-d157-473a-a226-0ef891dc0bc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e765aede-d157-473a-a226-0ef891dc0bc1', 'volume_size': 1} Jul 10 06:59:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-262b3805-3d06-450d-b7e9-f04ac2682441 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:59:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-262b3805-3d06-450d-b7e9-f04ac2682441 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:59:45 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-262b3805-3d06-450d-b7e9-f04ac2682441 tempest-ProjectMemberTests-1458770269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:59:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-546987921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e765aede-d157-473a-a226-0ef891dc0bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='215e832b6dbe42b49605af7a497c8dda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:59:45Z,use_quota=True,user_id='b5b28624cb0741588f7cc21f3c76f8e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:59:45 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-262b3805-3d06-450d-b7e9-f04ac2682441 tempest-ProjectMemberTests-1458770269 None] Creating volume e765aede-d157-473a-a226-0ef891dc0bc1 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:59:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-262b3805-3d06-450d-b7e9-f04ac2682441 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:59:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-262b3805-3d06-450d-b7e9-f04ac2682441 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:59:45 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-262b3805-3d06-450d-b7e9-f04ac2682441 tempest-ProjectMemberTests-1458770269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:59:45 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-262b3805-3d06-450d-b7e9-f04ac2682441 tempest-ProjectMemberTests-1458770269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:59:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-262b3805-3d06-450d-b7e9-f04ac2682441 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:59:45 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-262b3805-3d06-450d-b7e9-f04ac2682441 tempest-ProjectMemberTests-1458770269 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:59:45 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-262b3805-3d06-450d-b7e9-f04ac2682441 tempest-ProjectMemberTests-1458770269 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:59:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-262b3805-3d06-450d-b7e9-f04ac2682441 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:45 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1 1073741824 Jul 10 06:59:45 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:46 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-262b3805-3d06-450d-b7e9-f04ac2682441 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1 1073741824" returned: 0 in 0.777s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-262b3805-3d06-450d-b7e9-f04ac2682441 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:46 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1 Jul 10 06:59:46 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:46 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-262b3805-3d06-450d-b7e9-f04ac2682441 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1" returned: 0 in 0.608s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:46 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-262b3805-3d06-450d-b7e9-f04ac2682441 tempest-ProjectMemberTests-1458770269 None] <== create_volume: return (1423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:59:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-262b3805-3d06-450d-b7e9-f04ac2682441 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.425s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:59:47 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-262b3805-3d06-450d-b7e9-f04ac2682441 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b6205b-022c-44e2-863b-793e6ba2ecc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e765aede-d157-473a-a226-0ef891dc0bc1', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:47 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-262b3805-3d06-450d-b7e9-f04ac2682441 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce72e895-a21b-4482-911a-43254e5a3218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:47 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-262b3805-3d06-450d-b7e9-f04ac2682441 tempest-ProjectMemberTests-1458770269 None] Volume volume-e765aede-d157-473a-a226-0ef891dc0bc1 (e765aede-d157-473a-a226-0ef891dc0bc1): created successfully Jul 10 06:59:47 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-262b3805-3d06-450d-b7e9-f04ac2682441 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce72e895-a21b-4482-911a-43254e5a3218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:47 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-262b3805-3d06-450d-b7e9-f04ac2682441 tempest-ProjectMemberTests-1458770269 None] Flow 'volume_create_manager' (ef1751a7-413a-4266-bd2f-184d72c51cd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:59:47 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-262b3805-3d06-450d-b7e9-f04ac2682441 tempest-ProjectMemberTests-1458770269 None] Created volume successfully. Jul 10 06:59:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d0986bd1-beaa-4c63-a65f-f5313beef16a tempest-ProjectMemberTests-1458770269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:59:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d0986bd1-beaa-4c63-a65f-f5313beef16a tempest-ProjectMemberTests-1458770269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:59:47 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-d0986bd1-beaa-4c63-a65f-f5313beef16a tempest-ProjectMemberTests-1458770269 None] Creating offline snapshot b423cc5a-4b13-4ab7-9301-b7fb1a1e96c4 of volume e765aede-d157-473a-a226-0ef891dc0bc1 {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:59:47 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[176cd241-e7a8-42a1-918d-4ddda567e4ed]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:59:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d0986bd1-beaa-4c63-a65f-f5313beef16a tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:47 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1 Jul 10 06:59:47 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:48 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d0986bd1-beaa-4c63-a65f-f5313beef16a tempest-ProjectMemberTests-1458770269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1" returned: 0 in 0.706s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d0986bd1-beaa-4c63-a65f-f5313beef16a tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1.b423cc5a-4b13-4ab7-9301-b7fb1a1e96c4 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:48 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1.b423cc5a-4b13-4ab7-9301-b7fb1a1e96c4 1G Jul 10 06:59:48 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:49 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d0986bd1-beaa-4c63-a65f-f5313beef16a tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1.b423cc5a-4b13-4ab7-9301-b7fb1a1e96c4 1G" returned: 0 in 0.739s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d0986bd1-beaa-4c63-a65f-f5313beef16a tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e765aede-d157-473a-a226-0ef891dc0bc1 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1.b423cc5a-4b13-4ab7-9301-b7fb1a1e96c4 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:49 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e765aede-d157-473a-a226-0ef891dc0bc1 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1.b423cc5a-4b13-4ab7-9301-b7fb1a1e96c4 Jul 10 06:59:49 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:49 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d0986bd1-beaa-4c63-a65f-f5313beef16a tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e765aede-d157-473a-a226-0ef891dc0bc1 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1.b423cc5a-4b13-4ab7-9301-b7fb1a1e96c4" returned: 0 in 0.666s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:49 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-d0986bd1-beaa-4c63-a65f-f5313beef16a tempest-ProjectMemberTests-1458770269 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1.b423cc5a-4b13-4ab7-9301-b7fb1a1e96c4 is being set with open permissions: ugo+rw Jul 10 06:59:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d0986bd1-beaa-4c63-a65f-f5313beef16a tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1.b423cc5a-4b13-4ab7-9301-b7fb1a1e96c4 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:49 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1.b423cc5a-4b13-4ab7-9301-b7fb1a1e96c4 Jul 10 06:59:49 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:50 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d0986bd1-beaa-4c63-a65f-f5313beef16a tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1.b423cc5a-4b13-4ab7-9301-b7fb1a1e96c4" returned: 0 in 0.621s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d0986bd1-beaa-4c63-a65f-f5313beef16a tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:50 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1.info Jul 10 06:59:50 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:51 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d0986bd1-beaa-4c63-a65f-f5313beef16a tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1.info" returned: 0 in 0.620s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:51 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-d0986bd1-beaa-4c63-a65f-f5313beef16a tempest-ProjectMemberTests-1458770269 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1.info is being set with open permissions: ugo+rw Jul 10 06:59:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d0986bd1-beaa-4c63-a65f-f5313beef16a tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:51 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1.info Jul 10 06:59:51 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:51 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-d0986bd1-beaa-4c63-a65f-f5313beef16a tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1.info" returned: 0 in 0.601s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-d0986bd1-beaa-4c63-a65f-f5313beef16a tempest-ProjectMemberTests-1458770269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.028s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:59:51 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-d0986bd1-beaa-4c63-a65f-f5313beef16a tempest-ProjectMemberTests-1458770269 None] Create snapshot completed successfully Jul 10 06:59:51 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-68a1756e-4c53-4583-a97d-0c2425fc9a3a tempest-ProjectMemberTests-1458770269 None] Acquiring lock "cinder-b423cc5a-4b13-4ab7-9301-b7fb1a1e96c4-delete_snapshot" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:59:51 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-68a1756e-4c53-4583-a97d-0c2425fc9a3a tempest-ProjectMemberTests-1458770269 None] Lock "cinder-b423cc5a-4b13-4ab7-9301-b7fb1a1e96c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:59:51 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-68a1756e-4c53-4583-a97d-0c2425fc9a3a tempest-ProjectMemberTests-1458770269 None] Acquiring lock "cinder-quobyte-e765aede-d157-473a-a226-0ef891dc0bc1" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:59:51 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-68a1756e-4c53-4583-a97d-0c2425fc9a3a tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-e765aede-d157-473a-a226-0ef891dc0bc1" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:59:51 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-68a1756e-4c53-4583-a97d-0c2425fc9a3a tempest-ProjectMemberTests-1458770269 None] Acquiring lock "cinder-quobyte-b423cc5a-4b13-4ab7-9301-b7fb1a1e96c4" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:59:51 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-68a1756e-4c53-4583-a97d-0c2425fc9a3a tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-b423cc5a-4b13-4ab7-9301-b7fb1a1e96c4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:59:51 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-68a1756e-4c53-4583-a97d-0c2425fc9a3a tempest-ProjectMemberTests-1458770269 None] Deleting offline snapshot b423cc5a-4b13-4ab7-9301-b7fb1a1e96c4 of volume e765aede-d157-473a-a226-0ef891dc0bc1 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 06:59:51 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-68a1756e-4c53-4583-a97d-0c2425fc9a3a tempest-ProjectMemberTests-1458770269 None] snapshot_file for this snap is: volume-e765aede-d157-473a-a226-0ef891dc0bc1.b423cc5a-4b13-4ab7-9301-b7fb1a1e96c4 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 06:59:51 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34ea0d7-b5a1-4475-8c47-5cdbfc556e15]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:59:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-68a1756e-4c53-4583-a97d-0c2425fc9a3a tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1.b423cc5a-4b13-4ab7-9301-b7fb1a1e96c4 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:52 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1.b423cc5a-4b13-4ab7-9301-b7fb1a1e96c4 Jul 10 06:59:52 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:52 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-68a1756e-4c53-4583-a97d-0c2425fc9a3a tempest-ProjectMemberTests-1458770269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1.b423cc5a-4b13-4ab7-9301-b7fb1a1e96c4" returned: 0 in 0.710s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:52 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-68a1756e-4c53-4583-a97d-0c2425fc9a3a tempest-ProjectMemberTests-1458770269 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e765aede-d157-473a-a226-0ef891dc0bc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 06:59:52 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d7d12a-8333-422e-b898-a0eb881c134c]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:59:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-68a1756e-4c53-4583-a97d-0c2425fc9a3a tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:52 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1 Jul 10 06:59:52 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:53 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-68a1756e-4c53-4583-a97d-0c2425fc9a3a tempest-ProjectMemberTests-1458770269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1" returned: 0 in 0.766s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-68a1756e-4c53-4583-a97d-0c2425fc9a3a tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1.b423cc5a-4b13-4ab7-9301-b7fb1a1e96c4 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:53 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1.b423cc5a-4b13-4ab7-9301-b7fb1a1e96c4 Jul 10 06:59:53 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:54 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-68a1756e-4c53-4583-a97d-0c2425fc9a3a tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1.b423cc5a-4b13-4ab7-9301-b7fb1a1e96c4" returned: 0 in 0.677s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-68a1756e-4c53-4583-a97d-0c2425fc9a3a tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1.b423cc5a-4b13-4ab7-9301-b7fb1a1e96c4 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:54 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1.b423cc5a-4b13-4ab7-9301-b7fb1a1e96c4 Jul 10 06:59:54 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:54 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-68a1756e-4c53-4583-a97d-0c2425fc9a3a tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1.b423cc5a-4b13-4ab7-9301-b7fb1a1e96c4" returned: 0 in 0.610s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:54 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-68a1756e-4c53-4583-a97d-0c2425fc9a3a tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-b423cc5a-4b13-4ab7-9301-b7fb1a1e96c4" released by "_delete_snapshot" :: held 2.846s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:54 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-68a1756e-4c53-4583-a97d-0c2425fc9a3a tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-e765aede-d157-473a-a226-0ef891dc0bc1" released by "delete_snapshot" :: held 2.867s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:54 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-68a1756e-4c53-4583-a97d-0c2425fc9a3a tempest-ProjectMemberTests-1458770269 None] Created reservations ['f484f572-b861-47d8-91bd-98647e7fd655', 'efafcd8d-4ebc-4d6c-ad71-a7b2d7b683c5', '310005dc-0e64-452a-ab5b-ec6bb0fafa71', 'c35dea0a-6288-4479-a61e-35e871d3427b'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:59:54 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-68a1756e-4c53-4583-a97d-0c2425fc9a3a tempest-ProjectMemberTests-1458770269 None] Delete snapshot completed successfully. Jul 10 06:59:54 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-68a1756e-4c53-4583-a97d-0c2425fc9a3a tempest-ProjectMemberTests-1458770269 None] Lock "cinder-b423cc5a-4b13-4ab7-9301-b7fb1a1e96c4-delete_snapshot" released by "delete_snapshot" :: held 2.985s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-00a8fa53-f82f-4344-ae8d-170eb0f2a1ab tempest-ProjectMemberTests-1458770269 None] Acquiring lock "cinder-e765aede-d157-473a-a226-0ef891dc0bc1-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:59:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-00a8fa53-f82f-4344-ae8d-170eb0f2a1ab tempest-ProjectMemberTests-1458770269 None] Lock "cinder-e765aede-d157-473a-a226-0ef891dc0bc1-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:59:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-00a8fa53-f82f-4344-ae8d-170eb0f2a1ab tempest-ProjectMemberTests-1458770269 None] Acquiring lock "cinder-quobyte-e765aede-d157-473a-a226-0ef891dc0bc1" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 06:59:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-00a8fa53-f82f-4344-ae8d-170eb0f2a1ab tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-e765aede-d157-473a-a226-0ef891dc0bc1" acquired by "delete_volume" :: waited 0.015s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 06:59:55 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f50deed-68f0-47cb-94a5-2ec25685d351]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:59:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-00a8fa53-f82f-4344-ae8d-170eb0f2a1ab tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:55 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1 Jul 10 06:59:55 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:55 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-00a8fa53-f82f-4344-ae8d-170eb0f2a1ab tempest-ProjectMemberTests-1458770269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1" returned: 0 in 0.717s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-00a8fa53-f82f-4344-ae8d-170eb0f2a1ab tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:55 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1 Jul 10 06:59:55 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:56 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-00a8fa53-f82f-4344-ae8d-170eb0f2a1ab tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-e765aede-d157-473a-a226-0ef891dc0bc1" returned: 0 in 0.614s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:56 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-00a8fa53-f82f-4344-ae8d-170eb0f2a1ab tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-e765aede-d157-473a-a226-0ef891dc0bc1" released by "delete_volume" :: held 1.385s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:56 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:UPDATE=102,cinder:SELECT=79,cinder:INSERT=33,cinder:DELETE=8 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:59:56 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:UPDATE=102,cinder:DELETE=8,cinder:SELECT=82,cinder:INSERT=24 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 06:59:56 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-00a8fa53-f82f-4344-ae8d-170eb0f2a1ab tempest-ProjectMemberTests-1458770269 None] Created reservations ['f144c474-150f-4a8f-803f-c35192bfd445', '86082f03-f0d1-40bd-bea5-abe2575e82dc', 'bdf8bd45-f469-4ec2-8442-35a2d9189d17', 'adf57e84-6b85-48f9-a0c6-d7d385c21759'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 06:59:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-00a8fa53-f82f-4344-ae8d-170eb0f2a1ab tempest-ProjectMemberTests-1458770269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:59:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-00a8fa53-f82f-4344-ae8d-170eb0f2a1ab tempest-ProjectMemberTests-1458770269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:59:56 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-00a8fa53-f82f-4344-ae8d-170eb0f2a1ab tempest-ProjectMemberTests-1458770269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:59:56 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-00a8fa53-f82f-4344-ae8d-170eb0f2a1ab tempest-ProjectMemberTests-1458770269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:59:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-00a8fa53-f82f-4344-ae8d-170eb0f2a1ab tempest-ProjectMemberTests-1458770269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:59:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-00a8fa53-f82f-4344-ae8d-170eb0f2a1ab tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:56 devstack sudo[107296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 06:59:56 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:57 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-00a8fa53-f82f-4344-ae8d-170eb0f2a1ab tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.621s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:57 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-00a8fa53-f82f-4344-ae8d-170eb0f2a1ab tempest-ProjectMemberTests-1458770269 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 06:59:57 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-00a8fa53-f82f-4344-ae8d-170eb0f2a1ab tempest-ProjectMemberTests-1458770269 None] Deleted volume successfully. Jul 10 06:59:57 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-00a8fa53-f82f-4344-ae8d-170eb0f2a1ab tempest-ProjectMemberTests-1458770269 None] Lock "cinder-e765aede-d157-473a-a226-0ef891dc0bc1-delete_volume" released by "delete_volume" :: held 2.191s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 06:59:57 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-c84302b9-04cc-48f6-8420-148629a9bf8f tempest-ProjectMemberTests-1458770269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 06:59:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c84302b9-04cc-48f6-8420-148629a9bf8f tempest-ProjectMemberTests-1458770269 None] Flow 'volume_create_manager' (b7142f09-70ca-4e60-9e0d-74f7530c3aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:59:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c84302b9-04cc-48f6-8420-148629a9bf8f tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (942d80e7-8b8c-4561-bbd0-95ba456cbe57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c84302b9-04cc-48f6-8420-148629a9bf8f tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (942d80e7-8b8c-4561-bbd0-95ba456cbe57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-377727235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9f9385b-8d1f-4d41-9848-3f341832b29d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='215e832b6dbe42b49605af7a497c8dda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:59:58Z,use_quota=True,user_id='b5b28624cb0741588f7cc21f3c76f8e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c84302b9-04cc-48f6-8420-148629a9bf8f tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29b6c400-a799-426b-8e8f-ba587d6b2ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c84302b9-04cc-48f6-8420-148629a9bf8f tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29b6c400-a799-426b-8e8f-ba587d6b2ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c84302b9-04cc-48f6-8420-148629a9bf8f tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44aa3534-a2f1-45d4-a649-1364320237f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c84302b9-04cc-48f6-8420-148629a9bf8f tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44aa3534-a2f1-45d4-a649-1364320237f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9f9385b-8d1f-4d41-9848-3f341832b29d', 'volume_name': 'volume-a9f9385b-8d1f-4d41-9848-3f341832b29d', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c84302b9-04cc-48f6-8420-148629a9bf8f tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9c82469-ef99-4c8e-aa19-2d23428b9132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c84302b9-04cc-48f6-8420-148629a9bf8f tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9c82469-ef99-4c8e-aa19-2d23428b9132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c84302b9-04cc-48f6-8420-148629a9bf8f tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f89fb702-7445-4876-b9a1-b47ada5d6dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:57 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-c84302b9-04cc-48f6-8420-148629a9bf8f tempest-ProjectMemberTests-1458770269 None] Volume a9f9385b-8d1f-4d41-9848-3f341832b29d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9f9385b-8d1f-4d41-9848-3f341832b29d', 'volume_size': 1} Jul 10 06:59:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c84302b9-04cc-48f6-8420-148629a9bf8f tempest-ProjectMemberTests-1458770269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:59:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c84302b9-04cc-48f6-8420-148629a9bf8f tempest-ProjectMemberTests-1458770269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:59:57 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-c84302b9-04cc-48f6-8420-148629a9bf8f tempest-ProjectMemberTests-1458770269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T04:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-377727235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9f9385b-8d1f-4d41-9848-3f341832b29d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='215e832b6dbe42b49605af7a497c8dda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T04:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T04:59:58Z,use_quota=True,user_id='b5b28624cb0741588f7cc21f3c76f8e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 06:59:57 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-c84302b9-04cc-48f6-8420-148629a9bf8f tempest-ProjectMemberTests-1458770269 None] Creating volume a9f9385b-8d1f-4d41-9848-3f341832b29d {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 06:59:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c84302b9-04cc-48f6-8420-148629a9bf8f tempest-ProjectMemberTests-1458770269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:59:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c84302b9-04cc-48f6-8420-148629a9bf8f tempest-ProjectMemberTests-1458770269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:59:57 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-c84302b9-04cc-48f6-8420-148629a9bf8f tempest-ProjectMemberTests-1458770269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 06:59:57 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-c84302b9-04cc-48f6-8420-148629a9bf8f tempest-ProjectMemberTests-1458770269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 06:59:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c84302b9-04cc-48f6-8420-148629a9bf8f tempest-ProjectMemberTests-1458770269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:59:57 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-c84302b9-04cc-48f6-8420-148629a9bf8f tempest-ProjectMemberTests-1458770269 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 06:59:57 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-c84302b9-04cc-48f6-8420-148629a9bf8f tempest-ProjectMemberTests-1458770269 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 06:59:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c84302b9-04cc-48f6-8420-148629a9bf8f tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:57 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d 1073741824 Jul 10 06:59:57 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:58 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c84302b9-04cc-48f6-8420-148629a9bf8f tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d 1073741824" returned: 0 in 0.769s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c84302b9-04cc-48f6-8420-148629a9bf8f tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:58 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d Jul 10 06:59:58 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 06:59:59 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Jul 10 06:59:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c84302b9-04cc-48f6-8420-148629a9bf8f tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d" returned: 0 in 0.617s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 06:59:59 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-c84302b9-04cc-48f6-8420-148629a9bf8f tempest-ProjectMemberTests-1458770269 None] <== create_volume: return (1422ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 06:59:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c84302b9-04cc-48f6-8420-148629a9bf8f tempest-ProjectMemberTests-1458770269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.424s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 06:59:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c84302b9-04cc-48f6-8420-148629a9bf8f tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f89fb702-7445-4876-b9a1-b47ada5d6dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9f9385b-8d1f-4d41-9848-3f341832b29d', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c84302b9-04cc-48f6-8420-148629a9bf8f tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3df94f14-c94a-4207-9698-c4076a25ca67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 06:59:59 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-c84302b9-04cc-48f6-8420-148629a9bf8f tempest-ProjectMemberTests-1458770269 None] Volume volume-a9f9385b-8d1f-4d41-9848-3f341832b29d (a9f9385b-8d1f-4d41-9848-3f341832b29d): created successfully Jul 10 06:59:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c84302b9-04cc-48f6-8420-148629a9bf8f tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3df94f14-c94a-4207-9698-c4076a25ca67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 06:59:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c84302b9-04cc-48f6-8420-148629a9bf8f tempest-ProjectMemberTests-1458770269 None] Flow 'volume_create_manager' (b7142f09-70ca-4e60-9e0d-74f7530c3aca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 06:59:59 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-c84302b9-04cc-48f6-8420-148629a9bf8f tempest-ProjectMemberTests-1458770269 None] Created volume successfully. Jul 10 06:59:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-bc2dab54-b6d9-4290-915c-81eb843ea9a7 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 06:59:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-bc2dab54-b6d9-4290-915c-81eb843ea9a7 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 06:59:59 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-bc2dab54-b6d9-4290-915c-81eb843ea9a7 tempest-ProjectMemberTests-1458770269 None] Creating offline snapshot 3c8b6d40-94f9-4660-b992-bd2e49b8d92a of volume a9f9385b-8d1f-4d41-9848-3f341832b29d {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 06:59:59 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6cb00a-77a1-4579-843f-72dc941e2724]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 06:59:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bc2dab54-b6d9-4290-915c-81eb843ea9a7 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 06:59:59 devstack sudo[107308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d Jul 10 06:59:59 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:00 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bc2dab54-b6d9-4290-915c-81eb843ea9a7 tempest-ProjectMemberTests-1458770269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d" returned: 0 in 0.717s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bc2dab54-b6d9-4290-915c-81eb843ea9a7 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d.3c8b6d40-94f9-4660-b992-bd2e49b8d92a 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:00 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d.3c8b6d40-94f9-4660-b992-bd2e49b8d92a 1G Jul 10 07:00:00 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:01 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bc2dab54-b6d9-4290-915c-81eb843ea9a7 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d.3c8b6d40-94f9-4660-b992-bd2e49b8d92a 1G" returned: 0 in 0.736s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bc2dab54-b6d9-4290-915c-81eb843ea9a7 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9f9385b-8d1f-4d41-9848-3f341832b29d -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d.3c8b6d40-94f9-4660-b992-bd2e49b8d92a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:01 devstack sudo[107319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9f9385b-8d1f-4d41-9848-3f341832b29d -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d.3c8b6d40-94f9-4660-b992-bd2e49b8d92a Jul 10 07:00:01 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:01 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bc2dab54-b6d9-4290-915c-81eb843ea9a7 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9f9385b-8d1f-4d41-9848-3f341832b29d -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d.3c8b6d40-94f9-4660-b992-bd2e49b8d92a" returned: 0 in 0.664s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:02 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-bc2dab54-b6d9-4290-915c-81eb843ea9a7 tempest-ProjectMemberTests-1458770269 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d.3c8b6d40-94f9-4660-b992-bd2e49b8d92a is being set with open permissions: ugo+rw Jul 10 07:00:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bc2dab54-b6d9-4290-915c-81eb843ea9a7 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d.3c8b6d40-94f9-4660-b992-bd2e49b8d92a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:02 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d.3c8b6d40-94f9-4660-b992-bd2e49b8d92a Jul 10 07:00:02 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:02 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bc2dab54-b6d9-4290-915c-81eb843ea9a7 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d.3c8b6d40-94f9-4660-b992-bd2e49b8d92a" returned: 0 in 0.604s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bc2dab54-b6d9-4290-915c-81eb843ea9a7 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:02 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d.info Jul 10 07:00:02 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:03 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bc2dab54-b6d9-4290-915c-81eb843ea9a7 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d.info" returned: 0 in 0.650s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:03 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-bc2dab54-b6d9-4290-915c-81eb843ea9a7 tempest-ProjectMemberTests-1458770269 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d.info is being set with open permissions: ugo+rw Jul 10 07:00:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bc2dab54-b6d9-4290-915c-81eb843ea9a7 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:03 devstack sudo[107330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d.info Jul 10 07:00:03 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:03 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bc2dab54-b6d9-4290-915c-81eb843ea9a7 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d.info" returned: 0 in 0.604s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-bc2dab54-b6d9-4290-915c-81eb843ea9a7 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.051s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:00:03 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-bc2dab54-b6d9-4290-915c-81eb843ea9a7 tempest-ProjectMemberTests-1458770269 None] Create snapshot completed successfully Jul 10 07:00:04 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-0c59a76f-79c7-4d1a-88a4-68057b314266 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "cinder-3c8b6d40-94f9-4660-b992-bd2e49b8d92a-delete_snapshot" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:00:04 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-0c59a76f-79c7-4d1a-88a4-68057b314266 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-3c8b6d40-94f9-4660-b992-bd2e49b8d92a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:00:04 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-0c59a76f-79c7-4d1a-88a4-68057b314266 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "cinder-quobyte-a9f9385b-8d1f-4d41-9848-3f341832b29d" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:00:04 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-0c59a76f-79c7-4d1a-88a4-68057b314266 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-a9f9385b-8d1f-4d41-9848-3f341832b29d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:00:04 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-0c59a76f-79c7-4d1a-88a4-68057b314266 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "cinder-quobyte-3c8b6d40-94f9-4660-b992-bd2e49b8d92a" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:00:04 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-0c59a76f-79c7-4d1a-88a4-68057b314266 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-3c8b6d40-94f9-4660-b992-bd2e49b8d92a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:00:04 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-0c59a76f-79c7-4d1a-88a4-68057b314266 tempest-ProjectMemberTests-1458770269 None] Deleting offline snapshot 3c8b6d40-94f9-4660-b992-bd2e49b8d92a of volume a9f9385b-8d1f-4d41-9848-3f341832b29d {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:00:04 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-0c59a76f-79c7-4d1a-88a4-68057b314266 tempest-ProjectMemberTests-1458770269 None] snapshot_file for this snap is: volume-a9f9385b-8d1f-4d41-9848-3f341832b29d.3c8b6d40-94f9-4660-b992-bd2e49b8d92a {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:00:04 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90311ce-9a7f-4b12-9e75-b808fb2bc8f3]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:00:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0c59a76f-79c7-4d1a-88a4-68057b314266 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d.3c8b6d40-94f9-4660-b992-bd2e49b8d92a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:04 devstack sudo[107333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d.3c8b6d40-94f9-4660-b992-bd2e49b8d92a Jul 10 07:00:04 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:04 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0c59a76f-79c7-4d1a-88a4-68057b314266 tempest-ProjectMemberTests-1458770269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d.3c8b6d40-94f9-4660-b992-bd2e49b8d92a" returned: 0 in 0.724s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:04 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-0c59a76f-79c7-4d1a-88a4-68057b314266 tempest-ProjectMemberTests-1458770269 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9f9385b-8d1f-4d41-9848-3f341832b29d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:00:04 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88fb121-74a3-4da9-8571-25272a95507f]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:00:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0c59a76f-79c7-4d1a-88a4-68057b314266 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:04 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d Jul 10 07:00:04 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:05 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0c59a76f-79c7-4d1a-88a4-68057b314266 tempest-ProjectMemberTests-1458770269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d" returned: 0 in 0.733s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0c59a76f-79c7-4d1a-88a4-68057b314266 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d.3c8b6d40-94f9-4660-b992-bd2e49b8d92a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:05 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d.3c8b6d40-94f9-4660-b992-bd2e49b8d92a Jul 10 07:00:05 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:06 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0c59a76f-79c7-4d1a-88a4-68057b314266 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d.3c8b6d40-94f9-4660-b992-bd2e49b8d92a" returned: 0 in 0.681s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0c59a76f-79c7-4d1a-88a4-68057b314266 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d.3c8b6d40-94f9-4660-b992-bd2e49b8d92a {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:06 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d.3c8b6d40-94f9-4660-b992-bd2e49b8d92a Jul 10 07:00:06 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:06 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0c59a76f-79c7-4d1a-88a4-68057b314266 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d.3c8b6d40-94f9-4660-b992-bd2e49b8d92a" returned: 0 in 0.633s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:06 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-0c59a76f-79c7-4d1a-88a4-68057b314266 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-3c8b6d40-94f9-4660-b992-bd2e49b8d92a" released by "_delete_snapshot" :: held 2.859s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:00:06 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-0c59a76f-79c7-4d1a-88a4-68057b314266 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-a9f9385b-8d1f-4d41-9848-3f341832b29d" released by "delete_snapshot" :: held 2.880s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:00:07 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-0c59a76f-79c7-4d1a-88a4-68057b314266 tempest-ProjectMemberTests-1458770269 None] Created reservations ['a14045af-acb6-4a8c-b362-597051de783d', 'c8ec158d-3c3f-444f-9a09-d7cf11544a17', '050cc903-cabf-44ad-8a5f-07b2e13699b9', 'cc856aa0-e71e-4354-9eaf-de2c4bb1d779'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:00:07 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-0c59a76f-79c7-4d1a-88a4-68057b314266 tempest-ProjectMemberTests-1458770269 None] Delete snapshot completed successfully. Jul 10 07:00:07 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-0c59a76f-79c7-4d1a-88a4-68057b314266 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-3c8b6d40-94f9-4660-b992-bd2e49b8d92a-delete_snapshot" released by "delete_snapshot" :: held 3.009s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:00:07 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-3131bb6e-fdfe-4f33-b162-40fe136432b3 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "cinder-a9f9385b-8d1f-4d41-9848-3f341832b29d-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:00:07 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-3131bb6e-fdfe-4f33-b162-40fe136432b3 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-a9f9385b-8d1f-4d41-9848-3f341832b29d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:00:07 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-3131bb6e-fdfe-4f33-b162-40fe136432b3 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "cinder-quobyte-a9f9385b-8d1f-4d41-9848-3f341832b29d" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:00:07 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-3131bb6e-fdfe-4f33-b162-40fe136432b3 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-a9f9385b-8d1f-4d41-9848-3f341832b29d" acquired by "delete_volume" :: waited 0.013s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:00:07 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6d9904-da0b-4efe-b801-ec8aca464e81]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:00:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3131bb6e-fdfe-4f33-b162-40fe136432b3 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:07 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d Jul 10 07:00:07 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:08 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3131bb6e-fdfe-4f33-b162-40fe136432b3 tempest-ProjectMemberTests-1458770269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d" returned: 0 in 0.696s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3131bb6e-fdfe-4f33-b162-40fe136432b3 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:08 devstack sudo[107356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d Jul 10 07:00:08 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:08 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3131bb6e-fdfe-4f33-b162-40fe136432b3 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a9f9385b-8d1f-4d41-9848-3f341832b29d" returned: 0 in 0.607s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:08 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-3131bb6e-fdfe-4f33-b162-40fe136432b3 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-a9f9385b-8d1f-4d41-9848-3f341832b29d" released by "delete_volume" :: held 1.361s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:00:08 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-3131bb6e-fdfe-4f33-b162-40fe136432b3 tempest-ProjectMemberTests-1458770269 None] Created reservations ['d6c78cb5-1a42-4341-89e8-c73f7b27872d', '6d6c6a0a-cd1c-4b4f-bb74-02576132e3f9', '6dd5cfe0-f5e4-4f3b-8cd9-9de51c5d098e', '8b2dd1aa-5df7-4234-8ac3-1d9466c920b9'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:00:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-3131bb6e-fdfe-4f33-b162-40fe136432b3 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:00:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-3131bb6e-fdfe-4f33-b162-40fe136432b3 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:00:08 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-3131bb6e-fdfe-4f33-b162-40fe136432b3 tempest-ProjectMemberTests-1458770269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:00:08 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-3131bb6e-fdfe-4f33-b162-40fe136432b3 tempest-ProjectMemberTests-1458770269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:00:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-3131bb6e-fdfe-4f33-b162-40fe136432b3 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:00:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3131bb6e-fdfe-4f33-b162-40fe136432b3 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:08 devstack sudo[107359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 07:00:08 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:09 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3131bb6e-fdfe-4f33-b162-40fe136432b3 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.610s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:09 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-3131bb6e-fdfe-4f33-b162-40fe136432b3 tempest-ProjectMemberTests-1458770269 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:00:09 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-3131bb6e-fdfe-4f33-b162-40fe136432b3 tempest-ProjectMemberTests-1458770269 None] Deleted volume successfully. Jul 10 07:00:09 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-3131bb6e-fdfe-4f33-b162-40fe136432b3 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-a9f9385b-8d1f-4d41-9848-3f341832b29d-delete_volume" released by "delete_volume" :: held 2.155s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:00:09 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8956c9d-195f-4bd6-8095-2564bc8c1eb8 tempest-ProjectMemberTests-1458770269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:00:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c8956c9d-195f-4bd6-8095-2564bc8c1eb8 tempest-ProjectMemberTests-1458770269 None] Flow 'volume_create_manager' (454b698a-3a24-4acc-a5ba-083a781e1249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:00:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c8956c9d-195f-4bd6-8095-2564bc8c1eb8 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdeff830-f1ba-46fc-9561-e69e354a42b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c8956c9d-195f-4bd6-8095-2564bc8c1eb8 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdeff830-f1ba-46fc-9561-e69e354a42b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1822474949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1747ac12-c9e9-4453-98ee-ea25e2db4748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='215e832b6dbe42b49605af7a497c8dda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:00:10Z,use_quota=True,user_id='b5b28624cb0741588f7cc21f3c76f8e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c8956c9d-195f-4bd6-8095-2564bc8c1eb8 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4ee7fc1-d3b9-448f-812b-0752d183b4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c8956c9d-195f-4bd6-8095-2564bc8c1eb8 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4ee7fc1-d3b9-448f-812b-0752d183b4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c8956c9d-195f-4bd6-8095-2564bc8c1eb8 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49bbf12c-bf52-4161-a53d-b193132abd63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c8956c9d-195f-4bd6-8095-2564bc8c1eb8 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49bbf12c-bf52-4161-a53d-b193132abd63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1747ac12-c9e9-4453-98ee-ea25e2db4748', 'volume_name': 'volume-1747ac12-c9e9-4453-98ee-ea25e2db4748', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c8956c9d-195f-4bd6-8095-2564bc8c1eb8 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (334f1f03-af34-4bd1-ab5a-12654ab9873a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c8956c9d-195f-4bd6-8095-2564bc8c1eb8 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (334f1f03-af34-4bd1-ab5a-12654ab9873a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:09 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c8956c9d-195f-4bd6-8095-2564bc8c1eb8 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d907e80-53b8-48f9-b10f-2170c184d90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:09 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-c8956c9d-195f-4bd6-8095-2564bc8c1eb8 tempest-ProjectMemberTests-1458770269 None] Volume 1747ac12-c9e9-4453-98ee-ea25e2db4748: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1747ac12-c9e9-4453-98ee-ea25e2db4748', 'volume_size': 1} Jul 10 07:00:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c8956c9d-195f-4bd6-8095-2564bc8c1eb8 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:00:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c8956c9d-195f-4bd6-8095-2564bc8c1eb8 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:00:09 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-c8956c9d-195f-4bd6-8095-2564bc8c1eb8 tempest-ProjectMemberTests-1458770269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1822474949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1747ac12-c9e9-4453-98ee-ea25e2db4748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='215e832b6dbe42b49605af7a497c8dda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:00:10Z,use_quota=True,user_id='b5b28624cb0741588f7cc21f3c76f8e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:00:09 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-c8956c9d-195f-4bd6-8095-2564bc8c1eb8 tempest-ProjectMemberTests-1458770269 None] Creating volume 1747ac12-c9e9-4453-98ee-ea25e2db4748 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:00:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c8956c9d-195f-4bd6-8095-2564bc8c1eb8 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:00:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c8956c9d-195f-4bd6-8095-2564bc8c1eb8 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:00:09 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-c8956c9d-195f-4bd6-8095-2564bc8c1eb8 tempest-ProjectMemberTests-1458770269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:00:09 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-c8956c9d-195f-4bd6-8095-2564bc8c1eb8 tempest-ProjectMemberTests-1458770269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:00:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c8956c9d-195f-4bd6-8095-2564bc8c1eb8 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:00:09 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-c8956c9d-195f-4bd6-8095-2564bc8c1eb8 tempest-ProjectMemberTests-1458770269 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:00:09 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-c8956c9d-195f-4bd6-8095-2564bc8c1eb8 tempest-ProjectMemberTests-1458770269 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 07:00:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c8956c9d-195f-4bd6-8095-2564bc8c1eb8 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:09 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748 1073741824 Jul 10 07:00:09 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:10 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c8956c9d-195f-4bd6-8095-2564bc8c1eb8 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748 1073741824" returned: 0 in 0.773s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c8956c9d-195f-4bd6-8095-2564bc8c1eb8 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:10 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748 Jul 10 07:00:10 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:11 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c8956c9d-195f-4bd6-8095-2564bc8c1eb8 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748" returned: 0 in 0.624s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:11 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-c8956c9d-195f-4bd6-8095-2564bc8c1eb8 tempest-ProjectMemberTests-1458770269 None] <== create_volume: return (1433ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:00:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c8956c9d-195f-4bd6-8095-2564bc8c1eb8 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:00:11 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c8956c9d-195f-4bd6-8095-2564bc8c1eb8 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d907e80-53b8-48f9-b10f-2170c184d90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1747ac12-c9e9-4453-98ee-ea25e2db4748', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:11 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c8956c9d-195f-4bd6-8095-2564bc8c1eb8 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (132f7272-19f8-4e24-81ff-53bb8c368aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:11 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-c8956c9d-195f-4bd6-8095-2564bc8c1eb8 tempest-ProjectMemberTests-1458770269 None] Volume volume-1747ac12-c9e9-4453-98ee-ea25e2db4748 (1747ac12-c9e9-4453-98ee-ea25e2db4748): created successfully Jul 10 07:00:11 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c8956c9d-195f-4bd6-8095-2564bc8c1eb8 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (132f7272-19f8-4e24-81ff-53bb8c368aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:11 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-c8956c9d-195f-4bd6-8095-2564bc8c1eb8 tempest-ProjectMemberTests-1458770269 None] Flow 'volume_create_manager' (454b698a-3a24-4acc-a5ba-083a781e1249) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:00:11 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-c8956c9d-195f-4bd6-8095-2564bc8c1eb8 tempest-ProjectMemberTests-1458770269 None] Created volume successfully. Jul 10 07:00:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-550d1c09-77f2-40cd-88e1-6ce86ef4deb9 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:00:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-550d1c09-77f2-40cd-88e1-6ce86ef4deb9 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:00:12 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-550d1c09-77f2-40cd-88e1-6ce86ef4deb9 tempest-ProjectMemberTests-1458770269 None] Creating offline snapshot 35141b0f-1c7f-4551-bc21-645f8025db60 of volume 1747ac12-c9e9-4453-98ee-ea25e2db4748 {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:00:12 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa5076d-f42c-4cda-8c87-f229ad01ceb3]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:00:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-550d1c09-77f2-40cd-88e1-6ce86ef4deb9 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:12 devstack sudo[107371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748 Jul 10 07:00:12 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:12 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-550d1c09-77f2-40cd-88e1-6ce86ef4deb9 tempest-ProjectMemberTests-1458770269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748" returned: 0 in 0.705s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-550d1c09-77f2-40cd-88e1-6ce86ef4deb9 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748.35141b0f-1c7f-4551-bc21-645f8025db60 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:12 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748.35141b0f-1c7f-4551-bc21-645f8025db60 1G Jul 10 07:00:12 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:13 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-550d1c09-77f2-40cd-88e1-6ce86ef4deb9 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748.35141b0f-1c7f-4551-bc21-645f8025db60 1G" returned: 0 in 0.751s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-550d1c09-77f2-40cd-88e1-6ce86ef4deb9 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1747ac12-c9e9-4453-98ee-ea25e2db4748 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748.35141b0f-1c7f-4551-bc21-645f8025db60 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:13 devstack sudo[107381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1747ac12-c9e9-4453-98ee-ea25e2db4748 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748.35141b0f-1c7f-4551-bc21-645f8025db60 Jul 10 07:00:13 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:14 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-550d1c09-77f2-40cd-88e1-6ce86ef4deb9 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1747ac12-c9e9-4453-98ee-ea25e2db4748 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748.35141b0f-1c7f-4551-bc21-645f8025db60" returned: 0 in 0.645s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:14 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-550d1c09-77f2-40cd-88e1-6ce86ef4deb9 tempest-ProjectMemberTests-1458770269 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748.35141b0f-1c7f-4551-bc21-645f8025db60 is being set with open permissions: ugo+rw Jul 10 07:00:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-550d1c09-77f2-40cd-88e1-6ce86ef4deb9 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748.35141b0f-1c7f-4551-bc21-645f8025db60 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:14 devstack sudo[107386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748.35141b0f-1c7f-4551-bc21-645f8025db60 Jul 10 07:00:14 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:14 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-550d1c09-77f2-40cd-88e1-6ce86ef4deb9 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748.35141b0f-1c7f-4551-bc21-645f8025db60" returned: 0 in 0.602s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-550d1c09-77f2-40cd-88e1-6ce86ef4deb9 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:14 devstack sudo[107389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748.info Jul 10 07:00:14 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:15 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-550d1c09-77f2-40cd-88e1-6ce86ef4deb9 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748.info" returned: 0 in 0.605s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:15 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-550d1c09-77f2-40cd-88e1-6ce86ef4deb9 tempest-ProjectMemberTests-1458770269 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748.info is being set with open permissions: ugo+rw Jul 10 07:00:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-550d1c09-77f2-40cd-88e1-6ce86ef4deb9 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:15 devstack sudo[107392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748.info Jul 10 07:00:15 devstack sudo[107392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:16 devstack sudo[107392]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-550d1c09-77f2-40cd-88e1-6ce86ef4deb9 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748.info" returned: 0 in 0.598s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-550d1c09-77f2-40cd-88e1-6ce86ef4deb9 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.979s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:00:16 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-550d1c09-77f2-40cd-88e1-6ce86ef4deb9 tempest-ProjectMemberTests-1458770269 None] Create snapshot completed successfully Jul 10 07:00:16 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1ab416bd-129f-4abb-8d9e-be8f732d8f9d tempest-ProjectMemberTests-1458770269 None] Acquiring lock "cinder-35141b0f-1c7f-4551-bc21-645f8025db60-delete_snapshot" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:00:16 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1ab416bd-129f-4abb-8d9e-be8f732d8f9d tempest-ProjectMemberTests-1458770269 None] Lock "cinder-35141b0f-1c7f-4551-bc21-645f8025db60-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:00:16 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1ab416bd-129f-4abb-8d9e-be8f732d8f9d tempest-ProjectMemberTests-1458770269 None] Acquiring lock "cinder-quobyte-1747ac12-c9e9-4453-98ee-ea25e2db4748" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:00:16 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1ab416bd-129f-4abb-8d9e-be8f732d8f9d tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-1747ac12-c9e9-4453-98ee-ea25e2db4748" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:00:16 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1ab416bd-129f-4abb-8d9e-be8f732d8f9d tempest-ProjectMemberTests-1458770269 None] Acquiring lock "cinder-quobyte-35141b0f-1c7f-4551-bc21-645f8025db60" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:00:16 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1ab416bd-129f-4abb-8d9e-be8f732d8f9d tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-35141b0f-1c7f-4551-bc21-645f8025db60" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:00:16 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-1ab416bd-129f-4abb-8d9e-be8f732d8f9d tempest-ProjectMemberTests-1458770269 None] Deleting offline snapshot 35141b0f-1c7f-4551-bc21-645f8025db60 of volume 1747ac12-c9e9-4453-98ee-ea25e2db4748 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:00:16 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-1ab416bd-129f-4abb-8d9e-be8f732d8f9d tempest-ProjectMemberTests-1458770269 None] snapshot_file for this snap is: volume-1747ac12-c9e9-4453-98ee-ea25e2db4748.35141b0f-1c7f-4551-bc21-645f8025db60 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:00:16 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f7d5b2-8236-4312-b3c5-843f96d805ce]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:00:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1ab416bd-129f-4abb-8d9e-be8f732d8f9d tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748.35141b0f-1c7f-4551-bc21-645f8025db60 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:16 devstack sudo[107395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748.35141b0f-1c7f-4551-bc21-645f8025db60 Jul 10 07:00:16 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:17 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1ab416bd-129f-4abb-8d9e-be8f732d8f9d tempest-ProjectMemberTests-1458770269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748.35141b0f-1c7f-4551-bc21-645f8025db60" returned: 0 in 0.709s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:17 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-1ab416bd-129f-4abb-8d9e-be8f732d8f9d tempest-ProjectMemberTests-1458770269 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1747ac12-c9e9-4453-98ee-ea25e2db4748(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:00:17 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8edd09-0a40-4128-8e70-471966006042]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:00:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1ab416bd-129f-4abb-8d9e-be8f732d8f9d tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:17 devstack sudo[107400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748 Jul 10 07:00:17 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:17 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1ab416bd-129f-4abb-8d9e-be8f732d8f9d tempest-ProjectMemberTests-1458770269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748" returned: 0 in 0.704s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1ab416bd-129f-4abb-8d9e-be8f732d8f9d tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748.35141b0f-1c7f-4551-bc21-645f8025db60 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:17 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748.35141b0f-1c7f-4551-bc21-645f8025db60 Jul 10 07:00:17 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:18 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1ab416bd-129f-4abb-8d9e-be8f732d8f9d tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748.35141b0f-1c7f-4551-bc21-645f8025db60" returned: 0 in 0.699s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1ab416bd-129f-4abb-8d9e-be8f732d8f9d tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748.35141b0f-1c7f-4551-bc21-645f8025db60 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:18 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748.35141b0f-1c7f-4551-bc21-645f8025db60 Jul 10 07:00:18 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:19 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-1ab416bd-129f-4abb-8d9e-be8f732d8f9d tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748.35141b0f-1c7f-4551-bc21-645f8025db60" returned: 0 in 0.601s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:19 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1ab416bd-129f-4abb-8d9e-be8f732d8f9d tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-35141b0f-1c7f-4551-bc21-645f8025db60" released by "_delete_snapshot" :: held 2.804s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:00:19 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1ab416bd-129f-4abb-8d9e-be8f732d8f9d tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-1747ac12-c9e9-4453-98ee-ea25e2db4748" released by "delete_snapshot" :: held 2.825s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:00:19 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-1ab416bd-129f-4abb-8d9e-be8f732d8f9d tempest-ProjectMemberTests-1458770269 None] Created reservations ['1460cdec-000e-4b89-9c3f-bfc3d6de96e8', 'e8f7dea6-4d54-4662-ab5c-18dc05bb73a1', '2cab09e0-c089-4a8a-8808-9e1cf6a21c70', '84c4acec-8aec-4d90-94e3-1903aabda607'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:00:19 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-1ab416bd-129f-4abb-8d9e-be8f732d8f9d tempest-ProjectMemberTests-1458770269 None] Delete snapshot completed successfully. Jul 10 07:00:19 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-1ab416bd-129f-4abb-8d9e-be8f732d8f9d tempest-ProjectMemberTests-1458770269 None] Lock "cinder-35141b0f-1c7f-4551-bc21-645f8025db60-delete_snapshot" released by "delete_snapshot" :: held 2.950s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:00:19 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c8e83fa6-7fb0-45f0-9f6b-0c7049a99e2b tempest-ProjectMemberTests-1458770269 None] Acquiring lock "cinder-1747ac12-c9e9-4453-98ee-ea25e2db4748-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:00:19 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c8e83fa6-7fb0-45f0-9f6b-0c7049a99e2b tempest-ProjectMemberTests-1458770269 None] Lock "cinder-1747ac12-c9e9-4453-98ee-ea25e2db4748-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:00:19 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c8e83fa6-7fb0-45f0-9f6b-0c7049a99e2b tempest-ProjectMemberTests-1458770269 None] Acquiring lock "cinder-quobyte-1747ac12-c9e9-4453-98ee-ea25e2db4748" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:00:19 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c8e83fa6-7fb0-45f0-9f6b-0c7049a99e2b tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-1747ac12-c9e9-4453-98ee-ea25e2db4748" acquired by "delete_volume" :: waited 0.019s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:00:19 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c718b8-a2b0-4178-ad44-4e3185b4ac20]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:00:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c8e83fa6-7fb0-45f0-9f6b-0c7049a99e2b tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:19 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748 Jul 10 07:00:19 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:20 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c8e83fa6-7fb0-45f0-9f6b-0c7049a99e2b tempest-ProjectMemberTests-1458770269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748" returned: 0 in 0.705s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c8e83fa6-7fb0-45f0-9f6b-0c7049a99e2b tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:20 devstack sudo[107419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748 Jul 10 07:00:20 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:20 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c8e83fa6-7fb0-45f0-9f6b-0c7049a99e2b tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-1747ac12-c9e9-4453-98ee-ea25e2db4748" returned: 0 in 0.620s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:20 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c8e83fa6-7fb0-45f0-9f6b-0c7049a99e2b tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-1747ac12-c9e9-4453-98ee-ea25e2db4748" released by "delete_volume" :: held 1.380s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:00:20 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-c8e83fa6-7fb0-45f0-9f6b-0c7049a99e2b tempest-ProjectMemberTests-1458770269 None] Created reservations ['2697e05b-25b7-41ef-b604-3330442ecf0a', 'a04329a7-9a62-4f5f-be52-d64275ff279e', '4cc89e95-c805-4efe-afd1-beba682bb15c', '8f92a867-098e-45a1-8e3f-9d7de76ad7fe'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:00:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c8e83fa6-7fb0-45f0-9f6b-0c7049a99e2b tempest-ProjectMemberTests-1458770269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:00:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c8e83fa6-7fb0-45f0-9f6b-0c7049a99e2b tempest-ProjectMemberTests-1458770269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:00:20 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-c8e83fa6-7fb0-45f0-9f6b-0c7049a99e2b tempest-ProjectMemberTests-1458770269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:00:20 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-c8e83fa6-7fb0-45f0-9f6b-0c7049a99e2b tempest-ProjectMemberTests-1458770269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:00:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-c8e83fa6-7fb0-45f0-9f6b-0c7049a99e2b tempest-ProjectMemberTests-1458770269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:00:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c8e83fa6-7fb0-45f0-9f6b-0c7049a99e2b tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:21 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 07:00:21 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:21 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-c8e83fa6-7fb0-45f0-9f6b-0c7049a99e2b tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.660s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:21 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-c8e83fa6-7fb0-45f0-9f6b-0c7049a99e2b tempest-ProjectMemberTests-1458770269 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:00:21 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-c8e83fa6-7fb0-45f0-9f6b-0c7049a99e2b tempest-ProjectMemberTests-1458770269 None] Deleted volume successfully. Jul 10 07:00:21 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-c8e83fa6-7fb0-45f0-9f6b-0c7049a99e2b tempest-ProjectMemberTests-1458770269 None] Lock "cinder-1747ac12-c9e9-4453-98ee-ea25e2db4748-delete_volume" released by "delete_volume" :: held 2.243s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:00:21 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:00:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:00:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:00:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:00:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:00:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:00:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:21 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 07:00:21 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:22 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad4203e8-4ae4-4a76-b109-358c8fc08be0 tempest-ProjectMemberTests-1458770269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:00:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ad4203e8-4ae4-4a76-b109-358c8fc08be0 tempest-ProjectMemberTests-1458770269 None] Flow 'volume_create_manager' (b14c3534-084f-445a-89fd-48f866152a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:00:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ad4203e8-4ae4-4a76-b109-358c8fc08be0 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb8898fc-5d1f-4e01-b1c8-3781613f6983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ad4203e8-4ae4-4a76-b109-358c8fc08be0 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb8898fc-5d1f-4e01-b1c8-3781613f6983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:00:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1270303527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=798ef507-ab41-4685-8621-c2f9ba36b8e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='215e832b6dbe42b49605af7a497c8dda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:00:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:00:22Z,use_quota=True,user_id='b5b28624cb0741588f7cc21f3c76f8e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ad4203e8-4ae4-4a76-b109-358c8fc08be0 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a160b34-14ab-43f2-9d47-25e5b95490a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ad4203e8-4ae4-4a76-b109-358c8fc08be0 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a160b34-14ab-43f2-9d47-25e5b95490a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ad4203e8-4ae4-4a76-b109-358c8fc08be0 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cd0f9c2-6aaa-4163-b30e-54289909fced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ad4203e8-4ae4-4a76-b109-358c8fc08be0 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cd0f9c2-6aaa-4163-b30e-54289909fced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '798ef507-ab41-4685-8621-c2f9ba36b8e0', 'volume_name': 'volume-798ef507-ab41-4685-8621-c2f9ba36b8e0', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ad4203e8-4ae4-4a76-b109-358c8fc08be0 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78539a59-c713-41f1-8595-d559a2b47cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ad4203e8-4ae4-4a76-b109-358c8fc08be0 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78539a59-c713-41f1-8595-d559a2b47cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ad4203e8-4ae4-4a76-b109-358c8fc08be0 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88f3dff8-a74f-4dc3-ade4-1309b38eefb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:22 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-ad4203e8-4ae4-4a76-b109-358c8fc08be0 tempest-ProjectMemberTests-1458770269 None] Volume 798ef507-ab41-4685-8621-c2f9ba36b8e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-798ef507-ab41-4685-8621-c2f9ba36b8e0', 'volume_size': 1} Jul 10 07:00:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ad4203e8-4ae4-4a76-b109-358c8fc08be0 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:00:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ad4203e8-4ae4-4a76-b109-358c8fc08be0 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:00:22 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-ad4203e8-4ae4-4a76-b109-358c8fc08be0 tempest-ProjectMemberTests-1458770269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:00:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1270303527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=798ef507-ab41-4685-8621-c2f9ba36b8e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='215e832b6dbe42b49605af7a497c8dda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:00:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:00:22Z,use_quota=True,user_id='b5b28624cb0741588f7cc21f3c76f8e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:00:22 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-ad4203e8-4ae4-4a76-b109-358c8fc08be0 tempest-ProjectMemberTests-1458770269 None] Creating volume 798ef507-ab41-4685-8621-c2f9ba36b8e0 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:00:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ad4203e8-4ae4-4a76-b109-358c8fc08be0 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:00:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ad4203e8-4ae4-4a76-b109-358c8fc08be0 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:00:22 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-ad4203e8-4ae4-4a76-b109-358c8fc08be0 tempest-ProjectMemberTests-1458770269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:00:22 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-ad4203e8-4ae4-4a76-b109-358c8fc08be0 tempest-ProjectMemberTests-1458770269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:00:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ad4203e8-4ae4-4a76-b109-358c8fc08be0 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:00:22 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-ad4203e8-4ae4-4a76-b109-358c8fc08be0 tempest-ProjectMemberTests-1458770269 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:00:22 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-ad4203e8-4ae4-4a76-b109-358c8fc08be0 tempest-ProjectMemberTests-1458770269 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 07:00:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ad4203e8-4ae4-4a76-b109-358c8fc08be0 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:22 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0 1073741824 Jul 10 07:00:22 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:22 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.661s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:22 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:00:22 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager._thread_info {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:00:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread count: 28 {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 07:00:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread info: [<_MainThread(MainThread, started 139245706264704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 07:00:22 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ad4203e8-4ae4-4a76-b109-358c8fc08be0 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0 1073741824" returned: 0 in 0.777s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ad4203e8-4ae4-4a76-b109-358c8fc08be0 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:22 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0 Jul 10 07:00:22 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:23 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-ad4203e8-4ae4-4a76-b109-358c8fc08be0 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0" returned: 0 in 0.646s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:23 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-ad4203e8-4ae4-4a76-b109-358c8fc08be0 tempest-ProjectMemberTests-1458770269 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:00:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-ad4203e8-4ae4-4a76-b109-358c8fc08be0 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:00:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ad4203e8-4ae4-4a76-b109-358c8fc08be0 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88f3dff8-a74f-4dc3-ade4-1309b38eefb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-798ef507-ab41-4685-8621-c2f9ba36b8e0', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ad4203e8-4ae4-4a76-b109-358c8fc08be0 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65192d02-fe8a-4d84-94df-674675e34e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:23 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-ad4203e8-4ae4-4a76-b109-358c8fc08be0 tempest-ProjectMemberTests-1458770269 None] Volume volume-798ef507-ab41-4685-8621-c2f9ba36b8e0 (798ef507-ab41-4685-8621-c2f9ba36b8e0): created successfully Jul 10 07:00:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ad4203e8-4ae4-4a76-b109-358c8fc08be0 tempest-ProjectMemberTests-1458770269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65192d02-fe8a-4d84-94df-674675e34e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:23 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-ad4203e8-4ae4-4a76-b109-358c8fc08be0 tempest-ProjectMemberTests-1458770269 None] Flow 'volume_create_manager' (b14c3534-084f-445a-89fd-48f866152a48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:00:23 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-ad4203e8-4ae4-4a76-b109-358c8fc08be0 tempest-ProjectMemberTests-1458770269 None] Created volume successfully. Jul 10 07:00:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f52a2d61-f3b3-4c84-b8a5-9f040f6176f4 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:00:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f52a2d61-f3b3-4c84-b8a5-9f040f6176f4 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:00:24 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-f52a2d61-f3b3-4c84-b8a5-9f040f6176f4 tempest-ProjectMemberTests-1458770269 None] Creating offline snapshot d37ca034-3329-4ae4-a92a-7b344d3a4b01 of volume 798ef507-ab41-4685-8621-c2f9ba36b8e0 {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:00:24 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a618ba5-bb8c-4718-a0e8-4979cdf8103a]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:00:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f52a2d61-f3b3-4c84-b8a5-9f040f6176f4 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:24 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0 Jul 10 07:00:24 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:25 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f52a2d61-f3b3-4c84-b8a5-9f040f6176f4 tempest-ProjectMemberTests-1458770269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0" returned: 0 in 0.707s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f52a2d61-f3b3-4c84-b8a5-9f040f6176f4 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0.d37ca034-3329-4ae4-a92a-7b344d3a4b01 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:25 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0.d37ca034-3329-4ae4-a92a-7b344d3a4b01 1G Jul 10 07:00:25 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:25 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f52a2d61-f3b3-4c84-b8a5-9f040f6176f4 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0.d37ca034-3329-4ae4-a92a-7b344d3a4b01 1G" returned: 0 in 0.772s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f52a2d61-f3b3-4c84-b8a5-9f040f6176f4 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-798ef507-ab41-4685-8621-c2f9ba36b8e0 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0.d37ca034-3329-4ae4-a92a-7b344d3a4b01 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:25 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-798ef507-ab41-4685-8621-c2f9ba36b8e0 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0.d37ca034-3329-4ae4-a92a-7b344d3a4b01 Jul 10 07:00:25 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:26 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f52a2d61-f3b3-4c84-b8a5-9f040f6176f4 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-798ef507-ab41-4685-8621-c2f9ba36b8e0 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0.d37ca034-3329-4ae4-a92a-7b344d3a4b01" returned: 0 in 0.667s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:26 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-f52a2d61-f3b3-4c84-b8a5-9f040f6176f4 tempest-ProjectMemberTests-1458770269 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0.d37ca034-3329-4ae4-a92a-7b344d3a4b01 is being set with open permissions: ugo+rw Jul 10 07:00:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f52a2d61-f3b3-4c84-b8a5-9f040f6176f4 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0.d37ca034-3329-4ae4-a92a-7b344d3a4b01 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:26 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0.d37ca034-3329-4ae4-a92a-7b344d3a4b01 Jul 10 07:00:26 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:27 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f52a2d61-f3b3-4c84-b8a5-9f040f6176f4 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0.d37ca034-3329-4ae4-a92a-7b344d3a4b01" returned: 0 in 0.636s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f52a2d61-f3b3-4c84-b8a5-9f040f6176f4 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:27 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0.info Jul 10 07:00:27 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:27 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f52a2d61-f3b3-4c84-b8a5-9f040f6176f4 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0.info" returned: 0 in 0.611s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:27 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-f52a2d61-f3b3-4c84-b8a5-9f040f6176f4 tempest-ProjectMemberTests-1458770269 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0.info is being set with open permissions: ugo+rw Jul 10 07:00:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f52a2d61-f3b3-4c84-b8a5-9f040f6176f4 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:27 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0.info Jul 10 07:00:27 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:28 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f52a2d61-f3b3-4c84-b8a5-9f040f6176f4 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0.info" returned: 0 in 0.600s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f52a2d61-f3b3-4c84-b8a5-9f040f6176f4 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.065s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:00:28 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-f52a2d61-f3b3-4c84-b8a5-9f040f6176f4 tempest-ProjectMemberTests-1458770269 None] Create snapshot completed successfully Jul 10 07:00:28 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-31fa3d2d-c211-49f8-a36f-ccf28b9c464a tempest-ProjectMemberTests-1458770269 None] Acquiring lock "cinder-d37ca034-3329-4ae4-a92a-7b344d3a4b01-delete_snapshot" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:00:28 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-31fa3d2d-c211-49f8-a36f-ccf28b9c464a tempest-ProjectMemberTests-1458770269 None] Lock "cinder-d37ca034-3329-4ae4-a92a-7b344d3a4b01-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:00:28 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-31fa3d2d-c211-49f8-a36f-ccf28b9c464a tempest-ProjectMemberTests-1458770269 None] Acquiring lock "cinder-quobyte-798ef507-ab41-4685-8621-c2f9ba36b8e0" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:00:28 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-31fa3d2d-c211-49f8-a36f-ccf28b9c464a tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-798ef507-ab41-4685-8621-c2f9ba36b8e0" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:00:28 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-31fa3d2d-c211-49f8-a36f-ccf28b9c464a tempest-ProjectMemberTests-1458770269 None] Acquiring lock "cinder-quobyte-d37ca034-3329-4ae4-a92a-7b344d3a4b01" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:00:28 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-31fa3d2d-c211-49f8-a36f-ccf28b9c464a tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-d37ca034-3329-4ae4-a92a-7b344d3a4b01" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:00:28 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-31fa3d2d-c211-49f8-a36f-ccf28b9c464a tempest-ProjectMemberTests-1458770269 None] Deleting offline snapshot d37ca034-3329-4ae4-a92a-7b344d3a4b01 of volume 798ef507-ab41-4685-8621-c2f9ba36b8e0 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:00:28 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-31fa3d2d-c211-49f8-a36f-ccf28b9c464a tempest-ProjectMemberTests-1458770269 None] snapshot_file for this snap is: volume-798ef507-ab41-4685-8621-c2f9ba36b8e0.d37ca034-3329-4ae4-a92a-7b344d3a4b01 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:00:28 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ece7f2-aff0-43b3-9810-f72f6ef956cf]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:00:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-31fa3d2d-c211-49f8-a36f-ccf28b9c464a tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0.d37ca034-3329-4ae4-a92a-7b344d3a4b01 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:28 devstack sudo[107500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0.d37ca034-3329-4ae4-a92a-7b344d3a4b01 Jul 10 07:00:28 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:29 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-31fa3d2d-c211-49f8-a36f-ccf28b9c464a tempest-ProjectMemberTests-1458770269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0.d37ca034-3329-4ae4-a92a-7b344d3a4b01" returned: 0 in 0.704s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:29 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-31fa3d2d-c211-49f8-a36f-ccf28b9c464a tempest-ProjectMemberTests-1458770269 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-798ef507-ab41-4685-8621-c2f9ba36b8e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:00:29 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fcacf1-d91c-4d56-9f02-9d789b146959]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:00:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-31fa3d2d-c211-49f8-a36f-ccf28b9c464a tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:29 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0 Jul 10 07:00:29 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:30 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-31fa3d2d-c211-49f8-a36f-ccf28b9c464a tempest-ProjectMemberTests-1458770269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0" returned: 0 in 0.720s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-31fa3d2d-c211-49f8-a36f-ccf28b9c464a tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0.d37ca034-3329-4ae4-a92a-7b344d3a4b01 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:30 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0.d37ca034-3329-4ae4-a92a-7b344d3a4b01 Jul 10 07:00:30 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:30 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-31fa3d2d-c211-49f8-a36f-ccf28b9c464a tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0.d37ca034-3329-4ae4-a92a-7b344d3a4b01" returned: 0 in 0.696s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-31fa3d2d-c211-49f8-a36f-ccf28b9c464a tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0.d37ca034-3329-4ae4-a92a-7b344d3a4b01 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:30 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0.d37ca034-3329-4ae4-a92a-7b344d3a4b01 Jul 10 07:00:30 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:31 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-31fa3d2d-c211-49f8-a36f-ccf28b9c464a tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0.d37ca034-3329-4ae4-a92a-7b344d3a4b01" returned: 0 in 0.627s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:31 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-31fa3d2d-c211-49f8-a36f-ccf28b9c464a tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-d37ca034-3329-4ae4-a92a-7b344d3a4b01" released by "_delete_snapshot" :: held 2.831s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:00:31 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-31fa3d2d-c211-49f8-a36f-ccf28b9c464a tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-798ef507-ab41-4685-8621-c2f9ba36b8e0" released by "delete_snapshot" :: held 2.852s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:00:31 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-31fa3d2d-c211-49f8-a36f-ccf28b9c464a tempest-ProjectMemberTests-1458770269 None] Created reservations ['12cb1fc8-e42c-432f-9913-6bae182b89e3', '660d076b-6f6b-4e97-b6fd-782f308da4a0', '9182f96a-2985-4b30-bb47-903d50df7cc7', '191e4fa7-2de3-4057-87d5-2a517c249c9d'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:00:31 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-31fa3d2d-c211-49f8-a36f-ccf28b9c464a tempest-ProjectMemberTests-1458770269 None] Delete snapshot completed successfully. Jul 10 07:00:31 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-31fa3d2d-c211-49f8-a36f-ccf28b9c464a tempest-ProjectMemberTests-1458770269 None] Lock "cinder-d37ca034-3329-4ae4-a92a-7b344d3a4b01-delete_snapshot" released by "delete_snapshot" :: held 2.975s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:00:31 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-9ca22a5c-ec69-423a-930e-92167d068032 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "cinder-798ef507-ab41-4685-8621-c2f9ba36b8e0-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:00:31 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-9ca22a5c-ec69-423a-930e-92167d068032 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-798ef507-ab41-4685-8621-c2f9ba36b8e0-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:00:31 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-9ca22a5c-ec69-423a-930e-92167d068032 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "cinder-quobyte-798ef507-ab41-4685-8621-c2f9ba36b8e0" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:00:31 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-9ca22a5c-ec69-423a-930e-92167d068032 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-798ef507-ab41-4685-8621-c2f9ba36b8e0" acquired by "delete_volume" :: waited 0.013s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:00:31 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0a5222-4385-48e1-8483-1fb7a5dbde0d]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:00:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9ca22a5c-ec69-423a-930e-92167d068032 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:31 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0 Jul 10 07:00:31 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:32 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9ca22a5c-ec69-423a-930e-92167d068032 tempest-ProjectMemberTests-1458770269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0" returned: 0 in 0.706s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9ca22a5c-ec69-423a-930e-92167d068032 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:32 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0 Jul 10 07:00:32 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:33 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9ca22a5c-ec69-423a-930e-92167d068032 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-798ef507-ab41-4685-8621-c2f9ba36b8e0" returned: 0 in 0.602s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:33 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-9ca22a5c-ec69-423a-930e-92167d068032 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-quobyte-798ef507-ab41-4685-8621-c2f9ba36b8e0" released by "delete_volume" :: held 1.360s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:00:33 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-9ca22a5c-ec69-423a-930e-92167d068032 tempest-ProjectMemberTests-1458770269 None] Created reservations ['ebacdf60-5f92-488e-b1af-9f35084cae66', 'ba0bc84f-1d78-47df-ba4e-7565e6549e92', 'fd59b379-adb1-45a9-92e7-48e54e198f36', '278cd2a5-91d1-4074-8b9f-c0c90b078c39'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:00:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9ca22a5c-ec69-423a-930e-92167d068032 tempest-ProjectMemberTests-1458770269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:00:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9ca22a5c-ec69-423a-930e-92167d068032 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:00:33 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9ca22a5c-ec69-423a-930e-92167d068032 tempest-ProjectMemberTests-1458770269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:00:33 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-9ca22a5c-ec69-423a-930e-92167d068032 tempest-ProjectMemberTests-1458770269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:00:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9ca22a5c-ec69-423a-930e-92167d068032 tempest-ProjectMemberTests-1458770269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:00:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9ca22a5c-ec69-423a-930e-92167d068032 tempest-ProjectMemberTests-1458770269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:33 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 07:00:33 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:33 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9ca22a5c-ec69-423a-930e-92167d068032 tempest-ProjectMemberTests-1458770269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.607s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:33 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-9ca22a5c-ec69-423a-930e-92167d068032 tempest-ProjectMemberTests-1458770269 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:00:33 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-9ca22a5c-ec69-423a-930e-92167d068032 tempest-ProjectMemberTests-1458770269 None] Deleted volume successfully. Jul 10 07:00:33 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-9ca22a5c-ec69-423a-930e-92167d068032 tempest-ProjectMemberTests-1458770269 None] Lock "cinder-798ef507-ab41-4685-8621-c2f9ba36b8e0-delete_volume" released by "delete_volume" :: held 2.140s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:00:37 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-628ae998-dd00-4734-9ae1-c95ce1046f64 tempest-ProjectReaderTests-1214970823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:00:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-628ae998-dd00-4734-9ae1-c95ce1046f64 tempest-ProjectReaderTests-1214970823 None] Flow 'volume_create_manager' (7feacb5c-6268-4684-bf07-9411b4f83d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:00:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-628ae998-dd00-4734-9ae1-c95ce1046f64 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69a151bc-21fe-43d8-b51c-423b75cd97a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-628ae998-dd00-4734-9ae1-c95ce1046f64 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69a151bc-21fe-43d8-b51c-423b75cd97a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1141410789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d8b0fbd-4484-4151-84b3-632e6ffd2303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0dd9b2d347a477d96c8a4b53726601b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:00:37Z,use_quota=True,user_id='5cf5e2033d4e4b83852e40286fac75b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-628ae998-dd00-4734-9ae1-c95ce1046f64 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03a5801f-aebd-4460-956f-f51ff577c382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-628ae998-dd00-4734-9ae1-c95ce1046f64 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03a5801f-aebd-4460-956f-f51ff577c382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-628ae998-dd00-4734-9ae1-c95ce1046f64 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f336e34-461a-4660-ac06-15e227d8052f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-628ae998-dd00-4734-9ae1-c95ce1046f64 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f336e34-461a-4660-ac06-15e227d8052f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d8b0fbd-4484-4151-84b3-632e6ffd2303', 'volume_name': 'volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-628ae998-dd00-4734-9ae1-c95ce1046f64 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf0ebb71-7a75-41bc-b467-3fb1adc2b094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-628ae998-dd00-4734-9ae1-c95ce1046f64 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf0ebb71-7a75-41bc-b467-3fb1adc2b094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:37 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-628ae998-dd00-4734-9ae1-c95ce1046f64 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0d1566d-9cfe-491e-8a55-dbb957dcc2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:37 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-628ae998-dd00-4734-9ae1-c95ce1046f64 tempest-ProjectReaderTests-1214970823 None] Volume 7d8b0fbd-4484-4151-84b3-632e6ffd2303: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303', 'volume_size': 1} Jul 10 07:00:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-628ae998-dd00-4734-9ae1-c95ce1046f64 tempest-ProjectReaderTests-1214970823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:00:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-628ae998-dd00-4734-9ae1-c95ce1046f64 tempest-ProjectReaderTests-1214970823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:00:37 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-628ae998-dd00-4734-9ae1-c95ce1046f64 tempest-ProjectReaderTests-1214970823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1141410789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d8b0fbd-4484-4151-84b3-632e6ffd2303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0dd9b2d347a477d96c8a4b53726601b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:00:37Z,use_quota=True,user_id='5cf5e2033d4e4b83852e40286fac75b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:00:37 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-628ae998-dd00-4734-9ae1-c95ce1046f64 tempest-ProjectReaderTests-1214970823 None] Creating volume 7d8b0fbd-4484-4151-84b3-632e6ffd2303 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:00:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-628ae998-dd00-4734-9ae1-c95ce1046f64 tempest-ProjectReaderTests-1214970823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:00:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-628ae998-dd00-4734-9ae1-c95ce1046f64 tempest-ProjectReaderTests-1214970823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:00:37 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-628ae998-dd00-4734-9ae1-c95ce1046f64 tempest-ProjectReaderTests-1214970823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:00:37 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-628ae998-dd00-4734-9ae1-c95ce1046f64 tempest-ProjectReaderTests-1214970823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:00:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-628ae998-dd00-4734-9ae1-c95ce1046f64 tempest-ProjectReaderTests-1214970823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:00:37 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-628ae998-dd00-4734-9ae1-c95ce1046f64 tempest-ProjectReaderTests-1214970823 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:00:37 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-628ae998-dd00-4734-9ae1-c95ce1046f64 tempest-ProjectReaderTests-1214970823 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 07:00:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-628ae998-dd00-4734-9ae1-c95ce1046f64 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:37 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303 1073741824 Jul 10 07:00:37 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:38 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-628ae998-dd00-4734-9ae1-c95ce1046f64 tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303 1073741824" returned: 0 in 0.766s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-628ae998-dd00-4734-9ae1-c95ce1046f64 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:38 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303 Jul 10 07:00:38 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:38 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-628ae998-dd00-4734-9ae1-c95ce1046f64 tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303" returned: 0 in 0.612s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:38 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-628ae998-dd00-4734-9ae1-c95ce1046f64 tempest-ProjectReaderTests-1214970823 None] <== create_volume: return (1414ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:00:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-628ae998-dd00-4734-9ae1-c95ce1046f64 tempest-ProjectReaderTests-1214970823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.417s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:00:38 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-628ae998-dd00-4734-9ae1-c95ce1046f64 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0d1566d-9cfe-491e-8a55-dbb957dcc2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:38 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-628ae998-dd00-4734-9ae1-c95ce1046f64 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a2847ca-3b3d-43ac-84ed-31119a9b216c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:38 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-628ae998-dd00-4734-9ae1-c95ce1046f64 tempest-ProjectReaderTests-1214970823 None] Volume volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303 (7d8b0fbd-4484-4151-84b3-632e6ffd2303): created successfully Jul 10 07:00:38 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-628ae998-dd00-4734-9ae1-c95ce1046f64 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a2847ca-3b3d-43ac-84ed-31119a9b216c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:38 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-628ae998-dd00-4734-9ae1-c95ce1046f64 tempest-ProjectReaderTests-1214970823 None] Flow 'volume_create_manager' (7feacb5c-6268-4684-bf07-9411b4f83d37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:00:38 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-628ae998-dd00-4734-9ae1-c95ce1046f64 tempest-ProjectReaderTests-1214970823 None] Created volume successfully. Jul 10 07:00:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f7dfd8ce-6dfc-4024-acf1-7782aacc24d1 tempest-ProjectReaderTests-1214970823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:00:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f7dfd8ce-6dfc-4024-acf1-7782aacc24d1 tempest-ProjectReaderTests-1214970823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:00:39 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-f7dfd8ce-6dfc-4024-acf1-7782aacc24d1 tempest-ProjectReaderTests-1214970823 None] Creating offline snapshot 87f082c5-fe07-40c3-b9ec-a3d6c33f2f31 of volume 7d8b0fbd-4484-4151-84b3-632e6ffd2303 {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:00:39 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0e6e87-7be5-446b-8d31-19c6fbaffd2f]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:00:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f7dfd8ce-6dfc-4024-acf1-7782aacc24d1 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:39 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303 Jul 10 07:00:39 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:40 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f7dfd8ce-6dfc-4024-acf1-7782aacc24d1 tempest-ProjectReaderTests-1214970823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303" returned: 0 in 0.719s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:40 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f7dfd8ce-6dfc-4024-acf1-7782aacc24d1 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303.87f082c5-fe07-40c3-b9ec-a3d6c33f2f31 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:40 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303.87f082c5-fe07-40c3-b9ec-a3d6c33f2f31 1G Jul 10 07:00:40 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:41 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f7dfd8ce-6dfc-4024-acf1-7782aacc24d1 tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303.87f082c5-fe07-40c3-b9ec-a3d6c33f2f31 1G" returned: 0 in 0.766s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f7dfd8ce-6dfc-4024-acf1-7782aacc24d1 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303.87f082c5-fe07-40c3-b9ec-a3d6c33f2f31 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:41 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303.87f082c5-fe07-40c3-b9ec-a3d6c33f2f31 Jul 10 07:00:41 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:41 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f7dfd8ce-6dfc-4024-acf1-7782aacc24d1 tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303.87f082c5-fe07-40c3-b9ec-a3d6c33f2f31" returned: 0 in 0.655s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:41 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-f7dfd8ce-6dfc-4024-acf1-7782aacc24d1 tempest-ProjectReaderTests-1214970823 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303.87f082c5-fe07-40c3-b9ec-a3d6c33f2f31 is being set with open permissions: ugo+rw Jul 10 07:00:41 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f7dfd8ce-6dfc-4024-acf1-7782aacc24d1 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303.87f082c5-fe07-40c3-b9ec-a3d6c33f2f31 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:41 devstack sudo[107564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303.87f082c5-fe07-40c3-b9ec-a3d6c33f2f31 Jul 10 07:00:41 devstack sudo[107564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:42 devstack sudo[107564]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f7dfd8ce-6dfc-4024-acf1-7782aacc24d1 tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303.87f082c5-fe07-40c3-b9ec-a3d6c33f2f31" returned: 0 in 0.610s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f7dfd8ce-6dfc-4024-acf1-7782aacc24d1 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:42 devstack sudo[107567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303.info Jul 10 07:00:42 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:42 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f7dfd8ce-6dfc-4024-acf1-7782aacc24d1 tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303.info" returned: 0 in 0.598s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:42 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-f7dfd8ce-6dfc-4024-acf1-7782aacc24d1 tempest-ProjectReaderTests-1214970823 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303.info is being set with open permissions: ugo+rw Jul 10 07:00:42 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f7dfd8ce-6dfc-4024-acf1-7782aacc24d1 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:42 devstack sudo[107570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303.info Jul 10 07:00:42 devstack sudo[107570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:43 devstack sudo[107570]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f7dfd8ce-6dfc-4024-acf1-7782aacc24d1 tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303.info" returned: 0 in 0.594s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f7dfd8ce-6dfc-4024-acf1-7782aacc24d1 tempest-ProjectReaderTests-1214970823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.032s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:00:43 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-f7dfd8ce-6dfc-4024-acf1-7782aacc24d1 tempest-ProjectReaderTests-1214970823 None] Create snapshot completed successfully Jul 10 07:00:43 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b60fb0e8-0d9a-4a35-bdbc-4b518047a675 tempest-ProjectReaderTests-1214970823 None] Acquiring lock "cinder-87f082c5-fe07-40c3-b9ec-a3d6c33f2f31-delete_snapshot" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:00:43 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b60fb0e8-0d9a-4a35-bdbc-4b518047a675 tempest-ProjectReaderTests-1214970823 None] Lock "cinder-87f082c5-fe07-40c3-b9ec-a3d6c33f2f31-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:00:43 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b60fb0e8-0d9a-4a35-bdbc-4b518047a675 tempest-ProjectReaderTests-1214970823 None] Acquiring lock "cinder-quobyte-7d8b0fbd-4484-4151-84b3-632e6ffd2303" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:00:43 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b60fb0e8-0d9a-4a35-bdbc-4b518047a675 tempest-ProjectReaderTests-1214970823 None] Lock "cinder-quobyte-7d8b0fbd-4484-4151-84b3-632e6ffd2303" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:00:43 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b60fb0e8-0d9a-4a35-bdbc-4b518047a675 tempest-ProjectReaderTests-1214970823 None] Acquiring lock "cinder-quobyte-87f082c5-fe07-40c3-b9ec-a3d6c33f2f31" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:00:43 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b60fb0e8-0d9a-4a35-bdbc-4b518047a675 tempest-ProjectReaderTests-1214970823 None] Lock "cinder-quobyte-87f082c5-fe07-40c3-b9ec-a3d6c33f2f31" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:00:43 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-b60fb0e8-0d9a-4a35-bdbc-4b518047a675 tempest-ProjectReaderTests-1214970823 None] Deleting offline snapshot 87f082c5-fe07-40c3-b9ec-a3d6c33f2f31 of volume 7d8b0fbd-4484-4151-84b3-632e6ffd2303 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:00:43 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-b60fb0e8-0d9a-4a35-bdbc-4b518047a675 tempest-ProjectReaderTests-1214970823 None] snapshot_file for this snap is: volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303.87f082c5-fe07-40c3-b9ec-a3d6c33f2f31 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:00:43 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afb8bb8-81c5-42b1-97bc-a4a8d04e5983]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:00:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b60fb0e8-0d9a-4a35-bdbc-4b518047a675 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303.87f082c5-fe07-40c3-b9ec-a3d6c33f2f31 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:43 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303.87f082c5-fe07-40c3-b9ec-a3d6c33f2f31 Jul 10 07:00:43 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:44 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b60fb0e8-0d9a-4a35-bdbc-4b518047a675 tempest-ProjectReaderTests-1214970823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303.87f082c5-fe07-40c3-b9ec-a3d6c33f2f31" returned: 0 in 0.708s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:44 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-b60fb0e8-0d9a-4a35-bdbc-4b518047a675 tempest-ProjectReaderTests-1214970823 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:00:44 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca6fc4b-4f19-4947-8638-067df629f657]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:00:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b60fb0e8-0d9a-4a35-bdbc-4b518047a675 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:44 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303 Jul 10 07:00:44 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:45 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b60fb0e8-0d9a-4a35-bdbc-4b518047a675 tempest-ProjectReaderTests-1214970823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303" returned: 0 in 0.722s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b60fb0e8-0d9a-4a35-bdbc-4b518047a675 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303.87f082c5-fe07-40c3-b9ec-a3d6c33f2f31 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:45 devstack sudo[107583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303.87f082c5-fe07-40c3-b9ec-a3d6c33f2f31 Jul 10 07:00:45 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:46 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b60fb0e8-0d9a-4a35-bdbc-4b518047a675 tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303.87f082c5-fe07-40c3-b9ec-a3d6c33f2f31" returned: 0 in 0.690s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b60fb0e8-0d9a-4a35-bdbc-4b518047a675 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303.87f082c5-fe07-40c3-b9ec-a3d6c33f2f31 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:46 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303.87f082c5-fe07-40c3-b9ec-a3d6c33f2f31 Jul 10 07:00:46 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:46 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-b60fb0e8-0d9a-4a35-bdbc-4b518047a675 tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303.87f082c5-fe07-40c3-b9ec-a3d6c33f2f31" returned: 0 in 0.593s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:46 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b60fb0e8-0d9a-4a35-bdbc-4b518047a675 tempest-ProjectReaderTests-1214970823 None] Lock "cinder-quobyte-87f082c5-fe07-40c3-b9ec-a3d6c33f2f31" released by "_delete_snapshot" :: held 2.798s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:00:46 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b60fb0e8-0d9a-4a35-bdbc-4b518047a675 tempest-ProjectReaderTests-1214970823 None] Lock "cinder-quobyte-7d8b0fbd-4484-4151-84b3-632e6ffd2303" released by "delete_snapshot" :: held 2.820s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:00:46 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-b60fb0e8-0d9a-4a35-bdbc-4b518047a675 tempest-ProjectReaderTests-1214970823 None] Created reservations ['f2812fe5-dd78-4bbc-a9ab-e937968ab22a', '6f8e53ce-3ae6-416a-a063-7f22bd35af0d', '98482abc-9a01-4201-9863-d1cf81ab6d55', '4291db98-0e7a-454d-903b-a44fcb1f679b'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:00:46 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-b60fb0e8-0d9a-4a35-bdbc-4b518047a675 tempest-ProjectReaderTests-1214970823 None] Delete snapshot completed successfully. Jul 10 07:00:46 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-b60fb0e8-0d9a-4a35-bdbc-4b518047a675 tempest-ProjectReaderTests-1214970823 None] Lock "cinder-87f082c5-fe07-40c3-b9ec-a3d6c33f2f31-delete_snapshot" released by "delete_snapshot" :: held 2.987s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:00:46 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-668e1470-e6ad-443c-a35f-6001243d821d tempest-ProjectReaderTests-1214970823 None] Acquiring lock "cinder-7d8b0fbd-4484-4151-84b3-632e6ffd2303-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:00:46 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-668e1470-e6ad-443c-a35f-6001243d821d tempest-ProjectReaderTests-1214970823 None] Lock "cinder-7d8b0fbd-4484-4151-84b3-632e6ffd2303-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:00:46 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-668e1470-e6ad-443c-a35f-6001243d821d tempest-ProjectReaderTests-1214970823 None] Acquiring lock "cinder-quobyte-7d8b0fbd-4484-4151-84b3-632e6ffd2303" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:00:47 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-668e1470-e6ad-443c-a35f-6001243d821d tempest-ProjectReaderTests-1214970823 None] Lock "cinder-quobyte-7d8b0fbd-4484-4151-84b3-632e6ffd2303" acquired by "delete_volume" :: waited 0.013s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:00:47 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bae7bae-067b-4679-b3d6-d8fca8d988c5]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:00:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-668e1470-e6ad-443c-a35f-6001243d821d tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:47 devstack sudo[107591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303 Jul 10 07:00:47 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:47 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-668e1470-e6ad-443c-a35f-6001243d821d tempest-ProjectReaderTests-1214970823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303" returned: 0 in 0.724s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-668e1470-e6ad-443c-a35f-6001243d821d tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:47 devstack sudo[107596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303 Jul 10 07:00:47 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:48 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-668e1470-e6ad-443c-a35f-6001243d821d tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-7d8b0fbd-4484-4151-84b3-632e6ffd2303" returned: 0 in 0.612s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:48 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-668e1470-e6ad-443c-a35f-6001243d821d tempest-ProjectReaderTests-1214970823 None] Lock "cinder-quobyte-7d8b0fbd-4484-4151-84b3-632e6ffd2303" released by "delete_volume" :: held 1.387s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:00:48 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-668e1470-e6ad-443c-a35f-6001243d821d tempest-ProjectReaderTests-1214970823 None] Created reservations ['5355c6c8-80c7-442d-ac02-2ec6a4324a53', '575f3e9d-1348-4dac-b8cd-d1b5a09738e5', '0bd4ea4d-6132-4926-bfb4-5bc7ba2d22d8', '75073dae-a376-4824-b0f6-faa7425c2a67'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:00:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-668e1470-e6ad-443c-a35f-6001243d821d tempest-ProjectReaderTests-1214970823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:00:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-668e1470-e6ad-443c-a35f-6001243d821d tempest-ProjectReaderTests-1214970823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:00:48 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-668e1470-e6ad-443c-a35f-6001243d821d tempest-ProjectReaderTests-1214970823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:00:48 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-668e1470-e6ad-443c-a35f-6001243d821d tempest-ProjectReaderTests-1214970823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:00:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-668e1470-e6ad-443c-a35f-6001243d821d tempest-ProjectReaderTests-1214970823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:00:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-668e1470-e6ad-443c-a35f-6001243d821d tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:48 devstack sudo[107599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 07:00:48 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:49 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-668e1470-e6ad-443c-a35f-6001243d821d tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.601s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:49 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-668e1470-e6ad-443c-a35f-6001243d821d tempest-ProjectReaderTests-1214970823 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:00:49 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-668e1470-e6ad-443c-a35f-6001243d821d tempest-ProjectReaderTests-1214970823 None] Deleted volume successfully. Jul 10 07:00:49 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-668e1470-e6ad-443c-a35f-6001243d821d tempest-ProjectReaderTests-1214970823 None] Lock "cinder-7d8b0fbd-4484-4151-84b3-632e6ffd2303-delete_volume" released by "delete_volume" :: held 2.168s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:00:49 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-abe39cf3-70f0-47d6-886c-1aaa8df7d385 tempest-ProjectReaderTests-1214970823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:00:49 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-abe39cf3-70f0-47d6-886c-1aaa8df7d385 tempest-ProjectReaderTests-1214970823 None] Flow 'volume_create_manager' (7fa12d70-8f4e-45a7-acca-54a976bb1051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:00:49 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-abe39cf3-70f0-47d6-886c-1aaa8df7d385 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9fbd785-442e-4435-95f2-a25cf26a3bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:49 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-abe39cf3-70f0-47d6-886c-1aaa8df7d385 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9fbd785-442e-4435-95f2-a25cf26a3bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1124498302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=098e2e81-94d1-4a9b-bba3-78a85ee602bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0dd9b2d347a477d96c8a4b53726601b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:00:50Z,use_quota=True,user_id='5cf5e2033d4e4b83852e40286fac75b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:49 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-abe39cf3-70f0-47d6-886c-1aaa8df7d385 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaa73c05-3a68-4352-8006-dcaa2006c852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:49 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-abe39cf3-70f0-47d6-886c-1aaa8df7d385 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaa73c05-3a68-4352-8006-dcaa2006c852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:49 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-abe39cf3-70f0-47d6-886c-1aaa8df7d385 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6897c067-a9c5-4d33-8d1c-ac1a1d62b366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:49 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-abe39cf3-70f0-47d6-886c-1aaa8df7d385 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6897c067-a9c5-4d33-8d1c-ac1a1d62b366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '098e2e81-94d1-4a9b-bba3-78a85ee602bf', 'volume_name': 'volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:49 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-abe39cf3-70f0-47d6-886c-1aaa8df7d385 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7923eb7e-d9ca-4663-beea-948a33c831d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:49 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-abe39cf3-70f0-47d6-886c-1aaa8df7d385 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7923eb7e-d9ca-4663-beea-948a33c831d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:49 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-abe39cf3-70f0-47d6-886c-1aaa8df7d385 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7867c3ec-2090-40ba-af0e-b52b9a1606db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:49 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-abe39cf3-70f0-47d6-886c-1aaa8df7d385 tempest-ProjectReaderTests-1214970823 None] Volume 098e2e81-94d1-4a9b-bba3-78a85ee602bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf', 'volume_size': 1} Jul 10 07:00:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-abe39cf3-70f0-47d6-886c-1aaa8df7d385 tempest-ProjectReaderTests-1214970823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:00:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-abe39cf3-70f0-47d6-886c-1aaa8df7d385 tempest-ProjectReaderTests-1214970823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:00:49 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-abe39cf3-70f0-47d6-886c-1aaa8df7d385 tempest-ProjectReaderTests-1214970823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1124498302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=098e2e81-94d1-4a9b-bba3-78a85ee602bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0dd9b2d347a477d96c8a4b53726601b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:00:50Z,use_quota=True,user_id='5cf5e2033d4e4b83852e40286fac75b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:00:49 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-abe39cf3-70f0-47d6-886c-1aaa8df7d385 tempest-ProjectReaderTests-1214970823 None] Creating volume 098e2e81-94d1-4a9b-bba3-78a85ee602bf {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:00:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-abe39cf3-70f0-47d6-886c-1aaa8df7d385 tempest-ProjectReaderTests-1214970823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:00:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-abe39cf3-70f0-47d6-886c-1aaa8df7d385 tempest-ProjectReaderTests-1214970823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:00:49 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-abe39cf3-70f0-47d6-886c-1aaa8df7d385 tempest-ProjectReaderTests-1214970823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:00:49 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-abe39cf3-70f0-47d6-886c-1aaa8df7d385 tempest-ProjectReaderTests-1214970823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:00:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-abe39cf3-70f0-47d6-886c-1aaa8df7d385 tempest-ProjectReaderTests-1214970823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:00:49 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-abe39cf3-70f0-47d6-886c-1aaa8df7d385 tempest-ProjectReaderTests-1214970823 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:00:49 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-abe39cf3-70f0-47d6-886c-1aaa8df7d385 tempest-ProjectReaderTests-1214970823 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 07:00:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-abe39cf3-70f0-47d6-886c-1aaa8df7d385 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:49 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf 1073741824 Jul 10 07:00:49 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:50 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-abe39cf3-70f0-47d6-886c-1aaa8df7d385 tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf 1073741824" returned: 0 in 0.780s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-abe39cf3-70f0-47d6-886c-1aaa8df7d385 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:50 devstack sudo[107608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf Jul 10 07:00:50 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:51 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-abe39cf3-70f0-47d6-886c-1aaa8df7d385 tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf" returned: 0 in 0.610s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:51 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-abe39cf3-70f0-47d6-886c-1aaa8df7d385 tempest-ProjectReaderTests-1214970823 None] <== create_volume: return (1427ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:00:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-abe39cf3-70f0-47d6-886c-1aaa8df7d385 tempest-ProjectReaderTests-1214970823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.430s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:00:51 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-abe39cf3-70f0-47d6-886c-1aaa8df7d385 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7867c3ec-2090-40ba-af0e-b52b9a1606db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:51 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-abe39cf3-70f0-47d6-886c-1aaa8df7d385 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e73ac5d-e892-4af2-b741-31e0c5c8b1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:00:51 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-abe39cf3-70f0-47d6-886c-1aaa8df7d385 tempest-ProjectReaderTests-1214970823 None] Volume volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf (098e2e81-94d1-4a9b-bba3-78a85ee602bf): created successfully Jul 10 07:00:51 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-abe39cf3-70f0-47d6-886c-1aaa8df7d385 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e73ac5d-e892-4af2-b741-31e0c5c8b1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:00:51 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-abe39cf3-70f0-47d6-886c-1aaa8df7d385 tempest-ProjectReaderTests-1214970823 None] Flow 'volume_create_manager' (7fa12d70-8f4e-45a7-acca-54a976bb1051) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:00:51 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-abe39cf3-70f0-47d6-886c-1aaa8df7d385 tempest-ProjectReaderTests-1214970823 None] Created volume successfully. Jul 10 07:00:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-bbee353a-9073-4d85-a64b-9e1e60e5769b tempest-ProjectReaderTests-1214970823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:00:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-bbee353a-9073-4d85-a64b-9e1e60e5769b tempest-ProjectReaderTests-1214970823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:00:51 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-bbee353a-9073-4d85-a64b-9e1e60e5769b tempest-ProjectReaderTests-1214970823 None] Creating offline snapshot 6e08ff3f-bff5-434a-8e95-5b1c6d2963b7 of volume 098e2e81-94d1-4a9b-bba3-78a85ee602bf {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:00:51 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef22de7-d796-4854-8148-75fb817d42d3]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:00:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bbee353a-9073-4d85-a64b-9e1e60e5769b tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:51 devstack sudo[107611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf Jul 10 07:00:51 devstack sudo[107611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:52 devstack sudo[107611]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bbee353a-9073-4d85-a64b-9e1e60e5769b tempest-ProjectReaderTests-1214970823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf" returned: 0 in 0.723s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bbee353a-9073-4d85-a64b-9e1e60e5769b tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf.6e08ff3f-bff5-434a-8e95-5b1c6d2963b7 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:52 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf.6e08ff3f-bff5-434a-8e95-5b1c6d2963b7 1G Jul 10 07:00:52 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:53 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bbee353a-9073-4d85-a64b-9e1e60e5769b tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf.6e08ff3f-bff5-434a-8e95-5b1c6d2963b7 1G" returned: 0 in 0.730s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bbee353a-9073-4d85-a64b-9e1e60e5769b tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf.6e08ff3f-bff5-434a-8e95-5b1c6d2963b7 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:53 devstack sudo[107621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf.6e08ff3f-bff5-434a-8e95-5b1c6d2963b7 Jul 10 07:00:53 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:53 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bbee353a-9073-4d85-a64b-9e1e60e5769b tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf.6e08ff3f-bff5-434a-8e95-5b1c6d2963b7" returned: 0 in 0.646s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:53 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-bbee353a-9073-4d85-a64b-9e1e60e5769b tempest-ProjectReaderTests-1214970823 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf.6e08ff3f-bff5-434a-8e95-5b1c6d2963b7 is being set with open permissions: ugo+rw Jul 10 07:00:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bbee353a-9073-4d85-a64b-9e1e60e5769b tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf.6e08ff3f-bff5-434a-8e95-5b1c6d2963b7 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:53 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf.6e08ff3f-bff5-434a-8e95-5b1c6d2963b7 Jul 10 07:00:53 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:54 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bbee353a-9073-4d85-a64b-9e1e60e5769b tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf.6e08ff3f-bff5-434a-8e95-5b1c6d2963b7" returned: 0 in 0.610s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bbee353a-9073-4d85-a64b-9e1e60e5769b tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:54 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf.info Jul 10 07:00:54 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:55 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bbee353a-9073-4d85-a64b-9e1e60e5769b tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf.info" returned: 0 in 0.612s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:55 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-bbee353a-9073-4d85-a64b-9e1e60e5769b tempest-ProjectReaderTests-1214970823 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf.info is being set with open permissions: ugo+rw Jul 10 07:00:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bbee353a-9073-4d85-a64b-9e1e60e5769b tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:55 devstack sudo[107633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf.info Jul 10 07:00:55 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:55 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-bbee353a-9073-4d85-a64b-9e1e60e5769b tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf.info" returned: 0 in 0.608s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-bbee353a-9073-4d85-a64b-9e1e60e5769b tempest-ProjectReaderTests-1214970823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.004s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:00:55 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-bbee353a-9073-4d85-a64b-9e1e60e5769b tempest-ProjectReaderTests-1214970823 None] Create snapshot completed successfully Jul 10 07:00:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-3ccd8edf-53b9-4553-80d7-4f5d50a9a1d2 tempest-ProjectReaderTests-1214970823 None] Acquiring lock "cinder-6e08ff3f-bff5-434a-8e95-5b1c6d2963b7-delete_snapshot" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:00:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-3ccd8edf-53b9-4553-80d7-4f5d50a9a1d2 tempest-ProjectReaderTests-1214970823 None] Lock "cinder-6e08ff3f-bff5-434a-8e95-5b1c6d2963b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:00:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-3ccd8edf-53b9-4553-80d7-4f5d50a9a1d2 tempest-ProjectReaderTests-1214970823 None] Acquiring lock "cinder-quobyte-098e2e81-94d1-4a9b-bba3-78a85ee602bf" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:00:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-3ccd8edf-53b9-4553-80d7-4f5d50a9a1d2 tempest-ProjectReaderTests-1214970823 None] Lock "cinder-quobyte-098e2e81-94d1-4a9b-bba3-78a85ee602bf" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:00:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-3ccd8edf-53b9-4553-80d7-4f5d50a9a1d2 tempest-ProjectReaderTests-1214970823 None] Acquiring lock "cinder-quobyte-6e08ff3f-bff5-434a-8e95-5b1c6d2963b7" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:00:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-3ccd8edf-53b9-4553-80d7-4f5d50a9a1d2 tempest-ProjectReaderTests-1214970823 None] Lock "cinder-quobyte-6e08ff3f-bff5-434a-8e95-5b1c6d2963b7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:00:55 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-3ccd8edf-53b9-4553-80d7-4f5d50a9a1d2 tempest-ProjectReaderTests-1214970823 None] Deleting offline snapshot 6e08ff3f-bff5-434a-8e95-5b1c6d2963b7 of volume 098e2e81-94d1-4a9b-bba3-78a85ee602bf {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:00:55 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-3ccd8edf-53b9-4553-80d7-4f5d50a9a1d2 tempest-ProjectReaderTests-1214970823 None] snapshot_file for this snap is: volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf.6e08ff3f-bff5-434a-8e95-5b1c6d2963b7 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:00:56 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[35daf4dd-f91d-4149-8667-01d72a5e20a3]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:00:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3ccd8edf-53b9-4553-80d7-4f5d50a9a1d2 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf.6e08ff3f-bff5-434a-8e95-5b1c6d2963b7 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:56 devstack sudo[107636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf.6e08ff3f-bff5-434a-8e95-5b1c6d2963b7 Jul 10 07:00:56 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:56 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3ccd8edf-53b9-4553-80d7-4f5d50a9a1d2 tempest-ProjectReaderTests-1214970823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf.6e08ff3f-bff5-434a-8e95-5b1c6d2963b7" returned: 0 in 0.724s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:56 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-3ccd8edf-53b9-4553-80d7-4f5d50a9a1d2 tempest-ProjectReaderTests-1214970823 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:00:56 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[03505f67-6486-4701-b8fc-d4ceecb405c7]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:00:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3ccd8edf-53b9-4553-80d7-4f5d50a9a1d2 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:56 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf Jul 10 07:00:56 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:57 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3ccd8edf-53b9-4553-80d7-4f5d50a9a1d2 tempest-ProjectReaderTests-1214970823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf" returned: 0 in 0.711s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3ccd8edf-53b9-4553-80d7-4f5d50a9a1d2 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf.6e08ff3f-bff5-434a-8e95-5b1c6d2963b7 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:57 devstack sudo[107648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf.6e08ff3f-bff5-434a-8e95-5b1c6d2963b7 Jul 10 07:00:57 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:58 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3ccd8edf-53b9-4553-80d7-4f5d50a9a1d2 tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf.6e08ff3f-bff5-434a-8e95-5b1c6d2963b7" returned: 0 in 0.674s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3ccd8edf-53b9-4553-80d7-4f5d50a9a1d2 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf.6e08ff3f-bff5-434a-8e95-5b1c6d2963b7 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:58 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf.6e08ff3f-bff5-434a-8e95-5b1c6d2963b7 Jul 10 07:00:58 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:58 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-3ccd8edf-53b9-4553-80d7-4f5d50a9a1d2 tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf.6e08ff3f-bff5-434a-8e95-5b1c6d2963b7" returned: 0 in 0.620s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:58 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-3ccd8edf-53b9-4553-80d7-4f5d50a9a1d2 tempest-ProjectReaderTests-1214970823 None] Lock "cinder-quobyte-6e08ff3f-bff5-434a-8e95-5b1c6d2963b7" released by "_delete_snapshot" :: held 2.818s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:00:58 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-3ccd8edf-53b9-4553-80d7-4f5d50a9a1d2 tempest-ProjectReaderTests-1214970823 None] Lock "cinder-quobyte-098e2e81-94d1-4a9b-bba3-78a85ee602bf" released by "delete_snapshot" :: held 2.839s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:00:58 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:UPDATE=83,cinder:SELECT=61,cinder:DELETE=10,cinder:INSERT=20 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:00:58 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:SELECT=69,cinder:INSERT=26,cinder:UPDATE=86,cinder:DELETE=5 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:00:58 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-3ccd8edf-53b9-4553-80d7-4f5d50a9a1d2 tempest-ProjectReaderTests-1214970823 None] Created reservations ['3065e5bb-cc83-4fc9-a802-9c9b3f34b171', '1151fe95-28b7-47cb-8840-e15e568ea4a6', 'f78f3e21-7b31-42d3-aa54-d5b7f267a6ce', 'ec70a434-7cb5-4308-9557-18f805d30e33'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:00:58 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-3ccd8edf-53b9-4553-80d7-4f5d50a9a1d2 tempest-ProjectReaderTests-1214970823 None] Delete snapshot completed successfully. Jul 10 07:00:58 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-3ccd8edf-53b9-4553-80d7-4f5d50a9a1d2 tempest-ProjectReaderTests-1214970823 None] Lock "cinder-6e08ff3f-bff5-434a-8e95-5b1c6d2963b7-delete_snapshot" released by "delete_snapshot" :: held 2.966s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:00:59 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-99da820c-8410-42e6-9bd6-ccd1b4e03e78 tempest-ProjectReaderTests-1214970823 None] Acquiring lock "cinder-098e2e81-94d1-4a9b-bba3-78a85ee602bf-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:00:59 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-99da820c-8410-42e6-9bd6-ccd1b4e03e78 tempest-ProjectReaderTests-1214970823 None] Lock "cinder-098e2e81-94d1-4a9b-bba3-78a85ee602bf-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:00:59 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-99da820c-8410-42e6-9bd6-ccd1b4e03e78 tempest-ProjectReaderTests-1214970823 None] Acquiring lock "cinder-quobyte-098e2e81-94d1-4a9b-bba3-78a85ee602bf" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:00:59 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-99da820c-8410-42e6-9bd6-ccd1b4e03e78 tempest-ProjectReaderTests-1214970823 None] Lock "cinder-quobyte-098e2e81-94d1-4a9b-bba3-78a85ee602bf" acquired by "delete_volume" :: waited 0.013s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:00:59 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2bdfb0-1ca9-452d-b00b-dda77eb6a183]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:00:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-99da820c-8410-42e6-9bd6-ccd1b4e03e78 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:59 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf Jul 10 07:00:59 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:00:59 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Jul 10 07:00:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-99da820c-8410-42e6-9bd6-ccd1b4e03e78 tempest-ProjectReaderTests-1214970823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf" returned: 0 in 0.711s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:00:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-99da820c-8410-42e6-9bd6-ccd1b4e03e78 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:00:59 devstack sudo[107662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf Jul 10 07:00:59 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:00 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-99da820c-8410-42e6-9bd6-ccd1b4e03e78 tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-098e2e81-94d1-4a9b-bba3-78a85ee602bf" returned: 0 in 0.628s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:00 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-99da820c-8410-42e6-9bd6-ccd1b4e03e78 tempest-ProjectReaderTests-1214970823 None] Lock "cinder-quobyte-098e2e81-94d1-4a9b-bba3-78a85ee602bf" released by "delete_volume" :: held 1.391s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:01:00 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-99da820c-8410-42e6-9bd6-ccd1b4e03e78 tempest-ProjectReaderTests-1214970823 None] Created reservations ['99beef81-5ef0-422c-9277-fd9bb08a8e35', '5d787b64-bad3-4e78-869d-96bb6170d999', '458f46b4-0ea1-4d3c-b99a-f7e69db8a88f', '4649b1f0-29a7-4264-b7e3-cbcd6b509f1e'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:01:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-99da820c-8410-42e6-9bd6-ccd1b4e03e78 tempest-ProjectReaderTests-1214970823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:01:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-99da820c-8410-42e6-9bd6-ccd1b4e03e78 tempest-ProjectReaderTests-1214970823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:01:00 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-99da820c-8410-42e6-9bd6-ccd1b4e03e78 tempest-ProjectReaderTests-1214970823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:01:00 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-99da820c-8410-42e6-9bd6-ccd1b4e03e78 tempest-ProjectReaderTests-1214970823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:01:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-99da820c-8410-42e6-9bd6-ccd1b4e03e78 tempest-ProjectReaderTests-1214970823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:01:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-99da820c-8410-42e6-9bd6-ccd1b4e03e78 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:00 devstack sudo[107666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 07:01:00 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:01 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-99da820c-8410-42e6-9bd6-ccd1b4e03e78 tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.609s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:01 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-99da820c-8410-42e6-9bd6-ccd1b4e03e78 tempest-ProjectReaderTests-1214970823 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:01:01 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-99da820c-8410-42e6-9bd6-ccd1b4e03e78 tempest-ProjectReaderTests-1214970823 None] Deleted volume successfully. Jul 10 07:01:01 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-99da820c-8410-42e6-9bd6-ccd1b4e03e78 tempest-ProjectReaderTests-1214970823 None] Lock "cinder-098e2e81-94d1-4a9b-bba3-78a85ee602bf-delete_volume" released by "delete_volume" :: held 2.173s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:01:01 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-21f1c1d4-4287-4c02-9f19-cb7aace328c2 tempest-ProjectReaderTests-1214970823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:01:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-21f1c1d4-4287-4c02-9f19-cb7aace328c2 tempest-ProjectReaderTests-1214970823 None] Flow 'volume_create_manager' (f5df1cd2-7b83-448a-9461-e720712cd65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:01:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-21f1c1d4-4287-4c02-9f19-cb7aace328c2 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64456df0-9045-469b-b7d1-8305ce50ccde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-21f1c1d4-4287-4c02-9f19-cb7aace328c2 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64456df0-9045-469b-b7d1-8305ce50ccde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1434710189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e67eb46-9756-46a9-afd0-cc8c18f5de3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0dd9b2d347a477d96c8a4b53726601b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:01:02Z,use_quota=True,user_id='5cf5e2033d4e4b83852e40286fac75b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-21f1c1d4-4287-4c02-9f19-cb7aace328c2 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f63744bc-5892-431d-ae2b-802ecb2cd0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-21f1c1d4-4287-4c02-9f19-cb7aace328c2 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f63744bc-5892-431d-ae2b-802ecb2cd0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-21f1c1d4-4287-4c02-9f19-cb7aace328c2 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b17a7e7-6e4b-44f3-a7d2-912165584d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-21f1c1d4-4287-4c02-9f19-cb7aace328c2 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b17a7e7-6e4b-44f3-a7d2-912165584d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e67eb46-9756-46a9-afd0-cc8c18f5de3e', 'volume_name': 'volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-21f1c1d4-4287-4c02-9f19-cb7aace328c2 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d34844d-d726-4c64-99ca-19abd3eeda87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-21f1c1d4-4287-4c02-9f19-cb7aace328c2 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d34844d-d726-4c64-99ca-19abd3eeda87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:01 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-21f1c1d4-4287-4c02-9f19-cb7aace328c2 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7593da1c-b16c-4366-9e11-59e64a228883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:01 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-21f1c1d4-4287-4c02-9f19-cb7aace328c2 tempest-ProjectReaderTests-1214970823 None] Volume 0e67eb46-9756-46a9-afd0-cc8c18f5de3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e', 'volume_size': 1} Jul 10 07:01:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-21f1c1d4-4287-4c02-9f19-cb7aace328c2 tempest-ProjectReaderTests-1214970823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:01:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-21f1c1d4-4287-4c02-9f19-cb7aace328c2 tempest-ProjectReaderTests-1214970823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:01:01 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-21f1c1d4-4287-4c02-9f19-cb7aace328c2 tempest-ProjectReaderTests-1214970823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1434710189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e67eb46-9756-46a9-afd0-cc8c18f5de3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0dd9b2d347a477d96c8a4b53726601b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:01:02Z,use_quota=True,user_id='5cf5e2033d4e4b83852e40286fac75b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:01:01 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-21f1c1d4-4287-4c02-9f19-cb7aace328c2 tempest-ProjectReaderTests-1214970823 None] Creating volume 0e67eb46-9756-46a9-afd0-cc8c18f5de3e {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:01:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-21f1c1d4-4287-4c02-9f19-cb7aace328c2 tempest-ProjectReaderTests-1214970823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:01:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-21f1c1d4-4287-4c02-9f19-cb7aace328c2 tempest-ProjectReaderTests-1214970823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:01:01 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-21f1c1d4-4287-4c02-9f19-cb7aace328c2 tempest-ProjectReaderTests-1214970823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:01:01 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-21f1c1d4-4287-4c02-9f19-cb7aace328c2 tempest-ProjectReaderTests-1214970823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:01:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-21f1c1d4-4287-4c02-9f19-cb7aace328c2 tempest-ProjectReaderTests-1214970823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:01:01 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-21f1c1d4-4287-4c02-9f19-cb7aace328c2 tempest-ProjectReaderTests-1214970823 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:01:01 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-21f1c1d4-4287-4c02-9f19-cb7aace328c2 tempest-ProjectReaderTests-1214970823 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 07:01:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-21f1c1d4-4287-4c02-9f19-cb7aace328c2 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:01 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e 1073741824 Jul 10 07:01:01 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:02 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-21f1c1d4-4287-4c02-9f19-cb7aace328c2 tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e 1073741824" returned: 0 in 0.776s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-21f1c1d4-4287-4c02-9f19-cb7aace328c2 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:02 devstack sudo[107675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e Jul 10 07:01:02 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:03 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-21f1c1d4-4287-4c02-9f19-cb7aace328c2 tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e" returned: 0 in 0.632s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:03 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-21f1c1d4-4287-4c02-9f19-cb7aace328c2 tempest-ProjectReaderTests-1214970823 None] <== create_volume: return (1463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:01:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-21f1c1d4-4287-4c02-9f19-cb7aace328c2 tempest-ProjectReaderTests-1214970823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:01:03 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-21f1c1d4-4287-4c02-9f19-cb7aace328c2 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7593da1c-b16c-4366-9e11-59e64a228883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:03 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-21f1c1d4-4287-4c02-9f19-cb7aace328c2 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3245739-f461-481d-a7db-4f26207337ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:03 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-21f1c1d4-4287-4c02-9f19-cb7aace328c2 tempest-ProjectReaderTests-1214970823 None] Volume volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e (0e67eb46-9756-46a9-afd0-cc8c18f5de3e): created successfully Jul 10 07:01:03 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-21f1c1d4-4287-4c02-9f19-cb7aace328c2 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3245739-f461-481d-a7db-4f26207337ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:03 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-21f1c1d4-4287-4c02-9f19-cb7aace328c2 tempest-ProjectReaderTests-1214970823 None] Flow 'volume_create_manager' (f5df1cd2-7b83-448a-9461-e720712cd65e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:01:03 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-21f1c1d4-4287-4c02-9f19-cb7aace328c2 tempest-ProjectReaderTests-1214970823 None] Created volume successfully. Jul 10 07:01:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-eae3626e-296d-4e45-b20c-f88768e4adc6 tempest-ProjectReaderTests-1214970823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:01:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-eae3626e-296d-4e45-b20c-f88768e4adc6 tempest-ProjectReaderTests-1214970823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:01:03 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-eae3626e-296d-4e45-b20c-f88768e4adc6 tempest-ProjectReaderTests-1214970823 None] Creating offline snapshot ad672935-c08e-4fd3-9ef5-cb5837322e91 of volume 0e67eb46-9756-46a9-afd0-cc8c18f5de3e {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:01:03 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e976648-a866-4342-a298-d22f257350ae]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:01:03 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-eae3626e-296d-4e45-b20c-f88768e4adc6 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:04 devstack sudo[107678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e Jul 10 07:01:04 devstack sudo[107678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:04 devstack sudo[107678]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-eae3626e-296d-4e45-b20c-f88768e4adc6 tempest-ProjectReaderTests-1214970823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e" returned: 0 in 0.717s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:04 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-eae3626e-296d-4e45-b20c-f88768e4adc6 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e.ad672935-c08e-4fd3-9ef5-cb5837322e91 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:04 devstack sudo[107683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e.ad672935-c08e-4fd3-9ef5-cb5837322e91 1G Jul 10 07:01:04 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:05 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-eae3626e-296d-4e45-b20c-f88768e4adc6 tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e.ad672935-c08e-4fd3-9ef5-cb5837322e91 1G" returned: 0 in 0.759s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:05 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-eae3626e-296d-4e45-b20c-f88768e4adc6 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e.ad672935-c08e-4fd3-9ef5-cb5837322e91 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:05 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e.ad672935-c08e-4fd3-9ef5-cb5837322e91 Jul 10 07:01:05 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:06 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-eae3626e-296d-4e45-b20c-f88768e4adc6 tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e.ad672935-c08e-4fd3-9ef5-cb5837322e91" returned: 0 in 0.656s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:06 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-eae3626e-296d-4e45-b20c-f88768e4adc6 tempest-ProjectReaderTests-1214970823 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e.ad672935-c08e-4fd3-9ef5-cb5837322e91 is being set with open permissions: ugo+rw Jul 10 07:01:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-eae3626e-296d-4e45-b20c-f88768e4adc6 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e.ad672935-c08e-4fd3-9ef5-cb5837322e91 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:06 devstack sudo[107693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e.ad672935-c08e-4fd3-9ef5-cb5837322e91 Jul 10 07:01:06 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:06 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-eae3626e-296d-4e45-b20c-f88768e4adc6 tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e.ad672935-c08e-4fd3-9ef5-cb5837322e91" returned: 0 in 0.607s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:06 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-eae3626e-296d-4e45-b20c-f88768e4adc6 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:06 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e.info Jul 10 07:01:06 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:07 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-eae3626e-296d-4e45-b20c-f88768e4adc6 tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e.info" returned: 0 in 0.663s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:07 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-eae3626e-296d-4e45-b20c-f88768e4adc6 tempest-ProjectReaderTests-1214970823 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e.info is being set with open permissions: ugo+rw Jul 10 07:01:07 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-eae3626e-296d-4e45-b20c-f88768e4adc6 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:07 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e.info Jul 10 07:01:07 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:08 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-eae3626e-296d-4e45-b20c-f88768e4adc6 tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e.info" returned: 0 in 0.595s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:08 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-eae3626e-296d-4e45-b20c-f88768e4adc6 tempest-ProjectReaderTests-1214970823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.072s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:01:08 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-eae3626e-296d-4e45-b20c-f88768e4adc6 tempest-ProjectReaderTests-1214970823 None] Create snapshot completed successfully Jul 10 07:01:09 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-23a85110-053e-4199-8512-ed44d18dad15 tempest-ProjectReaderTests-1214970823 None] Acquiring lock "cinder-ad672935-c08e-4fd3-9ef5-cb5837322e91-delete_snapshot" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:01:09 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-23a85110-053e-4199-8512-ed44d18dad15 tempest-ProjectReaderTests-1214970823 None] Lock "cinder-ad672935-c08e-4fd3-9ef5-cb5837322e91-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:01:09 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-23a85110-053e-4199-8512-ed44d18dad15 tempest-ProjectReaderTests-1214970823 None] Acquiring lock "cinder-quobyte-0e67eb46-9756-46a9-afd0-cc8c18f5de3e" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:01:09 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-23a85110-053e-4199-8512-ed44d18dad15 tempest-ProjectReaderTests-1214970823 None] Lock "cinder-quobyte-0e67eb46-9756-46a9-afd0-cc8c18f5de3e" acquired by "delete_snapshot" :: waited 0.012s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:01:09 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-23a85110-053e-4199-8512-ed44d18dad15 tempest-ProjectReaderTests-1214970823 None] Acquiring lock "cinder-quobyte-ad672935-c08e-4fd3-9ef5-cb5837322e91" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:01:09 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-23a85110-053e-4199-8512-ed44d18dad15 tempest-ProjectReaderTests-1214970823 None] Lock "cinder-quobyte-ad672935-c08e-4fd3-9ef5-cb5837322e91" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:01:09 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-23a85110-053e-4199-8512-ed44d18dad15 tempest-ProjectReaderTests-1214970823 None] Deleting offline snapshot ad672935-c08e-4fd3-9ef5-cb5837322e91 of volume 0e67eb46-9756-46a9-afd0-cc8c18f5de3e {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:01:09 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-23a85110-053e-4199-8512-ed44d18dad15 tempest-ProjectReaderTests-1214970823 None] snapshot_file for this snap is: volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e.ad672935-c08e-4fd3-9ef5-cb5837322e91 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:01:09 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce737274-422e-4727-bdee-3564a4803c10]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:01:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-23a85110-053e-4199-8512-ed44d18dad15 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e.ad672935-c08e-4fd3-9ef5-cb5837322e91 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:09 devstack sudo[107702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e.ad672935-c08e-4fd3-9ef5-cb5837322e91 Jul 10 07:01:09 devstack sudo[107702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:09 devstack sudo[107702]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-23a85110-053e-4199-8512-ed44d18dad15 tempest-ProjectReaderTests-1214970823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e.ad672935-c08e-4fd3-9ef5-cb5837322e91" returned: 0 in 0.710s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:09 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-23a85110-053e-4199-8512-ed44d18dad15 tempest-ProjectReaderTests-1214970823 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:01:09 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[e682ed97-c0f1-43b3-a021-92f88ddfd7d2]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:01:09 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-23a85110-053e-4199-8512-ed44d18dad15 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:10 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e Jul 10 07:01:10 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:10 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-23a85110-053e-4199-8512-ed44d18dad15 tempest-ProjectReaderTests-1214970823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e" returned: 0 in 0.705s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:10 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-23a85110-053e-4199-8512-ed44d18dad15 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e.ad672935-c08e-4fd3-9ef5-cb5837322e91 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:10 devstack sudo[107713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e.ad672935-c08e-4fd3-9ef5-cb5837322e91 Jul 10 07:01:10 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:11 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-23a85110-053e-4199-8512-ed44d18dad15 tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e.ad672935-c08e-4fd3-9ef5-cb5837322e91" returned: 0 in 0.688s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-23a85110-053e-4199-8512-ed44d18dad15 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e.ad672935-c08e-4fd3-9ef5-cb5837322e91 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:11 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e.ad672935-c08e-4fd3-9ef5-cb5837322e91 Jul 10 07:01:11 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:11 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:11 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-23a85110-053e-4199-8512-ed44d18dad15 tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e.ad672935-c08e-4fd3-9ef5-cb5837322e91" returned: 0 in 0.595s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:11 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-23a85110-053e-4199-8512-ed44d18dad15 tempest-ProjectReaderTests-1214970823 None] Lock "cinder-quobyte-ad672935-c08e-4fd3-9ef5-cb5837322e91" released by "_delete_snapshot" :: held 2.779s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:01:12 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-23a85110-053e-4199-8512-ed44d18dad15 tempest-ProjectReaderTests-1214970823 None] Lock "cinder-quobyte-0e67eb46-9756-46a9-afd0-cc8c18f5de3e" released by "delete_snapshot" :: held 2.799s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:01:12 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-23a85110-053e-4199-8512-ed44d18dad15 tempest-ProjectReaderTests-1214970823 None] Created reservations ['7164d884-9ec2-427d-b3e8-61f635541918', 'b471845a-5a02-4e08-9318-40b62992de1c', 'fbb48136-849a-46e4-8d80-ae64e7e55f20', 'ac51f9fd-0081-4d54-bde3-ba50675fb5da'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:01:12 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-23a85110-053e-4199-8512-ed44d18dad15 tempest-ProjectReaderTests-1214970823 None] Delete snapshot completed successfully. Jul 10 07:01:12 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-23a85110-053e-4199-8512-ed44d18dad15 tempest-ProjectReaderTests-1214970823 None] Lock "cinder-ad672935-c08e-4fd3-9ef5-cb5837322e91-delete_snapshot" released by "delete_snapshot" :: held 2.918s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:01:12 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-53c2e645-b9b6-46c2-8b14-22ab809b7ccb tempest-ProjectReaderTests-1214970823 None] Acquiring lock "cinder-0e67eb46-9756-46a9-afd0-cc8c18f5de3e-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:01:12 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-53c2e645-b9b6-46c2-8b14-22ab809b7ccb tempest-ProjectReaderTests-1214970823 None] Lock "cinder-0e67eb46-9756-46a9-afd0-cc8c18f5de3e-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:01:12 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-53c2e645-b9b6-46c2-8b14-22ab809b7ccb tempest-ProjectReaderTests-1214970823 None] Acquiring lock "cinder-quobyte-0e67eb46-9756-46a9-afd0-cc8c18f5de3e" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:01:12 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-53c2e645-b9b6-46c2-8b14-22ab809b7ccb tempest-ProjectReaderTests-1214970823 None] Lock "cinder-quobyte-0e67eb46-9756-46a9-afd0-cc8c18f5de3e" acquired by "delete_volume" :: waited 0.015s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:01:12 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e51801-7743-4676-8d5b-4341e1dac335]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:01:12 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-53c2e645-b9b6-46c2-8b14-22ab809b7ccb tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:12 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e Jul 10 07:01:12 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:13 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-53c2e645-b9b6-46c2-8b14-22ab809b7ccb tempest-ProjectReaderTests-1214970823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e" returned: 0 in 0.700s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-53c2e645-b9b6-46c2-8b14-22ab809b7ccb tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:13 devstack sudo[107726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e Jul 10 07:01:13 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:13 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-53c2e645-b9b6-46c2-8b14-22ab809b7ccb tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-0e67eb46-9756-46a9-afd0-cc8c18f5de3e" returned: 0 in 0.650s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:13 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-53c2e645-b9b6-46c2-8b14-22ab809b7ccb tempest-ProjectReaderTests-1214970823 None] Lock "cinder-quobyte-0e67eb46-9756-46a9-afd0-cc8c18f5de3e" released by "delete_volume" :: held 1.405s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:01:13 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-53c2e645-b9b6-46c2-8b14-22ab809b7ccb tempest-ProjectReaderTests-1214970823 None] Created reservations ['4247a99e-82b2-403f-b821-acf52501a682', '0b45257e-e362-450f-9d8f-897d6ad41646', 'dfac52fa-5674-407e-a630-51ece65cf72b', '332f56ad-888c-4ed0-9a2e-28bbc31c44ef'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:01:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-53c2e645-b9b6-46c2-8b14-22ab809b7ccb tempest-ProjectReaderTests-1214970823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:01:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-53c2e645-b9b6-46c2-8b14-22ab809b7ccb tempest-ProjectReaderTests-1214970823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:01:13 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-53c2e645-b9b6-46c2-8b14-22ab809b7ccb tempest-ProjectReaderTests-1214970823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:01:13 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-53c2e645-b9b6-46c2-8b14-22ab809b7ccb tempest-ProjectReaderTests-1214970823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:01:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-53c2e645-b9b6-46c2-8b14-22ab809b7ccb tempest-ProjectReaderTests-1214970823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:01:13 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-53c2e645-b9b6-46c2-8b14-22ab809b7ccb tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:13 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 07:01:13 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:14 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:14 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-53c2e645-b9b6-46c2-8b14-22ab809b7ccb tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.611s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:14 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-53c2e645-b9b6-46c2-8b14-22ab809b7ccb tempest-ProjectReaderTests-1214970823 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:01:14 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-53c2e645-b9b6-46c2-8b14-22ab809b7ccb tempest-ProjectReaderTests-1214970823 None] Deleted volume successfully. Jul 10 07:01:14 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-53c2e645-b9b6-46c2-8b14-22ab809b7ccb tempest-ProjectReaderTests-1214970823 None] Lock "cinder-0e67eb46-9756-46a9-afd0-cc8c18f5de3e-delete_volume" released by "delete_volume" :: held 2.204s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:01:14 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-4483d7cb-7a81-4003-855f-20c35bb6276d tempest-ProjectReaderTests-1214970823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:01:14 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-4483d7cb-7a81-4003-855f-20c35bb6276d tempest-ProjectReaderTests-1214970823 None] Flow 'volume_create_manager' (3c8f3e4e-3549-48b7-bff1-56767482fcae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:01:14 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-4483d7cb-7a81-4003-855f-20c35bb6276d tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d426b19-3d5a-4b3a-919b-89cd8152832c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-4483d7cb-7a81-4003-855f-20c35bb6276d tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d426b19-3d5a-4b3a-919b-89cd8152832c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-859506915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77ffc39e-ab67-4dc0-a067-c6fbf98deac2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0dd9b2d347a477d96c8a4b53726601b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:01:15Z,use_quota=True,user_id='5cf5e2033d4e4b83852e40286fac75b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-4483d7cb-7a81-4003-855f-20c35bb6276d tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bd4b960-05c7-4782-9916-1460a4c2cfd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-4483d7cb-7a81-4003-855f-20c35bb6276d tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bd4b960-05c7-4782-9916-1460a4c2cfd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-4483d7cb-7a81-4003-855f-20c35bb6276d tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (447f3cfd-b537-4dc9-8181-135ef8179c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-4483d7cb-7a81-4003-855f-20c35bb6276d tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (447f3cfd-b537-4dc9-8181-135ef8179c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77ffc39e-ab67-4dc0-a067-c6fbf98deac2', 'volume_name': 'volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-4483d7cb-7a81-4003-855f-20c35bb6276d tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a73829-5748-4b0f-9068-ba8e941ee47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-4483d7cb-7a81-4003-855f-20c35bb6276d tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a73829-5748-4b0f-9068-ba8e941ee47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:15 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-4483d7cb-7a81-4003-855f-20c35bb6276d tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b512eb57-9bfe-4916-926c-3f59db37bf1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:15 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-4483d7cb-7a81-4003-855f-20c35bb6276d tempest-ProjectReaderTests-1214970823 None] Volume 77ffc39e-ab67-4dc0-a067-c6fbf98deac2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2', 'volume_size': 1} Jul 10 07:01:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-4483d7cb-7a81-4003-855f-20c35bb6276d tempest-ProjectReaderTests-1214970823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:01:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-4483d7cb-7a81-4003-855f-20c35bb6276d tempest-ProjectReaderTests-1214970823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:01:15 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-4483d7cb-7a81-4003-855f-20c35bb6276d tempest-ProjectReaderTests-1214970823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-859506915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77ffc39e-ab67-4dc0-a067-c6fbf98deac2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0dd9b2d347a477d96c8a4b53726601b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:01:15Z,use_quota=True,user_id='5cf5e2033d4e4b83852e40286fac75b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:01:15 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-4483d7cb-7a81-4003-855f-20c35bb6276d tempest-ProjectReaderTests-1214970823 None] Creating volume 77ffc39e-ab67-4dc0-a067-c6fbf98deac2 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:01:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-4483d7cb-7a81-4003-855f-20c35bb6276d tempest-ProjectReaderTests-1214970823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:01:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-4483d7cb-7a81-4003-855f-20c35bb6276d tempest-ProjectReaderTests-1214970823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:01:15 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-4483d7cb-7a81-4003-855f-20c35bb6276d tempest-ProjectReaderTests-1214970823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:01:15 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-4483d7cb-7a81-4003-855f-20c35bb6276d tempest-ProjectReaderTests-1214970823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:01:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-4483d7cb-7a81-4003-855f-20c35bb6276d tempest-ProjectReaderTests-1214970823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:01:15 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-4483d7cb-7a81-4003-855f-20c35bb6276d tempest-ProjectReaderTests-1214970823 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:01:15 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-4483d7cb-7a81-4003-855f-20c35bb6276d tempest-ProjectReaderTests-1214970823 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 07:01:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-4483d7cb-7a81-4003-855f-20c35bb6276d tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:15 devstack sudo[107732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2 1073741824 Jul 10 07:01:15 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:15 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-4483d7cb-7a81-4003-855f-20c35bb6276d tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2 1073741824" returned: 0 in 0.763s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:15 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-4483d7cb-7a81-4003-855f-20c35bb6276d tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:15 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2 Jul 10 07:01:15 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:16 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-4483d7cb-7a81-4003-855f-20c35bb6276d tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2" returned: 0 in 0.658s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:16 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-4483d7cb-7a81-4003-855f-20c35bb6276d tempest-ProjectReaderTests-1214970823 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:01:16 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-4483d7cb-7a81-4003-855f-20c35bb6276d tempest-ProjectReaderTests-1214970823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:01:16 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-4483d7cb-7a81-4003-855f-20c35bb6276d tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b512eb57-9bfe-4916-926c-3f59db37bf1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:16 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-4483d7cb-7a81-4003-855f-20c35bb6276d tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e54f05b9-4609-4d44-8be7-e8cfda3496d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:16 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-4483d7cb-7a81-4003-855f-20c35bb6276d tempest-ProjectReaderTests-1214970823 None] Volume volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2 (77ffc39e-ab67-4dc0-a067-c6fbf98deac2): created successfully Jul 10 07:01:16 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-4483d7cb-7a81-4003-855f-20c35bb6276d tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e54f05b9-4609-4d44-8be7-e8cfda3496d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:16 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-4483d7cb-7a81-4003-855f-20c35bb6276d tempest-ProjectReaderTests-1214970823 None] Flow 'volume_create_manager' (3c8f3e4e-3549-48b7-bff1-56767482fcae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:01:16 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-4483d7cb-7a81-4003-855f-20c35bb6276d tempest-ProjectReaderTests-1214970823 None] Created volume successfully. Jul 10 07:01:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9b45819f-b7ca-4e24-8f36-43ac3c3028dc tempest-ProjectReaderTests-1214970823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:01:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9b45819f-b7ca-4e24-8f36-43ac3c3028dc tempest-ProjectReaderTests-1214970823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:01:17 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-9b45819f-b7ca-4e24-8f36-43ac3c3028dc tempest-ProjectReaderTests-1214970823 None] Creating offline snapshot 3f4485ea-0d3e-4e5d-ae20-d87cf4f68855 of volume 77ffc39e-ab67-4dc0-a067-c6fbf98deac2 {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:01:17 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[47119f8e-2f84-4269-a8ee-b5aa52a5c813]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:01:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9b45819f-b7ca-4e24-8f36-43ac3c3028dc tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:17 devstack sudo[107740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2 Jul 10 07:01:17 devstack sudo[107740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:17 devstack sudo[107740]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9b45819f-b7ca-4e24-8f36-43ac3c3028dc tempest-ProjectReaderTests-1214970823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2" returned: 0 in 0.723s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:17 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9b45819f-b7ca-4e24-8f36-43ac3c3028dc tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2.3f4485ea-0d3e-4e5d-ae20-d87cf4f68855 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:17 devstack sudo[107745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2.3f4485ea-0d3e-4e5d-ae20-d87cf4f68855 1G Jul 10 07:01:17 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:18 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9b45819f-b7ca-4e24-8f36-43ac3c3028dc tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2.3f4485ea-0d3e-4e5d-ae20-d87cf4f68855 1G" returned: 0 in 0.747s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:18 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9b45819f-b7ca-4e24-8f36-43ac3c3028dc tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2.3f4485ea-0d3e-4e5d-ae20-d87cf4f68855 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:18 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2.3f4485ea-0d3e-4e5d-ae20-d87cf4f68855 Jul 10 07:01:18 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:19 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9b45819f-b7ca-4e24-8f36-43ac3c3028dc tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2.3f4485ea-0d3e-4e5d-ae20-d87cf4f68855" returned: 0 in 0.643s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:19 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-9b45819f-b7ca-4e24-8f36-43ac3c3028dc tempest-ProjectReaderTests-1214970823 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2.3f4485ea-0d3e-4e5d-ae20-d87cf4f68855 is being set with open permissions: ugo+rw Jul 10 07:01:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9b45819f-b7ca-4e24-8f36-43ac3c3028dc tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2.3f4485ea-0d3e-4e5d-ae20-d87cf4f68855 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:19 devstack sudo[107755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2.3f4485ea-0d3e-4e5d-ae20-d87cf4f68855 Jul 10 07:01:19 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:19 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9b45819f-b7ca-4e24-8f36-43ac3c3028dc tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2.3f4485ea-0d3e-4e5d-ae20-d87cf4f68855" returned: 0 in 0.605s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:19 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9b45819f-b7ca-4e24-8f36-43ac3c3028dc tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:19 devstack sudo[107758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2.info Jul 10 07:01:19 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:20 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9b45819f-b7ca-4e24-8f36-43ac3c3028dc tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2.info" returned: 0 in 0.628s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:20 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-9b45819f-b7ca-4e24-8f36-43ac3c3028dc tempest-ProjectReaderTests-1214970823 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2.info is being set with open permissions: ugo+rw Jul 10 07:01:20 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9b45819f-b7ca-4e24-8f36-43ac3c3028dc tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:20 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2.info Jul 10 07:01:20 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:21 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-9b45819f-b7ca-4e24-8f36-43ac3c3028dc tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2.info" returned: 0 in 0.599s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-9b45819f-b7ca-4e24-8f36-43ac3c3028dc tempest-ProjectReaderTests-1214970823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.023s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:01:21 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-9b45819f-b7ca-4e24-8f36-43ac3c3028dc tempest-ProjectReaderTests-1214970823 None] Create snapshot completed successfully Jul 10 07:01:21 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e1a5f54f-4b4a-4849-8236-58090f55a7da tempest-ProjectReaderTests-1214970823 None] Acquiring lock "cinder-3f4485ea-0d3e-4e5d-ae20-d87cf4f68855-delete_snapshot" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:01:21 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e1a5f54f-4b4a-4849-8236-58090f55a7da tempest-ProjectReaderTests-1214970823 None] Lock "cinder-3f4485ea-0d3e-4e5d-ae20-d87cf4f68855-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:01:21 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e1a5f54f-4b4a-4849-8236-58090f55a7da tempest-ProjectReaderTests-1214970823 None] Acquiring lock "cinder-quobyte-77ffc39e-ab67-4dc0-a067-c6fbf98deac2" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:01:21 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e1a5f54f-4b4a-4849-8236-58090f55a7da tempest-ProjectReaderTests-1214970823 None] Lock "cinder-quobyte-77ffc39e-ab67-4dc0-a067-c6fbf98deac2" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:01:21 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e1a5f54f-4b4a-4849-8236-58090f55a7da tempest-ProjectReaderTests-1214970823 None] Acquiring lock "cinder-quobyte-3f4485ea-0d3e-4e5d-ae20-d87cf4f68855" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:01:21 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e1a5f54f-4b4a-4849-8236-58090f55a7da tempest-ProjectReaderTests-1214970823 None] Lock "cinder-quobyte-3f4485ea-0d3e-4e5d-ae20-d87cf4f68855" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:01:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-e1a5f54f-4b4a-4849-8236-58090f55a7da tempest-ProjectReaderTests-1214970823 None] Deleting offline snapshot 3f4485ea-0d3e-4e5d-ae20-d87cf4f68855 of volume 77ffc39e-ab67-4dc0-a067-c6fbf98deac2 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:01:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-e1a5f54f-4b4a-4849-8236-58090f55a7da tempest-ProjectReaderTests-1214970823 None] snapshot_file for this snap is: volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2.3f4485ea-0d3e-4e5d-ae20-d87cf4f68855 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:01:21 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb74123-eae7-4e73-9e13-adbb00123d88]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:01:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e1a5f54f-4b4a-4849-8236-58090f55a7da tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2.3f4485ea-0d3e-4e5d-ae20-d87cf4f68855 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:21 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2.3f4485ea-0d3e-4e5d-ae20-d87cf4f68855 Jul 10 07:01:21 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:21 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:01:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:01:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:01:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:01:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:01:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:01:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:21 devstack sudo[107767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 07:01:21 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:22 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e1a5f54f-4b4a-4849-8236-58090f55a7da tempest-ProjectReaderTests-1214970823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2.3f4485ea-0d3e-4e5d-ae20-d87cf4f68855" returned: 0 in 0.729s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:22 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-e1a5f54f-4b4a-4849-8236-58090f55a7da tempest-ProjectReaderTests-1214970823 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:01:22 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[5830738f-103f-4cce-9aa5-5a2a9f3719bb]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:01:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e1a5f54f-4b4a-4849-8236-58090f55a7da tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:22 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2 Jul 10 07:01:22 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:22 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.676s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:22 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:01:22 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager._thread_info {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:01:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread count: 28 {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 07:01:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread info: [<_MainThread(MainThread, started 139245706264704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 07:01:22 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e1a5f54f-4b4a-4849-8236-58090f55a7da tempest-ProjectReaderTests-1214970823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2" returned: 0 in 0.724s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e1a5f54f-4b4a-4849-8236-58090f55a7da tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2.3f4485ea-0d3e-4e5d-ae20-d87cf4f68855 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:22 devstack sudo[107778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2.3f4485ea-0d3e-4e5d-ae20-d87cf4f68855 Jul 10 07:01:22 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:23 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e1a5f54f-4b4a-4849-8236-58090f55a7da tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2.3f4485ea-0d3e-4e5d-ae20-d87cf4f68855" returned: 0 in 0.704s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:23 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e1a5f54f-4b4a-4849-8236-58090f55a7da tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2.3f4485ea-0d3e-4e5d-ae20-d87cf4f68855 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:23 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2.3f4485ea-0d3e-4e5d-ae20-d87cf4f68855 Jul 10 07:01:23 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:24 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-e1a5f54f-4b4a-4849-8236-58090f55a7da tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2.3f4485ea-0d3e-4e5d-ae20-d87cf4f68855" returned: 0 in 0.603s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:24 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e1a5f54f-4b4a-4849-8236-58090f55a7da tempest-ProjectReaderTests-1214970823 None] Lock "cinder-quobyte-3f4485ea-0d3e-4e5d-ae20-d87cf4f68855" released by "_delete_snapshot" :: held 2.840s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:01:24 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e1a5f54f-4b4a-4849-8236-58090f55a7da tempest-ProjectReaderTests-1214970823 None] Lock "cinder-quobyte-77ffc39e-ab67-4dc0-a067-c6fbf98deac2" released by "delete_snapshot" :: held 2.859s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:01:24 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-e1a5f54f-4b4a-4849-8236-58090f55a7da tempest-ProjectReaderTests-1214970823 None] Created reservations ['900810c3-4f7e-4c55-8b7d-2da4bf7220db', '6fbc07f8-9c09-47c7-9314-92da6cd4ab13', 'bd2957da-31fb-40ba-93a2-c646bc61bd05', '1442727f-a76e-45c8-9163-0082f72830b8'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:01:24 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-e1a5f54f-4b4a-4849-8236-58090f55a7da tempest-ProjectReaderTests-1214970823 None] Delete snapshot completed successfully. Jul 10 07:01:24 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-e1a5f54f-4b4a-4849-8236-58090f55a7da tempest-ProjectReaderTests-1214970823 None] Lock "cinder-3f4485ea-0d3e-4e5d-ae20-d87cf4f68855-delete_snapshot" released by "delete_snapshot" :: held 2.981s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:01:24 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-07cc5381-c660-4eb6-aa3f-136aa1de97d2 tempest-ProjectReaderTests-1214970823 None] Acquiring lock "cinder-77ffc39e-ab67-4dc0-a067-c6fbf98deac2-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:01:24 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-07cc5381-c660-4eb6-aa3f-136aa1de97d2 tempest-ProjectReaderTests-1214970823 None] Lock "cinder-77ffc39e-ab67-4dc0-a067-c6fbf98deac2-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:01:24 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-07cc5381-c660-4eb6-aa3f-136aa1de97d2 tempest-ProjectReaderTests-1214970823 None] Acquiring lock "cinder-quobyte-77ffc39e-ab67-4dc0-a067-c6fbf98deac2" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:01:24 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-07cc5381-c660-4eb6-aa3f-136aa1de97d2 tempest-ProjectReaderTests-1214970823 None] Lock "cinder-quobyte-77ffc39e-ab67-4dc0-a067-c6fbf98deac2" acquired by "delete_volume" :: waited 0.013s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:01:24 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7c4cef-05f0-4a63-8345-6a542abe47ef]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:01:24 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-07cc5381-c660-4eb6-aa3f-136aa1de97d2 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:24 devstack sudo[107786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2 Jul 10 07:01:24 devstack sudo[107786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:25 devstack sudo[107786]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-07cc5381-c660-4eb6-aa3f-136aa1de97d2 tempest-ProjectReaderTests-1214970823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2" returned: 0 in 0.711s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-07cc5381-c660-4eb6-aa3f-136aa1de97d2 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:25 devstack sudo[107791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2 Jul 10 07:01:25 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:25 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:25 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-07cc5381-c660-4eb6-aa3f-136aa1de97d2 tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-77ffc39e-ab67-4dc0-a067-c6fbf98deac2" returned: 0 in 0.598s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:25 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-07cc5381-c660-4eb6-aa3f-136aa1de97d2 tempest-ProjectReaderTests-1214970823 None] Lock "cinder-quobyte-77ffc39e-ab67-4dc0-a067-c6fbf98deac2" released by "delete_volume" :: held 1.360s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:01:25 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-07cc5381-c660-4eb6-aa3f-136aa1de97d2 tempest-ProjectReaderTests-1214970823 None] Created reservations ['6b7e5d8b-a29a-44f3-b5f0-e983ae4d4ac7', 'a56b1792-573b-4246-a571-e61d95514af0', '09357894-7d21-4533-aed5-e7f94d76995f', 'b6660b64-0ffc-4f57-a48d-9f5be135f2c5'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:01:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-07cc5381-c660-4eb6-aa3f-136aa1de97d2 tempest-ProjectReaderTests-1214970823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:01:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-07cc5381-c660-4eb6-aa3f-136aa1de97d2 tempest-ProjectReaderTests-1214970823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:01:26 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-07cc5381-c660-4eb6-aa3f-136aa1de97d2 tempest-ProjectReaderTests-1214970823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:01:26 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-07cc5381-c660-4eb6-aa3f-136aa1de97d2 tempest-ProjectReaderTests-1214970823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:01:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-07cc5381-c660-4eb6-aa3f-136aa1de97d2 tempest-ProjectReaderTests-1214970823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:01:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-07cc5381-c660-4eb6-aa3f-136aa1de97d2 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:26 devstack sudo[107794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 07:01:26 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:26 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:26 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-07cc5381-c660-4eb6-aa3f-136aa1de97d2 tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.615s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:26 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-07cc5381-c660-4eb6-aa3f-136aa1de97d2 tempest-ProjectReaderTests-1214970823 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:01:26 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-07cc5381-c660-4eb6-aa3f-136aa1de97d2 tempest-ProjectReaderTests-1214970823 None] Deleted volume successfully. Jul 10 07:01:26 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-07cc5381-c660-4eb6-aa3f-136aa1de97d2 tempest-ProjectReaderTests-1214970823 None] Lock "cinder-77ffc39e-ab67-4dc0-a067-c6fbf98deac2-delete_volume" released by "delete_volume" :: held 2.145s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:01:27 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f27c4ee-038a-4c8a-9adf-e48302d1aa30 tempest-ProjectReaderTests-1214970823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:01:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7f27c4ee-038a-4c8a-9adf-e48302d1aa30 tempest-ProjectReaderTests-1214970823 None] Flow 'volume_create_manager' (5e93ae71-3037-4af1-8d6d-6c28cda64b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:01:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7f27c4ee-038a-4c8a-9adf-e48302d1aa30 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f68a128c-0921-4356-aae4-8675a1c6deae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7f27c4ee-038a-4c8a-9adf-e48302d1aa30 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f68a128c-0921-4356-aae4-8675a1c6deae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1062151644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5134c96-edba-4b12-b20d-c5a51854f542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0dd9b2d347a477d96c8a4b53726601b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:01:27Z,use_quota=True,user_id='5cf5e2033d4e4b83852e40286fac75b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7f27c4ee-038a-4c8a-9adf-e48302d1aa30 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8359aa04-0116-4b62-8c0c-6574bd19f215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7f27c4ee-038a-4c8a-9adf-e48302d1aa30 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8359aa04-0116-4b62-8c0c-6574bd19f215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7f27c4ee-038a-4c8a-9adf-e48302d1aa30 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (953f0d7a-97e2-41dd-a9cd-1d76ec1430ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7f27c4ee-038a-4c8a-9adf-e48302d1aa30 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (953f0d7a-97e2-41dd-a9cd-1d76ec1430ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5134c96-edba-4b12-b20d-c5a51854f542', 'volume_name': 'volume-a5134c96-edba-4b12-b20d-c5a51854f542', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7f27c4ee-038a-4c8a-9adf-e48302d1aa30 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d25af047-0425-4046-a6e7-aa60f4c58ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7f27c4ee-038a-4c8a-9adf-e48302d1aa30 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d25af047-0425-4046-a6e7-aa60f4c58ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:27 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7f27c4ee-038a-4c8a-9adf-e48302d1aa30 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f5e5f10-f9d3-4cdd-9db9-ec7b27343ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:27 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-7f27c4ee-038a-4c8a-9adf-e48302d1aa30 tempest-ProjectReaderTests-1214970823 None] Volume a5134c96-edba-4b12-b20d-c5a51854f542: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5134c96-edba-4b12-b20d-c5a51854f542', 'volume_size': 1} Jul 10 07:01:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7f27c4ee-038a-4c8a-9adf-e48302d1aa30 tempest-ProjectReaderTests-1214970823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:01:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7f27c4ee-038a-4c8a-9adf-e48302d1aa30 tempest-ProjectReaderTests-1214970823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:01:27 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-7f27c4ee-038a-4c8a-9adf-e48302d1aa30 tempest-ProjectReaderTests-1214970823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1062151644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5134c96-edba-4b12-b20d-c5a51854f542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0dd9b2d347a477d96c8a4b53726601b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:01:27Z,use_quota=True,user_id='5cf5e2033d4e4b83852e40286fac75b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:01:27 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-7f27c4ee-038a-4c8a-9adf-e48302d1aa30 tempest-ProjectReaderTests-1214970823 None] Creating volume a5134c96-edba-4b12-b20d-c5a51854f542 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:01:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7f27c4ee-038a-4c8a-9adf-e48302d1aa30 tempest-ProjectReaderTests-1214970823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:01:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7f27c4ee-038a-4c8a-9adf-e48302d1aa30 tempest-ProjectReaderTests-1214970823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:01:27 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-7f27c4ee-038a-4c8a-9adf-e48302d1aa30 tempest-ProjectReaderTests-1214970823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:01:27 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-7f27c4ee-038a-4c8a-9adf-e48302d1aa30 tempest-ProjectReaderTests-1214970823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:01:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7f27c4ee-038a-4c8a-9adf-e48302d1aa30 tempest-ProjectReaderTests-1214970823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:01:27 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-7f27c4ee-038a-4c8a-9adf-e48302d1aa30 tempest-ProjectReaderTests-1214970823 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:01:27 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-7f27c4ee-038a-4c8a-9adf-e48302d1aa30 tempest-ProjectReaderTests-1214970823 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 07:01:27 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7f27c4ee-038a-4c8a-9adf-e48302d1aa30 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:27 devstack sudo[107833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542 1073741824 Jul 10 07:01:27 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:28 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7f27c4ee-038a-4c8a-9adf-e48302d1aa30 tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542 1073741824" returned: 0 in 0.772s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7f27c4ee-038a-4c8a-9adf-e48302d1aa30 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:28 devstack sudo[107839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542 Jul 10 07:01:28 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:28 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7f27c4ee-038a-4c8a-9adf-e48302d1aa30 tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542" returned: 0 in 0.611s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:28 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-7f27c4ee-038a-4c8a-9adf-e48302d1aa30 tempest-ProjectReaderTests-1214970823 None] <== create_volume: return (1426ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:01:28 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7f27c4ee-038a-4c8a-9adf-e48302d1aa30 tempest-ProjectReaderTests-1214970823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.430s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:01:28 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7f27c4ee-038a-4c8a-9adf-e48302d1aa30 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f5e5f10-f9d3-4cdd-9db9-ec7b27343ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5134c96-edba-4b12-b20d-c5a51854f542', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:28 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7f27c4ee-038a-4c8a-9adf-e48302d1aa30 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b340501-5453-4516-837d-6bd54ff425a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:28 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-7f27c4ee-038a-4c8a-9adf-e48302d1aa30 tempest-ProjectReaderTests-1214970823 None] Volume volume-a5134c96-edba-4b12-b20d-c5a51854f542 (a5134c96-edba-4b12-b20d-c5a51854f542): created successfully Jul 10 07:01:28 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7f27c4ee-038a-4c8a-9adf-e48302d1aa30 tempest-ProjectReaderTests-1214970823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b340501-5453-4516-837d-6bd54ff425a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:28 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7f27c4ee-038a-4c8a-9adf-e48302d1aa30 tempest-ProjectReaderTests-1214970823 None] Flow 'volume_create_manager' (5e93ae71-3037-4af1-8d6d-6c28cda64b53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:01:28 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-7f27c4ee-038a-4c8a-9adf-e48302d1aa30 tempest-ProjectReaderTests-1214970823 None] Created volume successfully. Jul 10 07:01:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-134c287c-f1ae-4f20-a274-c41ea7c0a696 tempest-ProjectReaderTests-1214970823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:01:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-134c287c-f1ae-4f20-a274-c41ea7c0a696 tempest-ProjectReaderTests-1214970823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:01:29 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-134c287c-f1ae-4f20-a274-c41ea7c0a696 tempest-ProjectReaderTests-1214970823 None] Creating offline snapshot 1887e9ee-6a9e-4de7-a5b0-91303f269c38 of volume a5134c96-edba-4b12-b20d-c5a51854f542 {{(pid=87294) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 07:01:29 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[708086aa-3d09-4229-b46a-efe7e46904f2]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:01:29 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-134c287c-f1ae-4f20-a274-c41ea7c0a696 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:29 devstack sudo[107842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542 Jul 10 07:01:29 devstack sudo[107842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:30 devstack sudo[107842]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-134c287c-f1ae-4f20-a274-c41ea7c0a696 tempest-ProjectReaderTests-1214970823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542" returned: 0 in 0.730s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-134c287c-f1ae-4f20-a274-c41ea7c0a696 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542.1887e9ee-6a9e-4de7-a5b0-91303f269c38 1G {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:30 devstack sudo[107848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542.1887e9ee-6a9e-4de7-a5b0-91303f269c38 1G Jul 10 07:01:30 devstack sudo[107848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:30 devstack sudo[107848]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-134c287c-f1ae-4f20-a274-c41ea7c0a696 tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542.1887e9ee-6a9e-4de7-a5b0-91303f269c38 1G" returned: 0 in 0.781s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:30 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-134c287c-f1ae-4f20-a274-c41ea7c0a696 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5134c96-edba-4b12-b20d-c5a51854f542 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542.1887e9ee-6a9e-4de7-a5b0-91303f269c38 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:30 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5134c96-edba-4b12-b20d-c5a51854f542 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542.1887e9ee-6a9e-4de7-a5b0-91303f269c38 Jul 10 07:01:30 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:31 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-134c287c-f1ae-4f20-a274-c41ea7c0a696 tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5134c96-edba-4b12-b20d-c5a51854f542 -F qcow2 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542.1887e9ee-6a9e-4de7-a5b0-91303f269c38" returned: 0 in 0.666s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:31 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-134c287c-f1ae-4f20-a274-c41ea7c0a696 tempest-ProjectReaderTests-1214970823 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542.1887e9ee-6a9e-4de7-a5b0-91303f269c38 is being set with open permissions: ugo+rw Jul 10 07:01:31 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-134c287c-f1ae-4f20-a274-c41ea7c0a696 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542.1887e9ee-6a9e-4de7-a5b0-91303f269c38 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:31 devstack sudo[107859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542.1887e9ee-6a9e-4de7-a5b0-91303f269c38 Jul 10 07:01:31 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:32 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-134c287c-f1ae-4f20-a274-c41ea7c0a696 tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542.1887e9ee-6a9e-4de7-a5b0-91303f269c38" returned: 0 in 0.630s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-134c287c-f1ae-4f20-a274-c41ea7c0a696 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:32 devstack sudo[107862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542.info Jul 10 07:01:32 devstack sudo[107862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:32 devstack sudo[107862]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-134c287c-f1ae-4f20-a274-c41ea7c0a696 tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542.info" returned: 0 in 0.638s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:32 devstack cinder-volume[87294]: WARNING cinder.volume.drivers.remotefs [None req-134c287c-f1ae-4f20-a274-c41ea7c0a696 tempest-ProjectReaderTests-1214970823 None] /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542.info is being set with open permissions: ugo+rw Jul 10 07:01:32 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-134c287c-f1ae-4f20-a274-c41ea7c0a696 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542.info {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:32 devstack sudo[107871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542.info Jul 10 07:01:32 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:33 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-134c287c-f1ae-4f20-a274-c41ea7c0a696 tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542.info" returned: 0 in 0.604s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:33 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-134c287c-f1ae-4f20-a274-c41ea7c0a696 tempest-ProjectReaderTests-1214970823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.124s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:01:33 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-134c287c-f1ae-4f20-a274-c41ea7c0a696 tempest-ProjectReaderTests-1214970823 None] Create snapshot completed successfully Jul 10 07:01:34 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-42805ffc-d185-4963-a3a5-c39617c00524 tempest-ProjectReaderTests-1214970823 None] Acquiring lock "cinder-1887e9ee-6a9e-4de7-a5b0-91303f269c38-delete_snapshot" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:01:34 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-42805ffc-d185-4963-a3a5-c39617c00524 tempest-ProjectReaderTests-1214970823 None] Lock "cinder-1887e9ee-6a9e-4de7-a5b0-91303f269c38-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:01:34 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-42805ffc-d185-4963-a3a5-c39617c00524 tempest-ProjectReaderTests-1214970823 None] Acquiring lock "cinder-quobyte-a5134c96-edba-4b12-b20d-c5a51854f542" by "delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:01:34 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-42805ffc-d185-4963-a3a5-c39617c00524 tempest-ProjectReaderTests-1214970823 None] Lock "cinder-quobyte-a5134c96-edba-4b12-b20d-c5a51854f542" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:01:34 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-42805ffc-d185-4963-a3a5-c39617c00524 tempest-ProjectReaderTests-1214970823 None] Acquiring lock "cinder-quobyte-1887e9ee-6a9e-4de7-a5b0-91303f269c38" by "_delete_snapshot" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:01:34 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-42805ffc-d185-4963-a3a5-c39617c00524 tempest-ProjectReaderTests-1214970823 None] Lock "cinder-quobyte-1887e9ee-6a9e-4de7-a5b0-91303f269c38" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:01:34 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-42805ffc-d185-4963-a3a5-c39617c00524 tempest-ProjectReaderTests-1214970823 None] Deleting offline snapshot 1887e9ee-6a9e-4de7-a5b0-91303f269c38 of volume a5134c96-edba-4b12-b20d-c5a51854f542 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 07:01:34 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-42805ffc-d185-4963-a3a5-c39617c00524 tempest-ProjectReaderTests-1214970823 None] snapshot_file for this snap is: volume-a5134c96-edba-4b12-b20d-c5a51854f542.1887e9ee-6a9e-4de7-a5b0-91303f269c38 {{(pid=87294) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 07:01:34 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[104e1c3c-28ec-4c3e-9a56-8e6b58b5ca78]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:01:34 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-42805ffc-d185-4963-a3a5-c39617c00524 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542.1887e9ee-6a9e-4de7-a5b0-91303f269c38 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:34 devstack sudo[107874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542.1887e9ee-6a9e-4de7-a5b0-91303f269c38 Jul 10 07:01:34 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:35 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-42805ffc-d185-4963-a3a5-c39617c00524 tempest-ProjectReaderTests-1214970823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542.1887e9ee-6a9e-4de7-a5b0-91303f269c38" returned: 0 in 0.710s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:35 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-42805ffc-d185-4963-a3a5-c39617c00524 tempest-ProjectReaderTests-1214970823 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5134c96-edba-4b12-b20d-c5a51854f542(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87294) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 07:01:35 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4274b98-b8b4-4f34-b533-3aabd560893f]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:01:35 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-42805ffc-d185-4963-a3a5-c39617c00524 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:35 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542 Jul 10 07:01:35 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:36 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-42805ffc-d185-4963-a3a5-c39617c00524 tempest-ProjectReaderTests-1214970823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542" returned: 0 in 0.700s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-42805ffc-d185-4963-a3a5-c39617c00524 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542.1887e9ee-6a9e-4de7-a5b0-91303f269c38 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:36 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542.1887e9ee-6a9e-4de7-a5b0-91303f269c38 Jul 10 07:01:36 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:36 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-42805ffc-d185-4963-a3a5-c39617c00524 tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542.1887e9ee-6a9e-4de7-a5b0-91303f269c38" returned: 0 in 0.680s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:36 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-42805ffc-d185-4963-a3a5-c39617c00524 tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542.1887e9ee-6a9e-4de7-a5b0-91303f269c38 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:36 devstack sudo[107889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542.1887e9ee-6a9e-4de7-a5b0-91303f269c38 Jul 10 07:01:36 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:37 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-42805ffc-d185-4963-a3a5-c39617c00524 tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542.1887e9ee-6a9e-4de7-a5b0-91303f269c38" returned: 0 in 0.596s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:37 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-42805ffc-d185-4963-a3a5-c39617c00524 tempest-ProjectReaderTests-1214970823 None] Lock "cinder-quobyte-1887e9ee-6a9e-4de7-a5b0-91303f269c38" released by "_delete_snapshot" :: held 2.769s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:01:37 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-42805ffc-d185-4963-a3a5-c39617c00524 tempest-ProjectReaderTests-1214970823 None] Lock "cinder-quobyte-a5134c96-edba-4b12-b20d-c5a51854f542" released by "delete_snapshot" :: held 2.789s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:01:37 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-42805ffc-d185-4963-a3a5-c39617c00524 tempest-ProjectReaderTests-1214970823 None] Created reservations ['4cd58d0e-f92a-428c-b71b-078104c3aa95', 'f0af0729-1813-4726-8cf9-368ae63b71ef', 'b2018b1a-9063-4a43-b027-e8853936ec0f', '0787fbc7-1a53-4101-8fae-2c54efd13578'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:01:37 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-42805ffc-d185-4963-a3a5-c39617c00524 tempest-ProjectReaderTests-1214970823 None] Delete snapshot completed successfully. Jul 10 07:01:37 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-42805ffc-d185-4963-a3a5-c39617c00524 tempest-ProjectReaderTests-1214970823 None] Lock "cinder-1887e9ee-6a9e-4de7-a5b0-91303f269c38-delete_snapshot" released by "delete_snapshot" :: held 2.917s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:01:37 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-26765391-e1cf-4174-885d-13c0f98c3f4f tempest-ProjectReaderTests-1214970823 None] Acquiring lock "cinder-a5134c96-edba-4b12-b20d-c5a51854f542-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:01:37 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-26765391-e1cf-4174-885d-13c0f98c3f4f tempest-ProjectReaderTests-1214970823 None] Lock "cinder-a5134c96-edba-4b12-b20d-c5a51854f542-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:01:37 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-26765391-e1cf-4174-885d-13c0f98c3f4f tempest-ProjectReaderTests-1214970823 None] Acquiring lock "cinder-quobyte-a5134c96-edba-4b12-b20d-c5a51854f542" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:01:37 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-26765391-e1cf-4174-885d-13c0f98c3f4f tempest-ProjectReaderTests-1214970823 None] Lock "cinder-quobyte-a5134c96-edba-4b12-b20d-c5a51854f542" acquired by "delete_volume" :: waited 0.015s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:01:37 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[4699e605-471a-49a4-bf05-68708476ae78]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:01:37 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-26765391-e1cf-4174-885d-13c0f98c3f4f tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:37 devstack sudo[107892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542 Jul 10 07:01:37 devstack sudo[107892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:38 devstack sudo[107892]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-26765391-e1cf-4174-885d-13c0f98c3f4f tempest-ProjectReaderTests-1214970823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542" returned: 0 in 0.722s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:38 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-26765391-e1cf-4174-885d-13c0f98c3f4f tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:38 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542 Jul 10 07:01:38 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:39 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-26765391-e1cf-4174-885d-13c0f98c3f4f tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a5134c96-edba-4b12-b20d-c5a51854f542" returned: 0 in 0.599s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:39 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-26765391-e1cf-4174-885d-13c0f98c3f4f tempest-ProjectReaderTests-1214970823 None] Lock "cinder-quobyte-a5134c96-edba-4b12-b20d-c5a51854f542" released by "delete_volume" :: held 1.370s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:01:39 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-26765391-e1cf-4174-885d-13c0f98c3f4f tempest-ProjectReaderTests-1214970823 None] Created reservations ['2440fc2a-1de2-4c65-9f7f-eb2e2c448e17', '2e7627be-d4fc-4ded-bc18-b49b2d7983b8', '3fd32c47-141a-4cbb-82f5-d532796a4c31', '1da7d859-62b2-48dc-aadf-018b13b4f4ad'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:01:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-26765391-e1cf-4174-885d-13c0f98c3f4f tempest-ProjectReaderTests-1214970823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:01:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-26765391-e1cf-4174-885d-13c0f98c3f4f tempest-ProjectReaderTests-1214970823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:01:39 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-26765391-e1cf-4174-885d-13c0f98c3f4f tempest-ProjectReaderTests-1214970823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:01:39 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-26765391-e1cf-4174-885d-13c0f98c3f4f tempest-ProjectReaderTests-1214970823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:01:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-26765391-e1cf-4174-885d-13c0f98c3f4f tempest-ProjectReaderTests-1214970823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:01:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-26765391-e1cf-4174-885d-13c0f98c3f4f tempest-ProjectReaderTests-1214970823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:39 devstack sudo[107900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 07:01:39 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:39 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:39 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-26765391-e1cf-4174-885d-13c0f98c3f4f tempest-ProjectReaderTests-1214970823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.610s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:39 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-26765391-e1cf-4174-885d-13c0f98c3f4f tempest-ProjectReaderTests-1214970823 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:01:39 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-26765391-e1cf-4174-885d-13c0f98c3f4f tempest-ProjectReaderTests-1214970823 None] Deleted volume successfully. Jul 10 07:01:39 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-26765391-e1cf-4174-885d-13c0f98c3f4f tempest-ProjectReaderTests-1214970823 None] Lock "cinder-a5134c96-edba-4b12-b20d-c5a51854f542-delete_volume" released by "delete_volume" :: held 2.160s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:01:43 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa56cd88-d17b-4b16-8f35-0ee34d2688f7 tempest-ProjectReaderTests-934415171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:01:43 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-fa56cd88-d17b-4b16-8f35-0ee34d2688f7 tempest-ProjectReaderTests-934415171 None] Flow 'volume_create_manager' (bccced38-8489-4617-8d83-9ca8613ebfb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:01:43 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-fa56cd88-d17b-4b16-8f35-0ee34d2688f7 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (757ae5b9-73bb-4de5-9f81-471f81107eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:43 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-fa56cd88-d17b-4b16-8f35-0ee34d2688f7 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (757ae5b9-73bb-4de5-9f81-471f81107eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1986735503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0f0b65a-56c3-401c-8b44-9ecdb0a63b74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4857d23043b4508978a30e93ddf7cc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:01:43Z,use_quota=True,user_id='e20b6193ced042b2b80a424168ff2bf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:43 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-fa56cd88-d17b-4b16-8f35-0ee34d2688f7 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e09adc6-64e8-4410-a01d-06043bdb4b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:43 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-fa56cd88-d17b-4b16-8f35-0ee34d2688f7 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e09adc6-64e8-4410-a01d-06043bdb4b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:43 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-fa56cd88-d17b-4b16-8f35-0ee34d2688f7 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8380dadc-f598-4b08-a268-b791ad94f930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:43 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-fa56cd88-d17b-4b16-8f35-0ee34d2688f7 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8380dadc-f598-4b08-a268-b791ad94f930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0f0b65a-56c3-401c-8b44-9ecdb0a63b74', 'volume_name': 'volume-a0f0b65a-56c3-401c-8b44-9ecdb0a63b74', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:43 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-fa56cd88-d17b-4b16-8f35-0ee34d2688f7 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33631591-847b-4ba8-bd34-498bdaafc045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:43 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-fa56cd88-d17b-4b16-8f35-0ee34d2688f7 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33631591-847b-4ba8-bd34-498bdaafc045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:43 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-fa56cd88-d17b-4b16-8f35-0ee34d2688f7 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caff993a-3e2d-4afd-8b7d-96bbe4d1af0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:43 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-fa56cd88-d17b-4b16-8f35-0ee34d2688f7 tempest-ProjectReaderTests-934415171 None] Volume a0f0b65a-56c3-401c-8b44-9ecdb0a63b74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0f0b65a-56c3-401c-8b44-9ecdb0a63b74', 'volume_size': 1} Jul 10 07:01:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-fa56cd88-d17b-4b16-8f35-0ee34d2688f7 tempest-ProjectReaderTests-934415171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:01:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-fa56cd88-d17b-4b16-8f35-0ee34d2688f7 tempest-ProjectReaderTests-934415171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:01:43 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-fa56cd88-d17b-4b16-8f35-0ee34d2688f7 tempest-ProjectReaderTests-934415171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1986735503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0f0b65a-56c3-401c-8b44-9ecdb0a63b74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4857d23043b4508978a30e93ddf7cc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:01:43Z,use_quota=True,user_id='e20b6193ced042b2b80a424168ff2bf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:01:43 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-fa56cd88-d17b-4b16-8f35-0ee34d2688f7 tempest-ProjectReaderTests-934415171 None] Creating volume a0f0b65a-56c3-401c-8b44-9ecdb0a63b74 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:01:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-fa56cd88-d17b-4b16-8f35-0ee34d2688f7 tempest-ProjectReaderTests-934415171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:01:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-fa56cd88-d17b-4b16-8f35-0ee34d2688f7 tempest-ProjectReaderTests-934415171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:01:43 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-fa56cd88-d17b-4b16-8f35-0ee34d2688f7 tempest-ProjectReaderTests-934415171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:01:43 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-fa56cd88-d17b-4b16-8f35-0ee34d2688f7 tempest-ProjectReaderTests-934415171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:01:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-fa56cd88-d17b-4b16-8f35-0ee34d2688f7 tempest-ProjectReaderTests-934415171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:01:43 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-fa56cd88-d17b-4b16-8f35-0ee34d2688f7 tempest-ProjectReaderTests-934415171 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:01:43 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-fa56cd88-d17b-4b16-8f35-0ee34d2688f7 tempest-ProjectReaderTests-934415171 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 07:01:43 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-fa56cd88-d17b-4b16-8f35-0ee34d2688f7 tempest-ProjectReaderTests-934415171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a0f0b65a-56c3-401c-8b44-9ecdb0a63b74 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:43 devstack sudo[107906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a0f0b65a-56c3-401c-8b44-9ecdb0a63b74 1073741824 Jul 10 07:01:43 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:44 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-fa56cd88-d17b-4b16-8f35-0ee34d2688f7 tempest-ProjectReaderTests-934415171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a0f0b65a-56c3-401c-8b44-9ecdb0a63b74 1073741824" returned: 0 in 0.769s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-fa56cd88-d17b-4b16-8f35-0ee34d2688f7 tempest-ProjectReaderTests-934415171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a0f0b65a-56c3-401c-8b44-9ecdb0a63b74 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:44 devstack sudo[107912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a0f0b65a-56c3-401c-8b44-9ecdb0a63b74 Jul 10 07:01:44 devstack sudo[107912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:44 devstack sudo[107912]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-fa56cd88-d17b-4b16-8f35-0ee34d2688f7 tempest-ProjectReaderTests-934415171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a0f0b65a-56c3-401c-8b44-9ecdb0a63b74" returned: 0 in 0.599s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:44 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-fa56cd88-d17b-4b16-8f35-0ee34d2688f7 tempest-ProjectReaderTests-934415171 None] <== create_volume: return (1410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:01:44 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-fa56cd88-d17b-4b16-8f35-0ee34d2688f7 tempest-ProjectReaderTests-934415171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.413s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:01:45 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-fa56cd88-d17b-4b16-8f35-0ee34d2688f7 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caff993a-3e2d-4afd-8b7d-96bbe4d1af0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0f0b65a-56c3-401c-8b44-9ecdb0a63b74', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:45 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-fa56cd88-d17b-4b16-8f35-0ee34d2688f7 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63958e9b-874d-4f73-bbd4-79bab9c79960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:45 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-fa56cd88-d17b-4b16-8f35-0ee34d2688f7 tempest-ProjectReaderTests-934415171 None] Volume volume-a0f0b65a-56c3-401c-8b44-9ecdb0a63b74 (a0f0b65a-56c3-401c-8b44-9ecdb0a63b74): created successfully Jul 10 07:01:45 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-fa56cd88-d17b-4b16-8f35-0ee34d2688f7 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63958e9b-874d-4f73-bbd4-79bab9c79960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:45 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-fa56cd88-d17b-4b16-8f35-0ee34d2688f7 tempest-ProjectReaderTests-934415171 None] Flow 'volume_create_manager' (bccced38-8489-4617-8d83-9ca8613ebfb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:01:45 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-fa56cd88-d17b-4b16-8f35-0ee34d2688f7 tempest-ProjectReaderTests-934415171 None] Created volume successfully. Jul 10 07:01:45 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-5a6aabc9-2565-461d-bc37-b2eac361cfb7 tempest-ProjectReaderTests-934415171 None] Acquiring lock "cinder-a0f0b65a-56c3-401c-8b44-9ecdb0a63b74-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:01:45 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-5a6aabc9-2565-461d-bc37-b2eac361cfb7 tempest-ProjectReaderTests-934415171 None] Lock "cinder-a0f0b65a-56c3-401c-8b44-9ecdb0a63b74-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:01:45 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-5a6aabc9-2565-461d-bc37-b2eac361cfb7 tempest-ProjectReaderTests-934415171 None] Acquiring lock "cinder-quobyte-a0f0b65a-56c3-401c-8b44-9ecdb0a63b74" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:01:45 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-5a6aabc9-2565-461d-bc37-b2eac361cfb7 tempest-ProjectReaderTests-934415171 None] Lock "cinder-quobyte-a0f0b65a-56c3-401c-8b44-9ecdb0a63b74" acquired by "delete_volume" :: waited 0.016s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:01:45 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb96f111-4200-4669-868b-a606b57c5a82]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:01:45 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5a6aabc9-2565-461d-bc37-b2eac361cfb7 tempest-ProjectReaderTests-934415171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a0f0b65a-56c3-401c-8b44-9ecdb0a63b74 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:45 devstack sudo[107915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a0f0b65a-56c3-401c-8b44-9ecdb0a63b74 Jul 10 07:01:45 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:46 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5a6aabc9-2565-461d-bc37-b2eac361cfb7 tempest-ProjectReaderTests-934415171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a0f0b65a-56c3-401c-8b44-9ecdb0a63b74" returned: 0 in 0.731s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:46 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5a6aabc9-2565-461d-bc37-b2eac361cfb7 tempest-ProjectReaderTests-934415171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a0f0b65a-56c3-401c-8b44-9ecdb0a63b74 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:46 devstack sudo[107920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a0f0b65a-56c3-401c-8b44-9ecdb0a63b74 Jul 10 07:01:46 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:47 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5a6aabc9-2565-461d-bc37-b2eac361cfb7 tempest-ProjectReaderTests-934415171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-a0f0b65a-56c3-401c-8b44-9ecdb0a63b74" returned: 0 in 0.606s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:47 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-5a6aabc9-2565-461d-bc37-b2eac361cfb7 tempest-ProjectReaderTests-934415171 None] Lock "cinder-quobyte-a0f0b65a-56c3-401c-8b44-9ecdb0a63b74" released by "delete_volume" :: held 1.375s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:01:47 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-5a6aabc9-2565-461d-bc37-b2eac361cfb7 tempest-ProjectReaderTests-934415171 None] Created reservations ['fdb382b0-3161-447f-b4e0-0c5d0859aa3f', 'c2c41099-880b-4473-83dc-9b610d935d36', 'ca13b172-b2d0-43e3-ac59-cb8e6ef4d335', '6173ed9e-0a8e-44a6-ad47-79a0500621a5'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:01:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5a6aabc9-2565-461d-bc37-b2eac361cfb7 tempest-ProjectReaderTests-934415171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:01:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5a6aabc9-2565-461d-bc37-b2eac361cfb7 tempest-ProjectReaderTests-934415171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:01:47 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5a6aabc9-2565-461d-bc37-b2eac361cfb7 tempest-ProjectReaderTests-934415171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:01:47 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5a6aabc9-2565-461d-bc37-b2eac361cfb7 tempest-ProjectReaderTests-934415171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:01:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5a6aabc9-2565-461d-bc37-b2eac361cfb7 tempest-ProjectReaderTests-934415171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:01:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5a6aabc9-2565-461d-bc37-b2eac361cfb7 tempest-ProjectReaderTests-934415171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:47 devstack sudo[107923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 07:01:47 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:47 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:47 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5a6aabc9-2565-461d-bc37-b2eac361cfb7 tempest-ProjectReaderTests-934415171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.618s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:47 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-5a6aabc9-2565-461d-bc37-b2eac361cfb7 tempest-ProjectReaderTests-934415171 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:01:47 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-5a6aabc9-2565-461d-bc37-b2eac361cfb7 tempest-ProjectReaderTests-934415171 None] Deleted volume successfully. Jul 10 07:01:47 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-5a6aabc9-2565-461d-bc37-b2eac361cfb7 tempest-ProjectReaderTests-934415171 None] Lock "cinder-a0f0b65a-56c3-401c-8b44-9ecdb0a63b74-delete_volume" released by "delete_volume" :: held 2.177s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:01:48 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-af618755-3a39-41b0-9424-e0f3042e05c4 tempest-ProjectReaderTests-934415171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:01:48 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-af618755-3a39-41b0-9424-e0f3042e05c4 tempest-ProjectReaderTests-934415171 None] Flow 'volume_create_manager' (58587f62-8788-40b2-8a1a-4bc2147ba586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:01:48 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-af618755-3a39-41b0-9424-e0f3042e05c4 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d46f65d2-47d3-4a6a-a4cd-5118e24732ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:48 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-af618755-3a39-41b0-9424-e0f3042e05c4 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d46f65d2-47d3-4a6a-a4cd-5118e24732ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1661987526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af86bbea-9881-4e67-886c-2d12513eaf5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4857d23043b4508978a30e93ddf7cc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:01:48Z,use_quota=True,user_id='e20b6193ced042b2b80a424168ff2bf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:48 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-af618755-3a39-41b0-9424-e0f3042e05c4 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (686b177b-7dfa-4489-82d9-5d82587de6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:48 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-af618755-3a39-41b0-9424-e0f3042e05c4 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (686b177b-7dfa-4489-82d9-5d82587de6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:48 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-af618755-3a39-41b0-9424-e0f3042e05c4 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3915b4ae-a887-421e-bdb6-63857181b14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:48 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-af618755-3a39-41b0-9424-e0f3042e05c4 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3915b4ae-a887-421e-bdb6-63857181b14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af86bbea-9881-4e67-886c-2d12513eaf5b', 'volume_name': 'volume-af86bbea-9881-4e67-886c-2d12513eaf5b', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:48 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-af618755-3a39-41b0-9424-e0f3042e05c4 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef4502c9-b621-492c-9dc4-e287fa5decca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:48 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-af618755-3a39-41b0-9424-e0f3042e05c4 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef4502c9-b621-492c-9dc4-e287fa5decca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:48 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-af618755-3a39-41b0-9424-e0f3042e05c4 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1fcd12b-4d63-4aef-a5ad-74ca7f13b5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:48 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-af618755-3a39-41b0-9424-e0f3042e05c4 tempest-ProjectReaderTests-934415171 None] Volume af86bbea-9881-4e67-886c-2d12513eaf5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af86bbea-9881-4e67-886c-2d12513eaf5b', 'volume_size': 1} Jul 10 07:01:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-af618755-3a39-41b0-9424-e0f3042e05c4 tempest-ProjectReaderTests-934415171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:01:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-af618755-3a39-41b0-9424-e0f3042e05c4 tempest-ProjectReaderTests-934415171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:01:48 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-af618755-3a39-41b0-9424-e0f3042e05c4 tempest-ProjectReaderTests-934415171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1661987526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af86bbea-9881-4e67-886c-2d12513eaf5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4857d23043b4508978a30e93ddf7cc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:01:48Z,use_quota=True,user_id='e20b6193ced042b2b80a424168ff2bf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:01:48 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-af618755-3a39-41b0-9424-e0f3042e05c4 tempest-ProjectReaderTests-934415171 None] Creating volume af86bbea-9881-4e67-886c-2d12513eaf5b {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:01:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-af618755-3a39-41b0-9424-e0f3042e05c4 tempest-ProjectReaderTests-934415171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:01:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-af618755-3a39-41b0-9424-e0f3042e05c4 tempest-ProjectReaderTests-934415171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:01:48 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-af618755-3a39-41b0-9424-e0f3042e05c4 tempest-ProjectReaderTests-934415171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:01:48 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-af618755-3a39-41b0-9424-e0f3042e05c4 tempest-ProjectReaderTests-934415171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:01:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-af618755-3a39-41b0-9424-e0f3042e05c4 tempest-ProjectReaderTests-934415171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:01:48 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-af618755-3a39-41b0-9424-e0f3042e05c4 tempest-ProjectReaderTests-934415171 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:01:48 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-af618755-3a39-41b0-9424-e0f3042e05c4 tempest-ProjectReaderTests-934415171 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 07:01:48 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-af618755-3a39-41b0-9424-e0f3042e05c4 tempest-ProjectReaderTests-934415171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-af86bbea-9881-4e67-886c-2d12513eaf5b 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:48 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-af86bbea-9881-4e67-886c-2d12513eaf5b 1073741824 Jul 10 07:01:48 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:49 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-af618755-3a39-41b0-9424-e0f3042e05c4 tempest-ProjectReaderTests-934415171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-af86bbea-9881-4e67-886c-2d12513eaf5b 1073741824" returned: 0 in 0.760s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-af618755-3a39-41b0-9424-e0f3042e05c4 tempest-ProjectReaderTests-934415171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-af86bbea-9881-4e67-886c-2d12513eaf5b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:49 devstack sudo[107932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-af86bbea-9881-4e67-886c-2d12513eaf5b Jul 10 07:01:49 devstack sudo[107932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:49 devstack sudo[107932]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-af618755-3a39-41b0-9424-e0f3042e05c4 tempest-ProjectReaderTests-934415171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-af86bbea-9881-4e67-886c-2d12513eaf5b" returned: 0 in 0.609s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:49 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-af618755-3a39-41b0-9424-e0f3042e05c4 tempest-ProjectReaderTests-934415171 None] <== create_volume: return (1407ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:01:49 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-af618755-3a39-41b0-9424-e0f3042e05c4 tempest-ProjectReaderTests-934415171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:01:49 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-af618755-3a39-41b0-9424-e0f3042e05c4 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1fcd12b-4d63-4aef-a5ad-74ca7f13b5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af86bbea-9881-4e67-886c-2d12513eaf5b', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:49 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-af618755-3a39-41b0-9424-e0f3042e05c4 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed39fe78-705e-43f3-bd93-5e1251bc1c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:49 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-af618755-3a39-41b0-9424-e0f3042e05c4 tempest-ProjectReaderTests-934415171 None] Volume volume-af86bbea-9881-4e67-886c-2d12513eaf5b (af86bbea-9881-4e67-886c-2d12513eaf5b): created successfully Jul 10 07:01:49 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-af618755-3a39-41b0-9424-e0f3042e05c4 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed39fe78-705e-43f3-bd93-5e1251bc1c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:49 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-af618755-3a39-41b0-9424-e0f3042e05c4 tempest-ProjectReaderTests-934415171 None] Flow 'volume_create_manager' (58587f62-8788-40b2-8a1a-4bc2147ba586) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:01:49 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-af618755-3a39-41b0-9424-e0f3042e05c4 tempest-ProjectReaderTests-934415171 None] Created volume successfully. Jul 10 07:01:50 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-5faf0bd4-8c6a-4a94-a128-7ee5203bdf21 tempest-ProjectReaderTests-934415171 None] Acquiring lock "cinder-af86bbea-9881-4e67-886c-2d12513eaf5b-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:01:50 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-5faf0bd4-8c6a-4a94-a128-7ee5203bdf21 tempest-ProjectReaderTests-934415171 None] Lock "cinder-af86bbea-9881-4e67-886c-2d12513eaf5b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:01:50 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-5faf0bd4-8c6a-4a94-a128-7ee5203bdf21 tempest-ProjectReaderTests-934415171 None] Acquiring lock "cinder-quobyte-af86bbea-9881-4e67-886c-2d12513eaf5b" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:01:50 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-5faf0bd4-8c6a-4a94-a128-7ee5203bdf21 tempest-ProjectReaderTests-934415171 None] Lock "cinder-quobyte-af86bbea-9881-4e67-886c-2d12513eaf5b" acquired by "delete_volume" :: waited 0.015s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:01:50 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e51fdee-a082-4007-94d4-554ece9eb379]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:01:50 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5faf0bd4-8c6a-4a94-a128-7ee5203bdf21 tempest-ProjectReaderTests-934415171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-af86bbea-9881-4e67-886c-2d12513eaf5b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:50 devstack sudo[107936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-af86bbea-9881-4e67-886c-2d12513eaf5b Jul 10 07:01:50 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:51 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5faf0bd4-8c6a-4a94-a128-7ee5203bdf21 tempest-ProjectReaderTests-934415171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-af86bbea-9881-4e67-886c-2d12513eaf5b" returned: 0 in 0.707s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5faf0bd4-8c6a-4a94-a128-7ee5203bdf21 tempest-ProjectReaderTests-934415171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-af86bbea-9881-4e67-886c-2d12513eaf5b {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:51 devstack sudo[107941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-af86bbea-9881-4e67-886c-2d12513eaf5b Jul 10 07:01:51 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:51 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5faf0bd4-8c6a-4a94-a128-7ee5203bdf21 tempest-ProjectReaderTests-934415171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-af86bbea-9881-4e67-886c-2d12513eaf5b" returned: 0 in 0.599s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:51 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-5faf0bd4-8c6a-4a94-a128-7ee5203bdf21 tempest-ProjectReaderTests-934415171 None] Lock "cinder-quobyte-af86bbea-9881-4e67-886c-2d12513eaf5b" released by "delete_volume" :: held 1.339s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:01:51 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-5faf0bd4-8c6a-4a94-a128-7ee5203bdf21 tempest-ProjectReaderTests-934415171 None] Created reservations ['753d65a5-cc64-4ab1-8059-c556baec08d6', 'db32c383-da5a-402f-aa1a-f166f3b3ee85', '86b8a7b4-e741-42bd-afec-31cd2bf1e488', '0406693c-f57c-4a8e-9a79-e9ec874ecb57'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:01:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5faf0bd4-8c6a-4a94-a128-7ee5203bdf21 tempest-ProjectReaderTests-934415171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:01:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5faf0bd4-8c6a-4a94-a128-7ee5203bdf21 tempest-ProjectReaderTests-934415171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:01:51 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5faf0bd4-8c6a-4a94-a128-7ee5203bdf21 tempest-ProjectReaderTests-934415171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:01:51 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-5faf0bd4-8c6a-4a94-a128-7ee5203bdf21 tempest-ProjectReaderTests-934415171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:01:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-5faf0bd4-8c6a-4a94-a128-7ee5203bdf21 tempest-ProjectReaderTests-934415171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:01:51 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5faf0bd4-8c6a-4a94-a128-7ee5203bdf21 tempest-ProjectReaderTests-934415171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:51 devstack sudo[107944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 07:01:51 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:52 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:52 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-5faf0bd4-8c6a-4a94-a128-7ee5203bdf21 tempest-ProjectReaderTests-934415171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.632s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:52 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-5faf0bd4-8c6a-4a94-a128-7ee5203bdf21 tempest-ProjectReaderTests-934415171 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:01:52 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-5faf0bd4-8c6a-4a94-a128-7ee5203bdf21 tempest-ProjectReaderTests-934415171 None] Deleted volume successfully. Jul 10 07:01:52 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-5faf0bd4-8c6a-4a94-a128-7ee5203bdf21 tempest-ProjectReaderTests-934415171 None] Lock "cinder-af86bbea-9881-4e67-886c-2d12513eaf5b-delete_volume" released by "delete_volume" :: held 2.159s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:01:53 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-7de21f76-d65f-4367-b27e-b1e20505da05 tempest-ProjectReaderTests-934415171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:01:53 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7de21f76-d65f-4367-b27e-b1e20505da05 tempest-ProjectReaderTests-934415171 None] Flow 'volume_create_manager' (8530f04c-cb31-4280-981c-1b943caf06c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:01:53 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7de21f76-d65f-4367-b27e-b1e20505da05 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59aa944b-9104-44de-ac62-972c130fe06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:53 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7de21f76-d65f-4367-b27e-b1e20505da05 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59aa944b-9104-44de-ac62-972c130fe06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-736795668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=836b8f7e-cb8f-4aa1-8906-0f3d8bba97be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4857d23043b4508978a30e93ddf7cc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:01:53Z,use_quota=True,user_id='e20b6193ced042b2b80a424168ff2bf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:53 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7de21f76-d65f-4367-b27e-b1e20505da05 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eaa196f-5c07-482c-bea7-30fd183b868d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:53 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7de21f76-d65f-4367-b27e-b1e20505da05 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eaa196f-5c07-482c-bea7-30fd183b868d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:53 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7de21f76-d65f-4367-b27e-b1e20505da05 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e72fe8f-6c72-4a28-afe4-dd08cb839379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:53 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7de21f76-d65f-4367-b27e-b1e20505da05 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e72fe8f-6c72-4a28-afe4-dd08cb839379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '836b8f7e-cb8f-4aa1-8906-0f3d8bba97be', 'volume_name': 'volume-836b8f7e-cb8f-4aa1-8906-0f3d8bba97be', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:53 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7de21f76-d65f-4367-b27e-b1e20505da05 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4646369-4f81-4a4f-8bfd-2509f7ffcac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:53 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7de21f76-d65f-4367-b27e-b1e20505da05 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4646369-4f81-4a4f-8bfd-2509f7ffcac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:53 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7de21f76-d65f-4367-b27e-b1e20505da05 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5568a10-6cfe-4cb2-ac7a-d5e66a526e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:53 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-7de21f76-d65f-4367-b27e-b1e20505da05 tempest-ProjectReaderTests-934415171 None] Volume 836b8f7e-cb8f-4aa1-8906-0f3d8bba97be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-836b8f7e-cb8f-4aa1-8906-0f3d8bba97be', 'volume_size': 1} Jul 10 07:01:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7de21f76-d65f-4367-b27e-b1e20505da05 tempest-ProjectReaderTests-934415171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:01:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7de21f76-d65f-4367-b27e-b1e20505da05 tempest-ProjectReaderTests-934415171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:01:53 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-7de21f76-d65f-4367-b27e-b1e20505da05 tempest-ProjectReaderTests-934415171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-736795668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=836b8f7e-cb8f-4aa1-8906-0f3d8bba97be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4857d23043b4508978a30e93ddf7cc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:01:53Z,use_quota=True,user_id='e20b6193ced042b2b80a424168ff2bf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:01:53 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-7de21f76-d65f-4367-b27e-b1e20505da05 tempest-ProjectReaderTests-934415171 None] Creating volume 836b8f7e-cb8f-4aa1-8906-0f3d8bba97be {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:01:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7de21f76-d65f-4367-b27e-b1e20505da05 tempest-ProjectReaderTests-934415171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:01:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7de21f76-d65f-4367-b27e-b1e20505da05 tempest-ProjectReaderTests-934415171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:01:53 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-7de21f76-d65f-4367-b27e-b1e20505da05 tempest-ProjectReaderTests-934415171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:01:53 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-7de21f76-d65f-4367-b27e-b1e20505da05 tempest-ProjectReaderTests-934415171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:01:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7de21f76-d65f-4367-b27e-b1e20505da05 tempest-ProjectReaderTests-934415171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:01:53 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-7de21f76-d65f-4367-b27e-b1e20505da05 tempest-ProjectReaderTests-934415171 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:01:53 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-7de21f76-d65f-4367-b27e-b1e20505da05 tempest-ProjectReaderTests-934415171 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 07:01:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7de21f76-d65f-4367-b27e-b1e20505da05 tempest-ProjectReaderTests-934415171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-836b8f7e-cb8f-4aa1-8906-0f3d8bba97be 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:53 devstack sudo[107948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-836b8f7e-cb8f-4aa1-8906-0f3d8bba97be 1073741824 Jul 10 07:01:53 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:53 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7de21f76-d65f-4367-b27e-b1e20505da05 tempest-ProjectReaderTests-934415171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-836b8f7e-cb8f-4aa1-8906-0f3d8bba97be 1073741824" returned: 0 in 0.778s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:53 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7de21f76-d65f-4367-b27e-b1e20505da05 tempest-ProjectReaderTests-934415171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-836b8f7e-cb8f-4aa1-8906-0f3d8bba97be {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:53 devstack sudo[107954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-836b8f7e-cb8f-4aa1-8906-0f3d8bba97be Jul 10 07:01:53 devstack sudo[107954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:54 devstack sudo[107954]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-7de21f76-d65f-4367-b27e-b1e20505da05 tempest-ProjectReaderTests-934415171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-836b8f7e-cb8f-4aa1-8906-0f3d8bba97be" returned: 0 in 0.603s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:54 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-7de21f76-d65f-4367-b27e-b1e20505da05 tempest-ProjectReaderTests-934415171 None] <== create_volume: return (1417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:01:54 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-7de21f76-d65f-4367-b27e-b1e20505da05 tempest-ProjectReaderTests-934415171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:01:54 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7de21f76-d65f-4367-b27e-b1e20505da05 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5568a10-6cfe-4cb2-ac7a-d5e66a526e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-836b8f7e-cb8f-4aa1-8906-0f3d8bba97be', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:54 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7de21f76-d65f-4367-b27e-b1e20505da05 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a4f36d0-695d-414c-bbac-7221b4231262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:54 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-7de21f76-d65f-4367-b27e-b1e20505da05 tempest-ProjectReaderTests-934415171 None] Volume volume-836b8f7e-cb8f-4aa1-8906-0f3d8bba97be (836b8f7e-cb8f-4aa1-8906-0f3d8bba97be): created successfully Jul 10 07:01:54 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7de21f76-d65f-4367-b27e-b1e20505da05 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a4f36d0-695d-414c-bbac-7221b4231262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:54 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-7de21f76-d65f-4367-b27e-b1e20505da05 tempest-ProjectReaderTests-934415171 None] Flow 'volume_create_manager' (8530f04c-cb31-4280-981c-1b943caf06c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:01:54 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-7de21f76-d65f-4367-b27e-b1e20505da05 tempest-ProjectReaderTests-934415171 None] Created volume successfully. Jul 10 07:01:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-07aa021b-73e3-4a97-a833-40ebcb6e4093 tempest-ProjectReaderTests-934415171 None] Acquiring lock "cinder-836b8f7e-cb8f-4aa1-8906-0f3d8bba97be-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:01:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-07aa021b-73e3-4a97-a833-40ebcb6e4093 tempest-ProjectReaderTests-934415171 None] Lock "cinder-836b8f7e-cb8f-4aa1-8906-0f3d8bba97be-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:01:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-07aa021b-73e3-4a97-a833-40ebcb6e4093 tempest-ProjectReaderTests-934415171 None] Acquiring lock "cinder-quobyte-836b8f7e-cb8f-4aa1-8906-0f3d8bba97be" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:01:55 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-07aa021b-73e3-4a97-a833-40ebcb6e4093 tempest-ProjectReaderTests-934415171 None] Lock "cinder-quobyte-836b8f7e-cb8f-4aa1-8906-0f3d8bba97be" acquired by "delete_volume" :: waited 0.019s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:01:55 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f347cb-2011-4292-97b8-6048aa186523]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:01:55 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-07aa021b-73e3-4a97-a833-40ebcb6e4093 tempest-ProjectReaderTests-934415171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-836b8f7e-cb8f-4aa1-8906-0f3d8bba97be {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:55 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-836b8f7e-cb8f-4aa1-8906-0f3d8bba97be Jul 10 07:01:55 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:56 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-07aa021b-73e3-4a97-a833-40ebcb6e4093 tempest-ProjectReaderTests-934415171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-836b8f7e-cb8f-4aa1-8906-0f3d8bba97be" returned: 0 in 0.725s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-07aa021b-73e3-4a97-a833-40ebcb6e4093 tempest-ProjectReaderTests-934415171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-836b8f7e-cb8f-4aa1-8906-0f3d8bba97be {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:56 devstack sudo[107963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-836b8f7e-cb8f-4aa1-8906-0f3d8bba97be Jul 10 07:01:56 devstack sudo[107963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:56 devstack sudo[107963]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-07aa021b-73e3-4a97-a833-40ebcb6e4093 tempest-ProjectReaderTests-934415171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-836b8f7e-cb8f-4aa1-8906-0f3d8bba97be" returned: 0 in 0.607s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:56 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-07aa021b-73e3-4a97-a833-40ebcb6e4093 tempest-ProjectReaderTests-934415171 None] Lock "cinder-quobyte-836b8f7e-cb8f-4aa1-8906-0f3d8bba97be" released by "delete_volume" :: held 1.366s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:01:56 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-07aa021b-73e3-4a97-a833-40ebcb6e4093 tempest-ProjectReaderTests-934415171 None] Created reservations ['bb67ac26-7478-4b40-a853-ff0ba134d90f', 'a38d878e-c767-445e-bfec-e5291d660ff2', '1a777398-87af-439d-b34f-133166ba869c', '560e2fe9-c15a-46cd-a00f-62e500bd3d75'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:01:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-07aa021b-73e3-4a97-a833-40ebcb6e4093 tempest-ProjectReaderTests-934415171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:01:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-07aa021b-73e3-4a97-a833-40ebcb6e4093 tempest-ProjectReaderTests-934415171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:01:56 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-07aa021b-73e3-4a97-a833-40ebcb6e4093 tempest-ProjectReaderTests-934415171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:01:56 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-07aa021b-73e3-4a97-a833-40ebcb6e4093 tempest-ProjectReaderTests-934415171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:01:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-07aa021b-73e3-4a97-a833-40ebcb6e4093 tempest-ProjectReaderTests-934415171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:01:56 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-07aa021b-73e3-4a97-a833-40ebcb6e4093 tempest-ProjectReaderTests-934415171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:56 devstack sudo[107968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 07:01:56 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:57 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-07aa021b-73e3-4a97-a833-40ebcb6e4093 tempest-ProjectReaderTests-934415171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.602s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:57 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-07aa021b-73e3-4a97-a833-40ebcb6e4093 tempest-ProjectReaderTests-934415171 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:01:57 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-07aa021b-73e3-4a97-a833-40ebcb6e4093 tempest-ProjectReaderTests-934415171 None] Deleted volume successfully. Jul 10 07:01:57 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-07aa021b-73e3-4a97-a833-40ebcb6e4093 tempest-ProjectReaderTests-934415171 None] Lock "cinder-836b8f7e-cb8f-4aa1-8906-0f3d8bba97be-delete_volume" released by "delete_volume" :: held 2.160s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:01:57 devstack cinder-volume[87294]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c9389cc-6455-43f5-86dd-04759f38b177 tempest-ProjectReaderTests-934415171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87294) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 07:01:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0c9389cc-6455-43f5-86dd-04759f38b177 tempest-ProjectReaderTests-934415171 None] Flow 'volume_create_manager' (bedc11b5-61c4-4f80-a769-22fdc3473911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:01:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0c9389cc-6455-43f5-86dd-04759f38b177 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3695517f-2da0-413b-b698-b64ec7ebefb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0c9389cc-6455-43f5-86dd-04759f38b177 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3695517f-2da0-413b-b698-b64ec7ebefb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:01:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1337241664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c8c032e-9086-499e-98da-1178b14838b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4857d23043b4508978a30e93ddf7cc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:01:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:01:58Z,use_quota=True,user_id='e20b6193ced042b2b80a424168ff2bf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0c9389cc-6455-43f5-86dd-04759f38b177 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (968817b5-7fb2-425d-82ef-b728c25eabbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0c9389cc-6455-43f5-86dd-04759f38b177 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (968817b5-7fb2-425d-82ef-b728c25eabbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0c9389cc-6455-43f5-86dd-04759f38b177 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0f8a328-aa3d-4e2d-a2b7-df9be56cc85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0c9389cc-6455-43f5-86dd-04759f38b177 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0f8a328-aa3d-4e2d-a2b7-df9be56cc85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c8c032e-9086-499e-98da-1178b14838b3', 'volume_name': 'volume-2c8c032e-9086-499e-98da-1178b14838b3', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0c9389cc-6455-43f5-86dd-04759f38b177 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15d59856-5918-4386-9b48-d14d1f0bf05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0c9389cc-6455-43f5-86dd-04759f38b177 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15d59856-5918-4386-9b48-d14d1f0bf05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:57 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0c9389cc-6455-43f5-86dd-04759f38b177 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83584f04-7661-4c4c-9810-f7e9335f1d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:57 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-0c9389cc-6455-43f5-86dd-04759f38b177 tempest-ProjectReaderTests-934415171 None] Volume 2c8c032e-9086-499e-98da-1178b14838b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c8c032e-9086-499e-98da-1178b14838b3', 'volume_size': 1} Jul 10 07:01:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-0c9389cc-6455-43f5-86dd-04759f38b177 tempest-ProjectReaderTests-934415171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:01:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-0c9389cc-6455-43f5-86dd-04759f38b177 tempest-ProjectReaderTests-934415171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:01:57 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-0c9389cc-6455-43f5-86dd-04759f38b177 tempest-ProjectReaderTests-934415171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T05:01:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1337241664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c8c032e-9086-499e-98da-1178b14838b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4857d23043b4508978a30e93ddf7cc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T05:01:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T05:01:58Z,use_quota=True,user_id='e20b6193ced042b2b80a424168ff2bf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9de46099-a20f-4038-b376-4bb13b22eb46),volume_type_id=9de46099-a20f-4038-b376-4bb13b22eb46)}" {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 07:01:57 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.remotefs [None req-0c9389cc-6455-43f5-86dd-04759f38b177 tempest-ProjectReaderTests-934415171 None] Creating volume 2c8c032e-9086-499e-98da-1178b14838b3 {{(pid=87294) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 07:01:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-0c9389cc-6455-43f5-86dd-04759f38b177 tempest-ProjectReaderTests-934415171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:01:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-0c9389cc-6455-43f5-86dd-04759f38b177 tempest-ProjectReaderTests-934415171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:01:57 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-0c9389cc-6455-43f5-86dd-04759f38b177 tempest-ProjectReaderTests-934415171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:01:57 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-0c9389cc-6455-43f5-86dd-04759f38b177 tempest-ProjectReaderTests-934415171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:01:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-0c9389cc-6455-43f5-86dd-04759f38b177 tempest-ProjectReaderTests-934415171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:01:57 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-0c9389cc-6455-43f5-86dd-04759f38b177 tempest-ProjectReaderTests-934415171 None] Selected osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 as target Quobyte volume. {{(pid=87294) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 07:01:57 devstack cinder-volume[87294]: INFO cinder.volume.drivers.remotefs [None req-0c9389cc-6455-43f5-86dd-04759f38b177 tempest-ProjectReaderTests-934415171 None] casted to osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804 Jul 10 07:01:57 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0c9389cc-6455-43f5-86dd-04759f38b177 tempest-ProjectReaderTests-934415171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2c8c032e-9086-499e-98da-1178b14838b3 1073741824 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:57 devstack sudo[107971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2c8c032e-9086-499e-98da-1178b14838b3 1073741824 Jul 10 07:01:57 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:58 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0c9389cc-6455-43f5-86dd-04759f38b177 tempest-ProjectReaderTests-934415171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2c8c032e-9086-499e-98da-1178b14838b3 1073741824" returned: 0 in 0.769s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:58 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0c9389cc-6455-43f5-86dd-04759f38b177 tempest-ProjectReaderTests-934415171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2c8c032e-9086-499e-98da-1178b14838b3 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:01:58 devstack sudo[107977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2c8c032e-9086-499e-98da-1178b14838b3 Jul 10 07:01:58 devstack sudo[107977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:01:59 devstack sudo[107977]: pam_unix(sudo:session): session closed for user root Jul 10 07:01:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-0c9389cc-6455-43f5-86dd-04759f38b177 tempest-ProjectReaderTests-934415171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2c8c032e-9086-499e-98da-1178b14838b3" returned: 0 in 0.609s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:01:59 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-0c9389cc-6455-43f5-86dd-04759f38b177 tempest-ProjectReaderTests-934415171 None] <== create_volume: return (1427ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'} {{(pid=87294) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 07:01:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-0c9389cc-6455-43f5-86dd-04759f38b177 tempest-ProjectReaderTests-934415171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.430s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:01:59 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:SELECT=72,cinder:INSERT=28,cinder:UPDATE=100,cinder:DELETE=7 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:01:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0c9389cc-6455-43f5-86dd-04759f38b177 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83584f04-7661-4c4c-9810-f7e9335f1d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c8c032e-9086-499e-98da-1178b14838b3', 'volume_size': 1}' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0c9389cc-6455-43f5-86dd-04759f38b177 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bee3fde8-04ec-4d85-a9ef-0afe99f8cf91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 07:01:59 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:INSERT=26,cinder:UPDATE=106,cinder:SELECT=75,cinder:DELETE=9 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:01:59 devstack cinder-volume[87294]: INFO cinder.volume.flows.manager.create_volume [None req-0c9389cc-6455-43f5-86dd-04759f38b177 tempest-ProjectReaderTests-934415171 None] Volume volume-2c8c032e-9086-499e-98da-1178b14838b3 (2c8c032e-9086-499e-98da-1178b14838b3): created successfully Jul 10 07:01:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0c9389cc-6455-43f5-86dd-04759f38b177 tempest-ProjectReaderTests-934415171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bee3fde8-04ec-4d85-a9ef-0afe99f8cf91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87294) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 07:01:59 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-0c9389cc-6455-43f5-86dd-04759f38b177 tempest-ProjectReaderTests-934415171 None] Flow 'volume_create_manager' (bedc11b5-61c4-4f80-a769-22fdc3473911) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87294) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 07:01:59 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-0c9389cc-6455-43f5-86dd-04759f38b177 tempest-ProjectReaderTests-934415171 None] Created volume successfully. Jul 10 07:01:59 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-78097531-5ded-4456-a425-fd0c392ff405 tempest-ProjectReaderTests-934415171 None] Acquiring lock "cinder-2c8c032e-9086-499e-98da-1178b14838b3-delete_volume" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:01:59 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-78097531-5ded-4456-a425-fd0c392ff405 tempest-ProjectReaderTests-934415171 None] Lock "cinder-2c8c032e-9086-499e-98da-1178b14838b3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:01:59 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-78097531-5ded-4456-a425-fd0c392ff405 tempest-ProjectReaderTests-934415171 None] Acquiring lock "cinder-quobyte-2c8c032e-9086-499e-98da-1178b14838b3" by "delete_volume" {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 07:01:59 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-78097531-5ded-4456-a425-fd0c392ff405 tempest-ProjectReaderTests-934415171 None] Lock "cinder-quobyte-2c8c032e-9086-499e-98da-1178b14838b3" acquired by "delete_volume" :: waited 0.017s {{(pid=87294) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 07:01:59 devstack cinder-volume[87294]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4109985-3220-4ce9-9f94-3f4871803792]: (4, 'qcow2') {{(pid=88469) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 07:01:59 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-78097531-5ded-4456-a425-fd0c392ff405 tempest-ProjectReaderTests-934415171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2c8c032e-9086-499e-98da-1178b14838b3 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:00 devstack sudo[107980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2c8c032e-9086-499e-98da-1178b14838b3 Jul 10 07:02:00 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:00 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-78097531-5ded-4456-a425-fd0c392ff405 tempest-ProjectReaderTests-934415171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2c8c032e-9086-499e-98da-1178b14838b3" returned: 0 in 0.738s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:00 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-78097531-5ded-4456-a425-fd0c392ff405 tempest-ProjectReaderTests-934415171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2c8c032e-9086-499e-98da-1178b14838b3 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:00 devstack sudo[107986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2c8c032e-9086-499e-98da-1178b14838b3 Jul 10 07:02:00 devstack sudo[107986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:01 devstack sudo[107986]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-78097531-5ded-4456-a425-fd0c392ff405 tempest-ProjectReaderTests-934415171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0/volume-2c8c032e-9086-499e-98da-1178b14838b3" returned: 0 in 0.603s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:01 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-78097531-5ded-4456-a425-fd0c392ff405 tempest-ProjectReaderTests-934415171 None] Lock "cinder-quobyte-2c8c032e-9086-499e-98da-1178b14838b3" released by "delete_volume" :: held 1.376s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:02:01 devstack cinder-volume[87294]: DEBUG cinder.quota [None req-78097531-5ded-4456-a425-fd0c392ff405 tempest-ProjectReaderTests-934415171 None] Created reservations ['cc4174ea-3d5d-4909-a5f1-887f28dd4717', '7bef4763-ff0b-45fa-be5a-eb48e3912138', '3a5f582d-a2ea-4ebd-8336-62a9dd722fb0', 'd73aa893-f0dd-4315-943d-ad933f819360'] {{(pid=87294) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 07:02:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-78097531-5ded-4456-a425-fd0c392ff405 tempest-ProjectReaderTests-934415171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-78097531-5ded-4456-a425-fd0c392ff405 tempest-ProjectReaderTests-934415171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:01 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-78097531-5ded-4456-a425-fd0c392ff405 tempest-ProjectReaderTests-934415171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:02:01 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-78097531-5ded-4456-a425-fd0c392ff405 tempest-ProjectReaderTests-934415171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:02:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-78097531-5ded-4456-a425-fd0c392ff405 tempest-ProjectReaderTests-934415171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:01 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-78097531-5ded-4456-a425-fd0c392ff405 tempest-ProjectReaderTests-934415171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:01 devstack sudo[107989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 07:02:01 devstack sudo[107989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:02 devstack sudo[107989]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:02 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-78097531-5ded-4456-a425-fd0c392ff405 tempest-ProjectReaderTests-934415171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.608s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:02 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-78097531-5ded-4456-a425-fd0c392ff405 tempest-ProjectReaderTests-934415171 None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:02:02 devstack cinder-volume[87294]: INFO cinder.volume.manager [None req-78097531-5ded-4456-a425-fd0c392ff405 tempest-ProjectReaderTests-934415171 None] Deleted volume successfully. Jul 10 07:02:02 devstack cinder-volume[87294]: DEBUG cinder.coordination [None req-78097531-5ded-4456-a425-fd0c392ff405 tempest-ProjectReaderTests-934415171 None] Lock "cinder-2c8c032e-9086-499e-98da-1178b14838b3-delete_volume" released by "delete_volume" :: held 2.177s {{(pid=87294) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 07:02:11 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:UPDATE=9,cinder:SELECT=5,cinder:INSERT=2 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:02:12 devstack cinder-volume[87294]: DEBUG dbcounter [-] [87294] Writing DB stats cinder:UPDATE=8,cinder:DELETE=2,cinder:SELECT=5,cinder:INSERT=2 {{(pid=87294) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 07:02:21 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:02:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 07:02:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 07:02:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804': None} {{(pid=87294) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 07:02:21 devstack cinder-volume[87294]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eafd61c5-0a15-4211-b5dc-4e278582f804'] {{(pid=87294) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 07:02:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.lockutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87294) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 07:02:21 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 07:02:21 devstack sudo[108245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0 Jul 10 07:02:21 devstack sudo[108245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 07:02:22 devstack sudo[108245]: pam_unix(sudo:session): session closed for user root Jul 10 07:02:22 devstack cinder-volume[87294]: DEBUG oslo_concurrency.processutils [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d5ac996c0061e495be12afd4793251c0" returned: 0 in 0.652s {{(pid=87294) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 07:02:22 devstack cinder-volume[87294]: DEBUG cinder.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Notifying Schedulers of capabilities ... {{(pid=87294) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 07:02:22 devstack cinder-volume[87294]: DEBUG oslo_service.periodic_task [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] Running periodic task VolumeManager._thread_info {{(pid=87294) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 07:02:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread count: 28 {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 07:02:22 devstack cinder-volume[87294]: DEBUG cinder.volume.manager [None req-f3eb85ae-08fa-4df5-9ffa-f7ba88d49ed9 None None] thread info: [<_MainThread(MainThread, started 139245706264704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87294) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}